summaryrefslogtreecommitdiffstats
path: root/Lib/codecs.py
Commit message (Collapse)AuthorAgeFilesLines
* Issue #12160: Fix incorrect StreamCodec references in Codec.encode() and ↵Berker Peksag2015-07-301-4/+4
| | | | | | | | Codec.decode() docs. It should StreamWriter for Codecs.encode() and StreamReader for Codec.decode(). Patch by Nick Weinhold.
* Issue #19543: Emit deprecation warning for known non-text encodings.Serhiy Storchaka2015-05-311-1/+13
| | | | | | | | | | Backported issues #19619: encode() and decode() methods and constructors of str, unicode and bytearray classes now emit deprecation warning for known non-text encodings when Python is ran with the -3 option. Backported issues #20404: io.TextIOWrapper (and hence io.open()) now uses the internal codec marking system added to emit deprecation warning for known non-text encodings at stream construction time when Python is ran with the -3 option.
* Escaped backslashes in docstrings.Serhiy Storchaka2015-04-031-1/+1
|
* Issue #23071: Added missing names to codecs.__all__. Patch by Martin Panter.Serhiy Storchaka2014-12-201-1/+7
|
* Fixed a bug in previous changeset: StreamReader returned '' instead of u''.Serhiy Storchaka2014-01-261-2/+0
|
* Issue #8260: The read(), readline() and readlines() methods ofSerhiy Storchaka2014-01-261-8/+7
| | | | | codecs.StreamReader returned incomplete data when were called after readline() or read(size). Based on patch by Amaury Forgeot d'Arc.
* Issue #6268: More bugfixes about BOM, UTF-16 and UTF-32Victor Stinner2010-05-221-3/+10
| | | | | | | * Fix seek() method of codecs.open(), don't write the BOM twice after seek(0) * Fix reset() method of codecs, UTF-16, UTF-32 and StreamWriter classes * test_codecs: use "w+" mode instead of "wt+". "t" mode is not supported by Solaris or Windows, but does it really exist? I found it the in the issue.
* Issue #6268: Fix seek() method of codecs.open(), don't read the BOM twiceVictor Stinner2010-05-221-0/+4
| | | | after seek(0)
* #691291: codecs.open() should not convert end of lines on reading and writing.Florent Xicluna2010-02-261-4/+9
|
* Merged revisions ↵Christian Heimes2008-03-261-0/+48
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | 61750,61752,61754,61756,61760,61763,61768,61772,61775,61805,61809,61812,61819,61917,61920,61930,61933-61934 via svnmerge from svn+ssh://pythondev@svn.python.org/python/branches/trunk-bytearray ........ r61750 | christian.heimes | 2008-03-22 20:47:44 +0100 (Sat, 22 Mar 2008) | 1 line Copied files from py3k w/o modifications ........ r61752 | christian.heimes | 2008-03-22 20:53:20 +0100 (Sat, 22 Mar 2008) | 7 lines Take One * Added initialization code, warnings, flags etc. to the appropriate places * Added new buffer interface to string type * Modified tests * Modified Makefile.pre.in to compile the new files * Added bytesobject.c to Python.h ........ r61754 | christian.heimes | 2008-03-22 21:22:19 +0100 (Sat, 22 Mar 2008) | 2 lines Disabled bytearray.extend for now since it causes an infinite recursion Fixed serveral unit tests ........ r61756 | christian.heimes | 2008-03-22 21:43:38 +0100 (Sat, 22 Mar 2008) | 5 lines Added PyBytes support to several places: str + bytearray ord(bytearray) bytearray(str, encoding) ........ r61760 | christian.heimes | 2008-03-22 21:56:32 +0100 (Sat, 22 Mar 2008) | 1 line Fixed more unit tests related to type('') is not unicode ........ r61763 | christian.heimes | 2008-03-22 22:20:28 +0100 (Sat, 22 Mar 2008) | 2 lines Fixed more unit tests Fixed bytearray.extend ........ r61768 | christian.heimes | 2008-03-22 22:40:50 +0100 (Sat, 22 Mar 2008) | 1 line Implemented old buffer interface for bytearray ........ r61772 | christian.heimes | 2008-03-22 23:24:52 +0100 (Sat, 22 Mar 2008) | 1 line Added backport of the io module ........ r61775 | christian.heimes | 2008-03-23 03:50:49 +0100 (Sun, 23 Mar 2008) | 1 line Fix str assignement to bytearray. Assignment of a str of size 1 is interpreted as a single byte ........ r61805 | christian.heimes | 2008-03-23 19:33:48 +0100 (Sun, 23 Mar 2008) | 3 lines Fixed more tests Fixed bytearray() comparsion with unicode() Fixed iterator assignment of bytearray ........ r61809 | christian.heimes | 2008-03-23 21:02:21 +0100 (Sun, 23 Mar 2008) | 2 lines str(bytesarray()) now returns the bytes and not the representation of the bytearray object Enabled and fixed more unit tests ........ r61812 | christian.heimes | 2008-03-23 21:53:08 +0100 (Sun, 23 Mar 2008) | 3 lines Clear error PyNumber_AsSsize_t() fails Use CHARMASK for ob_svall access disabled a test with memoryview again ........ r61819 | christian.heimes | 2008-03-23 23:05:57 +0100 (Sun, 23 Mar 2008) | 1 line Untested updates to the PCBuild directory ........ r61917 | christian.heimes | 2008-03-26 00:57:06 +0100 (Wed, 26 Mar 2008) | 1 line The type system of Python 2.6 has subtle differences to 3.0's. I've removed the Py_TPFLAGS_BASETYPE flags from bytearray for now. bytearray can't be subclasses until the issues with bytearray subclasses are fixed. ........ r61920 | christian.heimes | 2008-03-26 01:44:08 +0100 (Wed, 26 Mar 2008) | 2 lines Disabled last failing test I don't understand what the test is testing and how it suppose to work. Ka-Ping, please check it out. ........ r61930 | christian.heimes | 2008-03-26 12:46:18 +0100 (Wed, 26 Mar 2008) | 1 line Re-enabled bytes warning code ........ r61933 | christian.heimes | 2008-03-26 13:20:46 +0100 (Wed, 26 Mar 2008) | 1 line Fixed a bug in the new buffer protocol. The buffer slots weren't copied into a subclass. ........ r61934 | christian.heimes | 2008-03-26 13:25:09 +0100 (Wed, 26 Mar 2008) | 1 line Re-enabled bytearray subclassing - all tests are passing. ........
* Fix codecs.EncodedFile which did not use file_encoding in 2.5.0, andGeorg Brandl2006-10-291-3/+30
| | | | | fix all codecs file wrappers to work correctly with the "with" statement (bug #1586513).
* Add a BufferedIncrementalEncoder class that can be used for implementingWalter Dörwald2006-04-141-0/+27
| | | | | | | | | an incremental encoder that must retain part of the data between calls to the encode() method. Fix the incremental encoder and decoder for the IDNA encoding. This closes SF patch #1453235.
* Fix wrong attribute name.Walter Dörwald2006-04-141-1/+1
|
* Change raise statement to PEP 8 style.Walter Dörwald2006-03-181-2/+1
|
* Add some versionadded info to new incremental codec docs and fix doco nits.Neal Norwitz2006-03-161-2/+2
|
* Patch #1436130: codecs.lookup() now returns a CodecInfo object (a subclassWalter Dörwald2006-03-151-11/+172
| | | | | | | of tuple) that provides incremental decoders and encoders (a way to use stateful codecs without the stream API). Functions codecs.getincrementaldecoder() and codecs.getincrementalencoder() have been added.
* If size is specified, try to read at least size characters.Walter Dörwald2006-03-061-1/+4
| | | | This is a alternative version of patch #1379332.
* Whitespace normalization.Tim Peters2005-12-251-2/+2
|
* Patch #1268314: Cache lines in StreamReader.readlines for performance.Martin v. Löwis2005-09-181-0/+37
| | | | Will backport to Python 2.4.
* SF bug #1235646: codecs.StreamRecoder.next() now reencodes the data it readsWalter Dörwald2005-09-011-1/+3
| | | | | from the input stream, so that the output is a byte string in the correct encoding instead of a unicode string.
* Return complete lines from codec stream readersMartin v. Löwis2005-08-241-3/+17
| | | | | | even if there is an exception in later lines, resulting in correct line numbers for decoding errors in source code. Fixes #1178484. Will backport to 2.4.
* Make attributes and local variables in the StreamReader str objects insteadWalter Dörwald2005-07-201-5/+7
| | | | | of unicode objects, so that codecs that do a str->str decoding won't promote the result to unicode. This fixes SF bug #1241507.
* Fix comment.Walter Dörwald2005-04-211-2/+2
|
* If the data read from the bytestream in readline() ends in a '\r' read one moreWalter Dörwald2005-04-211-12/+4
| | | | | | | | | | | byte, even if the user has passed a size parameter. This extra byte shouldn't cause a buffer overflow in the tokenizer. The original plan was to return a line ending in '\r', which might be recognizable as a complete line and skip any '\n' that was read afterwards. Unfortunately this didn't work, as the tokenizer only recognizes '\n' as line ends, which in turn lead to joined lines and SyntaxErrors, so this special treatment of a split '\r\n' has been dropped. (It can only happen with a temporarily exhausted bytestream now anyway.) Fixes parts of SF bugs #1163244 and #1175396.
* Fix typos.Walter Dörwald2005-04-041-2/+2
|
* Fix for SF bug #1175396: readline() will now read one more character, ifWalter Dörwald2005-04-041-0/+9
| | | | | | | | | | | | the last character read is "\r" (and size is None, i.e. we're allowed to call read() multiple times), so that we can return the correct line ending (this additional character might be a "\n"). If the stream is temporarily exhausted, we might return the wrong line ending (if the last character read is "\r" and the next one (after the byte stream provides more data) is "\n", but at least the atcr member ensure that we get the correct number of lines (i.e. this "\n" will not be treated as another line ending.)
* typoSkip Montanaro2005-03-161-1/+1
|
* Add default value for "whence" argument.Walter Dörwald2005-03-141-1/+1
|
* Reset internal buffers when seek() is called. This fixes SF bug #1156259.Walter Dörwald2005-03-141-1/+11
|
* Build with --disable-unicode again. Fixes #1158607.Martin v. Löwis2005-03-081-5/+13
| | | | Will backport to 2.4.
* Fix and test for SF bug #1098990: codec readline() splits lines apart.Walter Dörwald2005-01-101-2/+2
|
* The changes to the stateful codecs in 2.4 resulted in StreamReader.readline()Walter Dörwald2004-12-211-30/+41
| | | | | | | | | | | | | | trying to return a complete line even if a size parameter was given (see http://www.python.org/sf/1076985). This leads to buffer overflows with long source lines under Windows if e.g. cp1252 is used as the source encoding. This patch reverts the behaviour of readline() to something that behaves more like Python 2.3: If a size parameter is given, read() is called only once. As a side effect of this, readline() now supports all types of linebreaks supported by unicode.splitlines(). Note that the tokenizer is still broken and it's possible to provoke segfaults (see http://www.python.org/sf/1089395).
* SF #1048865: Fix a trivial typo that breaks StreamReader.readlines()Hye-Shik Chang2004-10-171-1/+1
|
* SF patch #998993: The UTF-8 and the UTF-16 stateful decoders now supportWalter Dörwald2004-09-071-43/+69
| | | | | | | | | | | decoding incomplete input (when the input stream is temporarily exhausted). codecs.StreamReader now implements buffering, which enables proper readline support for the UTF-16 decoders. codecs.StreamReader.read() has a new argument chars which specifies the number of characters to return. codecs.StreamReader.readline() and codecs.StreamReader.readlines() have a new argument keepends. Trailing "\n"s will be stripped from the lines if keepends is false. Added C APIs PyUnicode_DecodeUTF8Stateful and PyUnicode_DecodeUTF16Stateful.
* Ignore sizehint argument. Fixes SF #844561.Marc-André Lemburg2004-02-261-10/+4
|
* Fix typos.Walter Dörwald2003-02-021-4/+4
|
* sys was already imported, remove second importNeal Norwitz2002-12-301-2/+0
|
* Patch to make _codecs a builtin module. This is necessary sinceMarc-André Lemburg2002-12-121-5/+15
| | | | | | | Python 2.3 will support source code encodings which rely on the builtin codecs being available to the parser. Remove struct dependency from codecs.py
* Add missing documentation for the PEP 293 functionality toWalter Dörwald2002-11-191-7/+22
| | | | the codecs docstrings.
* Add next() and __iter__() methods to StreamReader, StreamReaderWriterWalter Dörwald2002-11-061-0/+27
| | | | | | and StreamRecoder. This closes SF bug #634246.
* PEP 293 implemention (from SF patch http://www.python.org/sf/432401)Walter Dörwald2002-09-021-1/+12
|
* Add constants BOM_UTF8, BOM_UTF16, BOM_UTF16_LE, BOM_UTF16_BE,Walter Dörwald2002-06-041-17/+32
| | | | | | | | | | BOM_UTF32, BOM_UTF32_LE and BOM_UTF32_BE that represent the Byte Order Mark in UTF-8, UTF-16 and UTF-32 encodings for little and big endian systems. The old names BOM32_* and BOM64_* were off by a factor of 2. This closes SF bug http://www.python.org/sf/555360
* SF 563203. Replaced 'has_key()' with 'in'.Raymond Hettinger2002-06-011-1/+1
|
* Set default value for readlines.sizehint to None. Change needed for 2.2.1Martin v. Löwis2002-03-051-1/+1
| | | | as well.
* Added new helpers for easy access to codecs. Docs will follow.Marc-André Lemburg2001-09-191-0/+42
|
* Fix typo in commentAndrew M. Kuchling2001-09-181-1/+1
|
* Patch #444359: Remove unused imports.Martin v. Löwis2001-08-021-1/+1
|
* Add dead imports of modules that are "magically" imported.Martin v. Löwis2001-07-311-0/+6
|
* Whitespace normalization.Tim Peters2001-05-291-1/+1
|
* Moved the encoding map building logic from the individual mappingMarc-André Lemburg2001-05-161-0/+21
| | | | | | codec files to codecs.py and added logic so that multi mappings in the decoding maps now result in mappings to None (undefined mapping) in the encoding maps.
generated by cgit v0.12 at 2025-03-27 16:05:51 (GMT)