summaryrefslogtreecommitdiffstats
path: root/Parser/tokenizer.c
Commit message (Expand)AuthorAgeFilesLines
* Fix an issue in the tokenizer, where a file is opened by fd, but the underlyi...Kristján Valur Jónsson2008-12-181-2/+2
* Latin-1 source code was not being properly decoded when passed throughBrett Cannon2008-10-171-2/+2
* Issues #2384 and #3975: Tracebacks were not correctly printed when the source...Amaury Forgeot d'Arc2008-10-091-0/+8
* Follow-up of #3773: In PyTokenizer_FindEncoding, remove the call to PyErr_NoM...Amaury Forgeot d'Arc2008-09-041-2/+0
* #3773: Check for errors around the use of PyTokenizer_FindEncoding().Amaury Forgeot d'Arc2008-09-041-1/+4
* PyTokenizer_FindEncoding() always failed because it set the tokenizer stateBrett Cannon2008-09-041-2/+6
* Rename PyUnicode_AsString -> _PyUnicode_AsString andMarc-André Lemburg2008-08-071-1/+1
* Renamed files bytesobject.[ch] and stringobject.[ch]Christian Heimes2008-05-261-1/+1
* Renamed PyString to PyBytesChristian Heimes2008-05-261-4/+4
* Renamed PyBytes to PyByteArrayChristian Heimes2008-05-261-4/+4
* Merged revisions 62425-62429,62434-62436,62441,62444,62446-62448,62450-62455,...Christian Heimes2008-05-041-1/+1
* Merged revisions 61981,61984-61987,61992-61993,61997-62000 via svnmerge fromChristian Heimes2008-03-281-8/+0
* Bug #2301: Don't try decoding the source code into the originalMartin v. Löwis2008-03-171-64/+0
* Merged revisions 60350-60363 via svnmerge fromChristian Heimes2008-01-271-0/+1
* Merged revisions 60176-60209 via svnmerge fromChristian Heimes2008-01-231-1/+1
* Merged revisions 60151-60159,60161-60168,60170,60172-60173,60175 via svnmerge...Georg Brandl2008-01-211-2/+13
* Merged revisions 60080-60089,60091-60093 via svnmerge fromGeorg Brandl2008-01-191-0/+19
* More PyImport_ImportModule -> PyImport_ImportModuleNoBlockChristian Heimes2008-01-031-1/+1
* #1629: Renamed Py_Size, Py_Type and Py_Refcnt to Py_SIZE, Py_TYPE and Py_REFCNT.Christian Heimes2007-12-191-1/+1
* Problem found while converting from PyBytes to PyString:Amaury Forgeot d'Arc2007-11-221-7/+17
* Cleanup of tokenizer.c.Guido van Rossum2007-11-161-61/+47
* Correction for issue1134: all source files with a coding spec, except latin-1Amaury Forgeot d'Arc2007-11-151-14/+29
* Merging the py3k-pep3137 branch back into the py3k branch.Guido van Rossum2007-11-061-12/+11
* Issue 1267, continued.Guido van Rossum2007-10-221-16/+20
* Make sure the malloc'ed string has space for the null byte.Brett Cannon2007-10-211-1/+1
* Fix PyTokenizer_FindEncoding() for OS X 10.4. Turns out that seeking to theBrett Cannon2007-10-201-4/+11
* Plug a memory leak where a struct tok_state was not being freed.Brett Cannon2007-10-201-3/+11
* Patch 1267 by Christian Heimes.Guido van Rossum2007-10-191-1/+22
* Fix another stray PyString reference that should be PyBytes; and its comment.Guido van Rossum2007-10-101-2/+2
* Fix an issue in PyTokenizer_RestoreEncoding() which was treating a PyBytesGuido van Rossum2007-10-101-5/+10
* Use an enum for decoding_state. It makes the code a little moreNeil Schemenauer2007-09-211-11/+11
* Merged revisions 57778-58052 via svnmerge fromThomas Wouters2007-09-081-0/+62
* Convert code from sys.stdin.encoding to UTF-8 inMartin v. Löwis2007-09-041-1/+35
* Fix an outdated URL in a SyntaxError message.Guido van Rossum2007-08-301-1/+1
* Fix issue # 1037 (sort of).Guido van Rossum2007-08-291-2/+8
* Add PyUnicode_AsStringAndSize(), which is like PyUnicode_AsString() butGuido van Rossum2007-08-291-1/+2
* Implement PEP 3131. Add isidentifier to str.Martin v. Löwis2007-08-151-3/+26
* Fix refleaks from execfile('file that contains a # coding: line')Neal Norwitz2007-08-121-11/+21
* Fix problem when exec'ing a string with a codingNeal Norwitz2007-08-111-1/+1
* Implement PEP 3120.Martin v. Löwis2007-07-291-5/+34
* Merged revisions 55817-55961 via svnmerge fromGuido van Rossum2007-06-131-12/+21
* Rip out the file object's implementation.Guido van Rossum2007-06-121-64/+0
* Make identifiers str (not str8) objects throughout.Martin v. Löwis2007-06-101-2/+13
* tokenizer.c: make coding markup work again.Guido van Rossum2007-06-071-13/+17
* Use AsCharBuffer to get a C string out of a Python string.Guido van Rossum2007-05-091-29/+16
* Kill u"..." string quotes. Thought I already did that.Guido van Rossum2007-05-081-8/+0
* More coding by random modification.Guido van Rossum2007-05-041-3/+3
* Get rid of all #ifdef Py_USING_UNICODE (it is always present now).Guido van Rossum2007-05-031-22/+2
* Make ELLIPSIS a separate token. This makes it a syntax error to write ". . ...Georg Brandl2007-03-181-5/+25
* Bytes literal.Thomas Wouters2007-02-231-0/+8