summaryrefslogtreecommitdiffstats
path: root/Parser/tokenizer.c
Commit message (Expand)AuthorAgeFilesLines
* Cleanup of tokenizer.c.Guido van Rossum2007-11-161-61/+47
* Correction for issue1134: all source files with a coding spec, except latin-1Amaury Forgeot d'Arc2007-11-151-14/+29
* Merging the py3k-pep3137 branch back into the py3k branch.Guido van Rossum2007-11-061-12/+11
* Issue 1267, continued.Guido van Rossum2007-10-221-16/+20
* Make sure the malloc'ed string has space for the null byte.Brett Cannon2007-10-211-1/+1
* Fix PyTokenizer_FindEncoding() for OS X 10.4. Turns out that seeking to theBrett Cannon2007-10-201-4/+11
* Plug a memory leak where a struct tok_state was not being freed.Brett Cannon2007-10-201-3/+11
* Patch 1267 by Christian Heimes.Guido van Rossum2007-10-191-1/+22
* Fix another stray PyString reference that should be PyBytes; and its comment.Guido van Rossum2007-10-101-2/+2
* Fix an issue in PyTokenizer_RestoreEncoding() which was treating a PyBytesGuido van Rossum2007-10-101-5/+10
* Use an enum for decoding_state. It makes the code a little moreNeil Schemenauer2007-09-211-11/+11
* Merged revisions 57778-58052 via svnmerge fromThomas Wouters2007-09-081-0/+62
* Convert code from sys.stdin.encoding to UTF-8 inMartin v. Löwis2007-09-041-1/+35
* Fix an outdated URL in a SyntaxError message.Guido van Rossum2007-08-301-1/+1
* Fix issue # 1037 (sort of).Guido van Rossum2007-08-291-2/+8
* Add PyUnicode_AsStringAndSize(), which is like PyUnicode_AsString() butGuido van Rossum2007-08-291-1/+2
* Implement PEP 3131. Add isidentifier to str.Martin v. Löwis2007-08-151-3/+26
* Fix refleaks from execfile('file that contains a # coding: line')Neal Norwitz2007-08-121-11/+21
* Fix problem when exec'ing a string with a codingNeal Norwitz2007-08-111-1/+1
* Implement PEP 3120.Martin v. Löwis2007-07-291-5/+34
* Merged revisions 55817-55961 via svnmerge fromGuido van Rossum2007-06-131-12/+21
* Rip out the file object's implementation.Guido van Rossum2007-06-121-64/+0
* Make identifiers str (not str8) objects throughout.Martin v. Löwis2007-06-101-2/+13
* tokenizer.c: make coding markup work again.Guido van Rossum2007-06-071-13/+17
* Use AsCharBuffer to get a C string out of a Python string.Guido van Rossum2007-05-091-29/+16
* Kill u"..." string quotes. Thought I already did that.Guido van Rossum2007-05-081-8/+0
* More coding by random modification.Guido van Rossum2007-05-041-3/+3
* Get rid of all #ifdef Py_USING_UNICODE (it is always present now).Guido van Rossum2007-05-031-22/+2
* Make ELLIPSIS a separate token. This makes it a syntax error to write ". . ...Georg Brandl2007-03-181-5/+25
* Bytes literal.Thomas Wouters2007-02-231-0/+8
* Rip out 'long' and 'L'-suffixed integer literals.Guido van Rossum2007-01-151-5/+1
* PEP 3107 - Function Annotations thanks to Tony LowndsNeal Norwitz2006-12-281-0/+2
* Four months of trunk changes (including a few releases...)Thomas Wouters2006-12-131-1/+1
* Remove support for backticks from the grammar and compiler.Brett Cannon2006-08-251-2/+0
* Killed the <> operator. You must now use !=.Guido van Rossum2006-08-241-1/+0
* Partially merge trunk into p3yk. The removal of Mac/Tools is confusing svnThomas Wouters2006-06-081-9/+11
* Merge p3yk branch with the trunk up to revision 45595. This breaks a fairThomas Wouters2006-04-211-51/+59
* Make 'python -tt' the default, meaning Python won't allow mixing tabs andThomas Wouters2006-04-141-35/+4
* Fix crashing bug in tokenizer, when tokenizing files with non-ASCII bytesThomas Wouters2006-03-021-0/+5
* Patch #1440601: Add col_offset attribute to AST nodes.Martin v. Löwis2006-03-011-0/+5
* Change non-ASCII warning into a SyntaxError.Martin v. Löwis2006-02-281-10/+6
* Use Py_ssize_t to count the length.Martin v. Löwis2006-02-161-1/+1
* Merge ssize_t branch.Martin v. Löwis2006-02-151-10/+10
* Fix SF bug #1072182, problems with signed characters.Neal Norwitz2005-12-191-1/+1
* Fix Bug #1378022, UTF-8 files with a leading BOM crashed the interpreter.Neal Norwitz2005-12-181-0/+6
* Fix some more memory leaks.Neal Norwitz2005-11-161-6/+11
* Free coding spec (cs) if there was an error to prevent mem leak. Maybe backp...Neal Norwitz2005-10-211-0/+3
* - Fix segfault with invalid coding.Neal Norwitz2005-10-021-1/+4
* Apply SF patch #1101726: Fix buffer overrun in tokenizer.c when a source fileWalter Dörwald2005-07-121-27/+45
* Patch #802188: better parser error message for non-EOL following line cont.Martin v. Löwis2005-03-031-1/+1