| Commit message (Expand) | Author | Age | Files | Lines |
|---|
| * | whitespace | Terry Jan Reedy | 2014-02-24 | 1 | -1/+1 |
|
|
| * | Issue #9974: When untokenizing, use row info to insert backslash+newline. | Terry Jan Reedy | 2014-02-24 | 1 | -0/+6 |
|
|
| * | Issue #8478: Untokenizer.compat now processes first token from iterator input. | Terry Jan Reedy | 2014-02-18 | 1 | -13/+11 |
|
|
| * | Untokenize: An logically incorrect assert tested user input validity. | Terry Jan Reedy | 2014-02-17 | 1 | -1/+3 |
|
|
| * | Issue #18960: Fix bugs with Python source code encoding in the second line. | Serhiy Storchaka | 2014-01-09 | 1 | -0/+3 |
|
|
| * | #19620: Fix typo in docstring (noticed by Christopher Welborn). | Ezio Melotti | 2013-11-25 | 1 | -1/+1 |
|
|
| * | Issue #18873: The tokenize module, IDLE, 2to3, and the findnocoding.py script | Serhiy Storchaka | 2013-09-16 | 1 | -4/+4 |
|
|
| * | #16152: merge with 3.2. | Ezio Melotti | 2012-11-03 | 1 | -1/+3 |
| |\ |
|
| | * | #16152: fix tokenize to ignore whitespace at the end of the code when no newl... | Ezio Melotti | 2012-11-03 | 1 | -1/+3 |
|
|
| * | | Merge branch | Florent Xicluna | 2012-07-07 | 1 | -1/+1 |
| |\ \
| |/ |
|
| | * | Issue #14990: tokenize: correctly fail with SyntaxError on invalid encoding d... | Florent Xicluna | 2012-07-07 | 1 | -1/+1 |
|
|
| * | | Issue #15096: Drop support for the ur string prefix | Christian Heimes | 2012-06-20 | 1 | -9/+3 |
|
|
| * | | Issue #15054: Fix incorrect tokenization of 'b' string literals. | Meador Inge | 2012-06-17 | 1 | -1/+1 |
|
|
| * | | Issue #14629: Mention the filename in SyntaxError exceptions from | Brett Cannon | 2012-04-20 | 1 | -3/+19 |
|
|
| * | | merge 3.2: issue 14629 | Martin v. Löwis | 2012-04-20 | 1 | -2/+5 |
| |\ \
| |/ |
|
| | * | Issue #14629: Raise SyntaxError in tokenizer.detect_encoding | Martin v. Löwis | 2012-04-20 | 1 | -2/+5 |
|
|
| | * | Merged revisions 88498 via svnmerge from | Brett Cannon | 2011-02-22 | 1 | -3/+2 |
|
|
| * | | Updated tokenize to support the inverse byte literals new in 3.3 | Armin Ronacher | 2012-03-04 | 1 | -6/+16 |
|
|
| * | | Basic support for PEP 414 without docs or tests. | Armin Ronacher | 2012-03-04 | 1 | -8/+22 |
|
|
| * | | Issue #2134: Add support for tokenize.TokenInfo.exact_type. | Meador Inge | 2012-01-19 | 1 | -1/+58 |
|
|
| * | | Issue #13150: The tokenize module doesn't compile large regular expressions a... | Antoine Pitrou | 2011-10-11 | 1 | -19/+16 |
|
|
| * | | Issue #12943: python -m tokenize support has been added to tokenize. | Meador Inge | 2011-10-07 | 1 | -23/+56 |
|
|
| * | | Issue #11074: Make 'tokenize' so it can be reloaded. | Brett Cannon | 2011-02-22 | 1 | -3/+2 |
| |/ |
|
| * | Issue #10386: Added __all__ to token module; this simplifies importing | Alexander Belopolsky | 2010-11-11 | 1 | -3/+2 |
|
|
| * | Issue #10335: Add tokenize.open(), detect the file encoding using | Victor Stinner | 2010-11-09 | 1 | -0/+15 |
|
|
| * | A little bit more readable repr method. | Raymond Hettinger | 2010-09-09 | 1 | -3/+3 |
|
|
| * | Experiment: Let collections.namedtuple() do the work. This should work now t... | Raymond Hettinger | 2010-09-09 | 1 | -39/+3 |
|
|
| * | Improve the repr for the TokenInfo named tuple. | Raymond Hettinger | 2010-09-09 | 1 | -1/+28 |
|
|
| * | Remove unused import, fix typo and rewrap docstrings. | Florent Xicluna | 2010-09-03 | 1 | -17/+18 |
|
|
| * | handle names starting with non-ascii characters correctly #9712 | Benjamin Peterson | 2010-08-30 | 1 | -5/+10 |
|
|
| * | fix for files with coding cookies and BOMs | Benjamin Peterson | 2010-03-18 | 1 | -3/+5 |
|
|
| * | in tokenize.detect_encoding(), return utf-8-sig when a BOM is found | Benjamin Peterson | 2010-03-18 | 1 | -6/+12 |
|
|
| * | use some more itertools magic to make '' be yielded after readline is done | Benjamin Peterson | 2009-11-14 | 1 | -3/+4 |
|
|
| * | simply by using itertools.chain() | Benjamin Peterson | 2009-11-14 | 1 | -10/+5 |
|
|
| * | Merged revisions 75149,75260-75263,75265-75267,75292,75300,75376,75405,75429-... | Benjamin Peterson | 2009-11-13 | 1 | -13/+20 |
|
|
| * | normalize latin-1 and utf-8 variant encodings like the builtin tokenizer does | Benjamin Peterson | 2009-10-09 | 1 | -1/+12 |
|
|
| * | Remove dependency on the collections module. | Raymond Hettinger | 2009-04-29 | 1 | -3/+41 |
|
|
| * | Issue #5857: tokenize.tokenize() now returns named tuples. | Raymond Hettinger | 2009-04-29 | 1 | -19/+22 |
|
|
| * | reuse tokenize.detect_encoding in linecache instead of a custom solution | Benjamin Peterson | 2009-03-24 | 1 | -3/+4 |
|
|
| * | raise a SyntaxError in detect_encoding() when a codec lookup fails like the b... | Benjamin Peterson | 2008-12-12 | 1 | -13/+20 |
|
|
| * | #2834: Change re module semantics, so that str and bytes mixing is forbidden, | Antoine Pitrou | 2008-08-19 | 1 | -6/+8 |
|
|
| * | use the more idomatic (and Py3k faster) while True | Benjamin Peterson | 2008-06-05 | 1 | -1/+1 |
|
|
| * | Merged revisions 61964-61979 via svnmerge from | Christian Heimes | 2008-03-28 | 1 | -0/+9 |
|
|
| * | - Issue #719888: Updated tokenize to use a bytes API. generate_tokens has been | Trent Nelson | 2008-03-18 | 1 | -57/+130 |
|
|
| * | Merged revisions 60080-60089,60091-60093 via svnmerge from | Georg Brandl | 2008-01-19 | 1 | -3/+3 |
|
|
| * | Patch 1420 by Ron Adam. | Guido van Rossum | 2007-11-12 | 1 | -18/+18 |
|
|
| * | Raise statement normalization in Lib/. | Collin Winter | 2007-08-30 | 1 | -2/+2 |
|
|
| * | Merged revisions 55817-55961 via svnmerge from | Guido van Rossum | 2007-06-13 | 1 | -4/+5 |
|
|
| * | Merged revisions 55328-55341 via svnmerge from | Guido van Rossum | 2007-05-15 | 1 | -1/+2 |
|
|
| * | PEP 3114: rename .next() to .__next__() and add next() builtin. | Georg Brandl | 2007-04-21 | 1 | -2/+2 |
|
|
