| Commit message (Expand) | Author | Age | Files | Lines |
* | normalize latin-1 and utf-8 variant encodings like the builtin tokenizer does | Benjamin Peterson | 2009-10-09 | 1 | -1/+12 |
|
|
* | Remove dependency on the collections module. | Raymond Hettinger | 2009-04-29 | 1 | -3/+41 |
|
|
* | Issue #5857: tokenize.tokenize() now returns named tuples. | Raymond Hettinger | 2009-04-29 | 1 | -19/+22 |
|
|
* | reuse tokenize.detect_encoding in linecache instead of a custom solution | Benjamin Peterson | 2009-03-24 | 1 | -3/+4 |
|
|
* | raise a SyntaxError in detect_encoding() when a codec lookup fails like the b... | Benjamin Peterson | 2008-12-12 | 1 | -13/+20 |
|
|
* | #2834: Change re module semantics, so that str and bytes mixing is forbidden, | Antoine Pitrou | 2008-08-19 | 1 | -6/+8 |
|
|
* | use the more idomatic (and Py3k faster) while True | Benjamin Peterson | 2008-06-05 | 1 | -1/+1 |
|
|
* | Merged revisions 61964-61979 via svnmerge from | Christian Heimes | 2008-03-28 | 1 | -0/+9 |
|
|
* | - Issue #719888: Updated tokenize to use a bytes API. generate_tokens has been | Trent Nelson | 2008-03-18 | 1 | -57/+130 |
|
|
* | Merged revisions 60080-60089,60091-60093 via svnmerge from | Georg Brandl | 2008-01-19 | 1 | -3/+3 |
|
|
* | Patch 1420 by Ron Adam. | Guido van Rossum | 2007-11-12 | 1 | -18/+18 |
|
|
* | Raise statement normalization in Lib/. | Collin Winter | 2007-08-30 | 1 | -2/+2 |
|
|
* | Merged revisions 55817-55961 via svnmerge from | Guido van Rossum | 2007-06-13 | 1 | -4/+5 |
|
|
* | Merged revisions 55328-55341 via svnmerge from | Guido van Rossum | 2007-05-15 | 1 | -1/+2 |
|
|
* | PEP 3114: rename .next() to .__next__() and add next() builtin. | Georg Brandl | 2007-04-21 | 1 | -2/+2 |
|
|
* | Hide list comp variables and support set comprehensions | Nick Coghlan | 2007-04-15 | 1 | -1/+0 |
|
|
* | Make ELLIPSIS a separate token. This makes it a syntax error to write ". . ... | Georg Brandl | 2007-03-18 | 1 | -3/+3 |
|
|
* | Fix most trivially-findable print statements. | Guido van Rossum | 2007-02-09 | 1 | -2/+2 |
|
|
* | PEP 3107 - Function Annotations thanks to Tony Lownds | Neal Norwitz | 2006-12-28 | 1 | -1/+1 |
|
|
* | Four months of trunk changes (including a few releases...) | Thomas Wouters | 2006-12-13 | 1 | -32/+77 |
|
|
* | Remove support for backticks from the grammar and compiler. | Brett Cannon | 2006-08-25 | 1 | -1/+1 |
|
|
* | Killed the <> operator. You must now use !=. | Guido van Rossum | 2006-08-24 | 1 | -1/+1 |
|
|
* | Merge current trunk into p3yk. This includes the PyNumber_Index API change, | Thomas Wouters | 2006-08-21 | 1 | -1/+2 |
|
|
* | Merge p3yk branch with the trunk up to revision 45595. This breaks a fair | Thomas Wouters | 2006-04-21 | 1 | -1/+1 |
|
|
* | SF bug #1224621: tokenize module does not detect inconsistent dedents | Raymond Hettinger | 2005-06-21 | 1 | -0/+3 |
|
|
* | Add untokenize() function to allow full round-trip tokenization. | Raymond Hettinger | 2005-06-10 | 1 | -3/+49 |
|
|
* | PEP-0318, @decorator-style. In Guido's words: | Anthony Baxter | 2004-08-02 | 1 | -1/+1 |
|
|
* | Get rid of many apply() calls. | Guido van Rossum | 2003-02-27 | 1 | -3/+3 |
|
|
* | SF 633560: tokenize.__all__ needs "generate_tokens" | Raymond Hettinger | 2002-11-05 | 1 | -1/+2 |
|
|
* | Speed up the most egregious "if token in (long tuple)" cases by using | Guido van Rossum | 2002-08-24 | 1 | -10/+19 |
|
|
* | Whitespace normalization. | Tim Peters | 2002-05-23 | 1 | -5/+5 |
|
|
* | Added docstrings excerpted from Python Library Reference. | Raymond Hettinger | 2002-05-15 | 1 | -0/+25 |
|
|
* | Remove some now-obsolete generator future statements. | Tim Peters | 2002-04-01 | 1 | -2/+0 |
|
|
* | Cleanup x so it is not left in module | Neal Norwitz | 2002-03-26 | 1 | -0/+1 |
|
|
* | SF patch #455966: Allow leading 0 in float/imag literals. | Tim Peters | 2001-08-30 | 1 | -2/+2 |
|
|
* | Add new tokens // and //=, in support of PEP 238. | Guido van Rossum | 2001-08-08 | 1 | -0/+1 |
|
|
* | Use string.ascii_letters instead of string.letters (SF bug #226706). | Fred Drake | 2001-07-20 | 1 | -1/+1 |
|
|
* | Preliminary support for "from __future__ import generators" to enable | Guido van Rossum | 2001-07-15 | 1 | -0/+2 |
|
|
* | Turns out Neil didn't intend for *all* of his gen-branch work to get | Tim Peters | 2001-06-29 | 1 | -8/+21 |
|
|
* | Merging the gen-branch into the main line, at Guido's direction. Yay! | Tim Peters | 2001-06-18 | 1 | -15/+20 |
|
|
* | Provide a StopTokenizing exception for conveniently exiting the loop. | Ka-Ping Yee | 2001-03-23 | 1 | -10/+11 |
|
|
* | Better __credits__. | Ka-Ping Yee | 2001-03-01 | 1 | -1/+2 |
|
|
* | Add __author__ and __credits__ variables. | Ka-Ping Yee | 2001-03-01 | 1 | -1/+2 |
|
|
* | final round of __all__ lists (I hope) - skipped urllib2 because Moshe may be | Skip Montanaro | 2001-03-01 | 1 | -1/+5 |
|
|
* | String method conversion. | Eric S. Raymond | 2001-02-09 | 1 | -1/+1 |
|
|
* | Add tokenizer support and tests for u'', U"", uR'', Ur"", etc. | Ka-Ping Yee | 2001-01-15 | 1 | -9/+25 |
|
|
* | Whitespace normalization. | Tim Peters | 2001-01-15 | 1 | -1/+0 |
|
|
* | Possible fix for Skip's bug 116136 (sre recursion limit hit in tokenize.py). | Tim Peters | 2000-10-07 | 1 | -12/+20 |
|
|
* | Update for augmented assignment, tested & approved by Guido. | Thomas Wouters | 2000-08-24 | 1 | -2/+5 |
|
|
* | Convert some old-style string exceptions to class exceptions. | Fred Drake | 2000-08-17 | 1 | -1/+4 |
|
|