summaryrefslogtreecommitdiffstats
path: root/Lib/tokenize.py
Commit message (Expand)AuthorAgeFilesLines
* Issue #20387: Backport fix from Python 3.4Jason R. Coombs2015-06-281-0/+17
* Issue #9974: When untokenizing, use row info to insert backslash+newline.Terry Jan Reedy2014-02-241-0/+6
* whitespaceTerry Jan Reedy2014-02-181-1/+1
* Issue #8478: Untokenizer.compat now processes first token from iterator input.Terry Jan Reedy2014-02-181-9/+7
* Untokenize: An logically incorrect assert tested user input validity.Terry Jan Reedy2014-02-171-1/+3
* #19620: Fix typo in docstring (noticed by Christopher Welborn).Ezio Melotti2013-11-251-1/+1
* #16152: fix tokenize to ignore whitespace at the end of the code when no newl...Ezio Melotti2012-11-031-1/+3
* Issue #15054: Fix incorrect tokenization of 'b' and 'br' string literals.Meador Inge2012-06-171-5/+5
* some cleanupsBenjamin Peterson2009-10-151-10/+10
* use floor division and add a test that exercises the tabsize codepathBenjamin Peterson2009-10-151-1/+1
* pep8ify if blocksBenjamin Peterson2009-10-151-9/+18
* Remove a tuple unpacking in a parameter list to remove a SyntaxWarning raisedBrett Cannon2008-08-021-1/+3
* revert 63965 for preformance reasonsBenjamin Peterson2008-06-051-1/+1
* use the more idomatic while TrueBenjamin Peterson2008-06-051-1/+1
* Issue2495: tokenize.untokenize did not insert space between two consecutive s...Amaury Forgeot d'Arc2008-03-271-1/+10
* Added PEP 3127 support to tokenize (with tests); added PEP 3127 to NEWS.Eric Smith2008-03-171-2/+3
* Fix #1679: "0x" was taken as a valid integer literal.Georg Brandl2008-01-191-1/+1
* Added bytes and b'' as aliases for str and ''Christian Heimes2008-01-181-3/+16
* Add name to credits (for untokenize).Raymond Hettinger2006-12-021-1/+1
* Replace dead code with an assert.Jeremy Hylton2006-08-231-4/+1
* Bug fixes large and small for tokenize.Jeremy Hylton2006-08-231-31/+79
* Make tabnanny recognize IndentationErrors raised by tokenize.Georg Brandl2006-08-141-1/+2
* Insert a safety space after numbers as well as names in untokenize().Guido van Rossum2006-03-301-1/+1
* SF bug #1224621: tokenize module does not detect inconsistent dedentsRaymond Hettinger2005-06-211-0/+3
* Add untokenize() function to allow full round-trip tokenization.Raymond Hettinger2005-06-101-3/+49
* PEP-0318, @decorator-style. In Guido's words:Anthony Baxter2004-08-021-1/+1
* Get rid of many apply() calls.Guido van Rossum2003-02-271-3/+3
* SF 633560: tokenize.__all__ needs "generate_tokens"Raymond Hettinger2002-11-051-1/+2
* Speed up the most egregious "if token in (long tuple)" cases by usingGuido van Rossum2002-08-241-10/+19
* Whitespace normalization.Tim Peters2002-05-231-5/+5
* Added docstrings excerpted from Python Library Reference.Raymond Hettinger2002-05-151-0/+25
* Remove some now-obsolete generator future statements.Tim Peters2002-04-011-2/+0
* Cleanup x so it is not left in moduleNeal Norwitz2002-03-261-0/+1
* SF patch #455966: Allow leading 0 in float/imag literals.Tim Peters2001-08-301-2/+2
* Add new tokens // and //=, in support of PEP 238.Guido van Rossum2001-08-081-0/+1
* Use string.ascii_letters instead of string.letters (SF bug #226706).Fred Drake2001-07-201-1/+1
* Preliminary support for "from __future__ import generators" to enableGuido van Rossum2001-07-151-0/+2
* Turns out Neil didn't intend for *all* of his gen-branch work to getTim Peters2001-06-291-8/+21
* Merging the gen-branch into the main line, at Guido's direction. Yay!Tim Peters2001-06-181-15/+20
* Provide a StopTokenizing exception for conveniently exiting the loop.Ka-Ping Yee2001-03-231-10/+11
* Better __credits__.Ka-Ping Yee2001-03-011-1/+2
* Add __author__ and __credits__ variables.Ka-Ping Yee2001-03-011-1/+2
* final round of __all__ lists (I hope) - skipped urllib2 because Moshe may beSkip Montanaro2001-03-011-1/+5
* String method conversion.Eric S. Raymond2001-02-091-1/+1
* Add tokenizer support and tests for u'', U"", uR'', Ur"", etc.Ka-Ping Yee2001-01-151-9/+25
* Whitespace normalization.Tim Peters2001-01-151-1/+0
* Possible fix for Skip's bug 116136 (sre recursion limit hit in tokenize.py).Tim Peters2000-10-071-12/+20
* Update for augmented assignment, tested & approved by Guido.Thomas Wouters2000-08-241-2/+5
* Convert some old-style string exceptions to class exceptions.Fred Drake2000-08-171-1/+4
* Differentiate between NEWLINE token (an official newline) and NL tokenGuido van Rossum1998-04-031-5/+15
generated by cgit v0.12 at 2025-08-25 22:02:20 (GMT)