summaryrefslogtreecommitdiffstats
path: root/Lib/tokenize.py
Commit message (Expand)AuthorAgeFilesLines
...
* Add tokenizer support and tests for u'', U"", uR'', Ur"", etc.Ka-Ping Yee2001-01-151-9/+25
* Whitespace normalization.Tim Peters2001-01-151-1/+0
* Possible fix for Skip's bug 116136 (sre recursion limit hit in tokenize.py).Tim Peters2000-10-071-12/+20
* Update for augmented assignment, tested & approved by Guido.Thomas Wouters2000-08-241-2/+5
* Convert some old-style string exceptions to class exceptions.Fred Drake2000-08-171-1/+4
* Differentiate between NEWLINE token (an official newline) and NL tokenGuido van Rossum1998-04-031-5/+15
* New, fixed version with proper r"..." and R"..." support from Ka-Ping.Guido van Rossum1997-10-271-7/+10
* Redone (by Ka-Ping) using the new re module, and adding recognitionGuido van Rossum1997-10-271-57/+55
* Correct typo in last line (test program invocation).Guido van Rossum1997-06-031-1/+1
* Ping's latest. Fixes triple quoted strings ending in oddGuido van Rossum1997-04-091-20/+31
* Ka-Ping's muich improved version of March 26, 1997:Guido van Rossum1997-04-081-74/+98
* Added support for imaginary constants (e.g. 0j, 1j, 1.0j).Guido van Rossum1997-03-101-4/+5
* Fixed doc string, added __version__, fixed 1 bug.Guido van Rossum1997-03-071-11/+18
* Ka-Ping's version.Guido van Rossum1997-03-071-45/+132
* * test_select.py: (some) tests for built-in select moduleGuido van Rossum1993-11-111-1/+3
* Change the order in which Floatnumber and Intnumber are triedGuido van Rossum1992-03-161-2/+3
* Initial revisionGuido van Rossum1992-01-011-0/+60