summaryrefslogtreecommitdiffstats
path: root/Doc/lib/libtokenize.tex
Commit message (Collapse)AuthorAgeFilesLines
* Add \exception markupGeorge Yoshida2006-05-131-1/+1
|
* fix typo. \var vs \variableGregory P. Smith2005-06-111-1/+1
|
* Add untokenize() function to allow full round-trip tokenization.Raymond Hettinger2005-06-101-0/+52
| | | | | | Should significantly enhance the utility of the module by supporting the creation of tools that modify the token stream and writeback the modified result.
* Turns out Neil didn't intend for *all* of his gen-branch work to getTim Peters2001-06-291-10/+27
| | | | | | | | | | | | | | | | | | | | committed. tokenize.py: I like these changes, and have tested them extensively without even realizing it, so I just updated the docstring and the docs. tabnanny.py: Also liked this, but did a little code fiddling. I should really rewrite this to *exploit* generators, but that's near the bottom of my effort/benefit scale so doubt I'll get to it anytime soon (it would be most useful as a non-trivial example of ideal use of generators; but test_generators.py has already grown plenty of food-for-thought examples). inspect.py: I'm sure Ping intended for this to continue running even under 1.5.2, so I reverted this to the last pre-gen-branch version. The "bugfix" I checked in in-between was actually repairing a bug *introduced* by the conversion to generators, so it's OK that the reverted version doesn't reflect that checkin.
* Explain the difference between NL and NEWLINE.Ka-Ping Yee2001-03-231-1/+4
|
* added description of NL tokenSkip Montanaro2001-02-281-1/+4
|
* Fix a couple of grammatical errors reported by Detlef LannertFred Drake1999-04-231-2/+2
| | | | <lannert@lannert.rz.uni-duesseldorf.de>.
* Documentation for pyclbr and tokenize modules.Fred Drake1999-02-181-0/+44