diff options
| author | Raymond Hettinger <python@rcn.com> | 2005-06-10 11:05:19 (GMT) |
|---|---|---|
| committer | Raymond Hettinger <python@rcn.com> | 2005-06-10 11:05:19 (GMT) |
| commit | 68c04534182f2c09783b6506701a8bc25c98b4a9 (patch) | |
| tree | 4e5f2b764eff65a3201dd2e666355c487e88a9b7 /Misc | |
| parent | bf7255fffb5dda1b9541892cc40412bb6bbd4409 (diff) | |
| download | cpython-68c04534182f2c09783b6506701a8bc25c98b4a9.zip cpython-68c04534182f2c09783b6506701a8bc25c98b4a9.tar.gz cpython-68c04534182f2c09783b6506701a8bc25c98b4a9.tar.bz2 | |
Add untokenize() function to allow full round-trip tokenization.
Should significantly enhance the utility of the module by supporting
the creation of tools that modify the token stream and writeback the
modified result.
Diffstat (limited to 'Misc')
| -rw-r--r-- | Misc/NEWS | 5 |
1 files changed, 5 insertions, 0 deletions
@@ -141,6 +141,11 @@ Extension Modules Library ------- +- The tokenize module has a new untokenize() function to support a full + roundtrip from lexed tokens back to Python sourcecode. In addition, + the generate_tokens() function now accepts a callable argument that + terminates by raising StopIteration. + - Bug #1196315: fix weakref.WeakValueDictionary constructor. - Bug #1213894: os.path.realpath didn't resolve symlinks that were the first |