summaryrefslogtreecommitdiffstats
path: root/Doc/library/tokenize.rst
Commit message (Expand)AuthorAgeFilesLines
* Clarify the supported cases in the tokenize module (#105569)Pablo Galindo Salgado2023-06-091-0/+9
* gh-105390: Correctly raise TokenError instead of SyntaxError for tokenize err...Pablo Galindo Salgado2023-06-071-5/+0
* fix comma location in various places (GH-19233)Mathieu Dupuy2020-03-301-1/+1
* bpo-36654: Add examples for using tokenize module programmically (#12947)Windson yang2020-01-251-0/+19
* bpo-5028: Fix up rest of documentation for tokenize documenting line (GH-13686)Anthony Sottile2019-05-301-2/+2
* bpo-5028: fix doc bug for tokenize (GH-11683)Andrew Carr2019-05-301-1/+1
* bpo-12486: Document tokenize.generate_tokens() as public API (#6957)Thomas Kluyver2018-06-051-1/+12
* Improve highlighting of some code blocks. (GH-6401)Serhiy Storchaka2018-04-081-2/+2
* bpo-31394: Make tokenize.rst PEP 8-compliant (GH-3526)Mariatta2017-09-131-2/+3
* bpo-31394: Clarify documentation about token type attribute (GH-3469)Aivar Annamaa2017-09-131-2/+2
* bpo-25324: Move the description of tokenize tokens to token.rst. (#1911)Serhiy Storchaka2017-06-061-28/+9
* Issue #22558: Add remaining doc links to source code for Python-coded modules.Terry Jan Reedy2016-06-111-0/+1
* Issue #23921: Standardized documentation whitespace formatting.Serhiy Storchaka2016-05-101-3/+3
* Issue #26127: Fix links in tokenize documentation; patch by Silent GhostMartin Panter2016-01-161-7/+7
* Issue #25523: Further a-to-an corrections.Serhiy Storchaka2015-11-021-1/+1
* document TokenError and unclosed expression behavior (closes #12063)Benjamin Peterson2014-06-081-0/+18
* Issue #2134: Add support for tokenize.TokenInfo.exact_type.Meador Inge2012-01-191-1/+52
* Issue #12943: python -m tokenize support has been added to tokenize.Meador Inge2011-10-071-0/+57
* Separate source link from main text.Raymond Hettinger2011-01-101-0/+2
* Move source links to consistent location and remove wordy, big yellow boxes.Raymond Hettinger2011-01-101-5/+1
* Provide links to Python source where the code is short, readable andÉric Araujo2010-11-161-0/+5
* Issue #10335: Add tokenize.open(), detect the file encoding usingVictor Stinner2010-11-091-8/+9
* Improve the repr for the TokenInfo named tuple.Raymond Hettinger2010-09-091-1/+1
* show a common usage of detect_encodingBenjamin Peterson2010-03-181-1/+11
* in tokenize.detect_encoding(), return utf-8-sig when a BOM is foundBenjamin Peterson2010-03-181-1/+2
* Issue #7631: Fix undefined references to the "built-in file object", whichAntoine Pitrou2010-01-041-3/+2
* Fixed capitalization and markup; added imports in the exampleEzio Melotti2009-12-201-3/+6
* Issue #5857: tokenize.tokenize() now returns named tuples.Raymond Hettinger2009-04-291-1/+6
* #5486: typos.Georg Brandl2009-03-131-1/+1
* Remove trailing whitespace.Georg Brandl2009-01-031-29/+29
* Merged revisions 64002-64003,64012,64036-64037,64047,64050-64052,64054-64055,...Georg Brandl2008-06-101-6/+4
* - Issue #719888: Updated tokenize to use a bytes API. generate_tokens has beenTrent Nelson2008-03-181-74/+98
* Merged revisions 60481,60485,60489-60492,60494-60496,60498-60499,60501-60503,...Christian Heimes2008-02-221-1/+1
* #1370: Finish the merge r58749, log below, by resolving all conflicts in Doc/.Georg Brandl2007-11-011-1/+1
* Convert all print statements in the docs.Georg Brandl2007-09-041-2/+2
* Get rid of the remaining versionadded/versionchanged directives.Georg Brandl2007-09-011-7/+1
* Move the 3k reST doc tree in place.Georg Brandl2007-08-151-0/+122