summaryrefslogtreecommitdiffstats
path: root/Lib/tokenize.py
Commit message (Expand)AuthorAgeFilesLines
* Fix pyflakes warnings: variable is assigned to but never used (#142294)Victor Stinner2025-12-081-1/+1
* gh-63161: Fix tokenize.detect_encoding() (GH-139446)Serhiy Storchaka2025-10-201-8/+14
* gh-134675: Add t-string prefixes to tokenizer module, lexical analysis doc, a...Eric V. Smith2025-05-261-1/+1
* gh-134582: Fix t-strings untokenize() roundtrip removing space between braces...Loïc Simon2025-05-251-7/+7
* gh-130645: Add color to stdlib argparse CLIs (gh-133380)Hugo van Kemenade2025-05-051-1/+1
* gh-133306: Use \z instead of \Z in regular expressions in the stdlib (GH-133337)Serhiy Storchaka2025-05-031-1/+1
* gh-132661: Implement PEP 750 (#132662)Lysandros Nikolaou2025-04-301-2/+2
* gh-131178: Add tests for `tokenize` command-line interface (#131274)Semyon Moroz2025-03-271-3/+3
* gh-125553: Fix backslash continuation in `untokenize` (#126010)Tomas R.2025-01-211-6/+20
* gh-128519: Align the docstring of untokenize() to match the docs (#128521)Tomas R.2025-01-061-10/+4
* gh-91818: Use default program name in the CLI of many modules (GH-124867)Serhiy Storchaka2024-10-091-1/+1
* gh-125008: Fix `tokenize.untokenize` roundtrip for `\n{{` (#125013)Tomas R.2024-10-061-1/+1
* gh-115154: Fix untokenize handling of unicode named literals (#115171)Pablo Galindo Salgado2024-02-191-7/+46
* gh-104169: Fix test_peg_generator after tokenizer refactoring (#110727)Lysandros Nikolaou2023-10-121-1/+1
* gh-71299: Fix __all__ in tokenize (#105907)Lysandros Nikolaou2023-06-191-3/+1
* gh-105390: Correctly raise TokenError instead of SyntaxError for tokenize err...Pablo Galindo Salgado2023-06-071-2/+18
* gh-105324: Fix tokenize module main function for stdin (#105325)Pablo Galindo Salgado2023-06-051-2/+1
* gh-105069: Add a readline-like callable to the tokenizer to consume input ite...Pablo Galindo Salgado2023-05-301-21/+11
* gh-104976: Ensure trailing dedent tokens are emitted as the previous tokenize...Pablo Galindo Salgado2023-05-261-5/+0
* gh-102856: Tokenize performance improvement (#104731)Marta Gómez Macías2023-05-221-12/+1
* gh-104719: Restore Tokenize module constants (#104722)Marta Gómez Macías2023-05-211-0/+101
* gh-102856: Python tokenizer implementation for PEP 701 (#104323)Marta Gómez Macías2023-05-211-288/+51
* bpo-46565: `del` loop vars that are leaking into module namespaces (GH-30993)Nikita Sobolev2022-02-031-0/+2
* Add tests for the C tokenizer and expose it as a private module (GH-27924)Pablo Galindo Salgado2021-08-241-0/+8
* bpo-44667: Treat correctly lines ending with comments and no newlines in the ...Pablo Galindo Salgado2021-07-311-1/+1
* bpo-43014: Improve performance of tokenize.tokenize by 20-30%Anthony Sottile2021-01-241-0/+2
* bpo-5028: Fix up rest of documentation for tokenize documenting line (GH-13686)Anthony Sottile2019-05-301-1/+1
* bpo-5028: fix doc bug for tokenize (GH-11683)Andrew Carr2019-05-301-1/+1
* bpo-36766: Typos in docs and code comments (GH-13116)penguindustin2019-05-061-1/+1
* bpo-30455: Generate all token related code and docs from Grammar/Tokens. (GH-...Serhiy Storchaka2018-12-221-60/+6
* bpo-33899: Make tokenize module mirror end-of-file is end-of-line behavior (G...Ammar Askar2018-07-061-0/+10
* bpo-12486: Document tokenize.generate_tokens() as public API (#6957)Thomas Kluyver2018-06-051-3/+6
* bpo-33338: [tokenize] Minor code cleanup (#6573)Łukasz Langa2018-04-231-11/+8
* bpo-33260: Regenerate token.py after removing ASYNC and AWAIT. (GH-6447)Serhiy Storchaka2018-04-111-1/+1
* bpo-30406: Make async and await proper keywords (#1669)Jelle Zijlstra2017-10-061-61/+1
* bpo-25324: copy tok_name before changing it (#1608)Albert-Jan Nijburg2017-05-311-9/+2
* bpo-30377: Simplify handling of COMMENT and NL in tokenize.py (#1607)Albert-Jan Nijburg2017-05-241-5/+3
* bpo-30296 Remove unnecessary tuples, lists, sets, and dicts (#1489)Jon Dufresne2017-05-181-1/+1
* Add ELLIPSIS and RARROW. Add tests (#666)Jim Fasarakis-Hilliard2017-03-141-1/+3
* Issue #26331: Implement the parsing part of PEP 515.Brett Cannon2016-09-091-8/+9
* Issue #26581: Use the first coding cookie on a line, not the last one.Serhiy Storchaka2016-03-201-1/+1
|\
| * Issue #26581: Use the first coding cookie on a line, not the last one.Serhiy Storchaka2016-03-201-1/+1
* | Issue #25977: Fix typos in Lib/tokenize.pyBerker Peksag2015-12-291-5/+5
|\ \ | |/
| * Issue #25977: Fix typos in Lib/tokenize.pyBerker Peksag2015-12-291-4/+4
* | Issue 25311: Add support for f-strings to tokenize.py. Also added some commen...Eric V. Smith2015-10-261-51/+67
|/
* Issue #24619: Simplify async/await tokenization.Yury Selivanov2015-07-231-16/+23
* Issue #24619: New approach for tokenizing async/await.Yury Selivanov2015-07-221-1/+6
* Issue #20387: Merge test and patch from 3.4.4Jason R. Coombs2015-06-281-0/+17
|\
| * Issue #20387: Restore retention of indentation during untokenize.Dingyuan Wang2015-06-221-0/+17
* | (Merge 3.5) Issue #23840: tokenize.open() now closes the temporary binary fileVictor Stinner2015-05-251-5/+9
|\ \ | |/
generated by cgit v0.12 at 2026-01-15 16:27:28 (GMT)