summaryrefslogtreecommitdiffstats
path: root/Lib/test/test_tokenize.py
Commit message (Expand)AuthorAgeFilesLines
* gh-111031: Check more files in `test_tokenize` (#111032)Nikita Sobolev2023-10-191-10/+0
* gh-104169: Fix test_peg_generator after tokenizer refactoring (#110727)Lysandros Nikolaou2023-10-121-2/+2
* gh-108303: Move all inspect test files to `test_inspect/` (#109607)Nikita Sobolev2023-10-101-1/+1
* gh-110259: Fix f-strings with multiline expressions and format specs (#110271)Pablo Galindo Salgado2023-10-051-0/+97
* gh-108303: Move tokenize-related data to Lib/test/tokenizedata (GH-109265)Nikita Sobolev2023-09-121-4/+3
* gh-108469: Update ast.unparse for unescaped quote support from PEP701 [3.12] ...Anthony Shaw2023-09-051-1/+1
* gh-107015: Remove async_hacks from the tokenizer (#107018)Pablo Galindo Salgado2023-07-261-34/+34
* gh-106200: Remove unused imports (#106201)Nikita Sobolev2023-06-281-1/+0
* gh-71299: Fix __all__ in tokenize (#105907)Lysandros Nikolaou2023-06-191-132/+136
* gh-105820: Fix tok_mode expression buffer in file & readline tokenizer (#105828)Lysandros Nikolaou2023-06-151-0/+13
* gh-105718: Fix buffer allocation in tokenizer with readline (#105728)Lysandros Nikolaou2023-06-131-0/+10
* gh-105549: Tokenize separately NUMBER and NAME tokens and allow 0-prefixed li...Pablo Galindo Salgado2023-06-091-0/+33
* gh-105564: Don't include artificial newlines in the line attribute of tokens ...Pablo Galindo Salgado2023-06-091-8/+8
* gh-105435: Fix spurious NEWLINE token if file ends with comment without a new...Pablo Galindo Salgado2023-06-071-5/+26
* gh-105390: Correctly raise TokenError instead of SyntaxError for tokenize err...Pablo Galindo Salgado2023-06-071-5/+6
* gh-105259: Ensure we don't show newline characters for trailing NEWLINE token...Pablo Galindo Salgado2023-06-061-1/+1
* gh-105042: Disable unmatched parens syntax error in python tokenize (#105061)Lysandros Nikolaou2023-05-301-0/+7
* gh-105069: Add a readline-like callable to the tokenizer to consume input ite...Pablo Galindo Salgado2023-05-301-49/+96
* gh-105017: Include CRLF lines in strings and column numbers (#105030)Marta Gómez Macías2023-05-281-8/+36
* gh-105017: Fix including additional NL token when using CRLF (#105022)Marta Gómez Macías2023-05-271-0/+8
* gh-104976: Ensure trailing dedent tokens are emitted as the previous tokenize...Pablo Galindo Salgado2023-05-261-7/+8
* gh-104972: Ensure that line attributes in tokens in the tokenize module are c...Pablo Galindo Salgado2023-05-261-2/+13
* gh-104866: Tokenize should emit NEWLINE after exiting block with comment (#10...Lysandros Nikolaou2023-05-241-0/+17
* gh-104825: Remove implicit newline in the line attribute in tokens emitted in...Pablo Galindo Salgado2023-05-241-2/+2
* gh-104741: Add line number attribute to indentation error exception (#104743)Marta Gómez Macías2023-05-221-1/+10
* gh-102856: Python tokenizer implementation for PEP 701 (#104323)Marta Gómez Macías2023-05-211-48/+135
* gh-103824: fix use-after-free error in Parser/tokenizer.c (#103993)chgnrdv2023-05-011-1/+14
* gh-102856: Initial implementation of PEP 701 (#102855)Pablo Galindo Salgado2023-04-191-5/+23
* gh-99581: Fix a buffer overflow in the tokenizer when copying lines that fill...Pablo Galindo Salgado2022-11-201-0/+16
* gh-94808: Coverage: Test that maximum indentation level is handled (#95926)Michael Droettboom2022-10-061-1/+21
* Remove trailing spaces (GH-31695)Serhiy Storchaka2022-03-051-5/+5
* bpo-46091: Correctly calculate indentation levels for whitespace lines with c...Pablo Galindo Salgado2022-01-251-1/+99
* Remove trailing spaces. (GH-28706)Serhiy Storchaka2021-10-031-1/+1
* Add tests for the C tokenizer and expose it as a private module (GH-27924)Pablo Galindo Salgado2021-08-241-2/+861
* bpo-44667: Treat correctly lines ending with comments and no newlines in the ...Pablo Galindo Salgado2021-07-311-0/+10
* bpo-40275: Use new test.support helper submodules in tests (GH-21448)Hai Shi2020-08-031-2/+3
* bpo-41043: Escape literal part of the path for glob(). (GH-20994)Serhiy Storchaka2020-06-201-1/+1
* bpo-35224: PEP 572 Implementation (#10497)Emily Morehouse2019-01-241-0/+1
* bpo-30455: Generate all token related code and docs from Grammar/Tokens. (GH-...Serhiy Storchaka2018-12-221-0/+2
* Fixed several assertTrue() that were intended to be assertEqual(). (GH-8191)Sergey Fedoseev2018-07-091-1/+1
* bpo-33899: Make tokenize module mirror end-of-file is end-of-line behavior (G...Ammar Askar2018-07-061-24/+47
* bpo-12486: Document tokenize.generate_tokens() as public API (#6957)Thomas Kluyver2018-06-051-2/+15
* bpo-30406: Make async and await proper keywords (#1669)Jelle Zijlstra2017-10-061-14/+14
* bpo-31029: test_tokenize Add missing import unittest (#2865)Stéphane Wirtel2017-07-251-0/+1
* bpo-25324: copy tok_name before changing it (#1608)Albert-Jan Nijburg2017-05-311-6/+6
* bpo-30377: Simplify handling of COMMENT and NL in tokenize.py (#1607)Albert-Jan Nijburg2017-05-241-7/+9
* Add ELLIPSIS and RARROW. Add tests (#666)Jim Fasarakis-Hilliard2017-03-141-0/+21
* Issue #26331: Implement the parsing part of PEP 515.Brett Cannon2016-09-091-7/+23
* Rename test_pep####.py filesZachary Ware2016-09-091-5/+6
* Fix running test_tokenize directlyZachary Ware2016-09-091-2/+2