summaryrefslogtreecommitdiffstats
path: root/Lib/test/test_tokenize.py
Commit message (Expand)AuthorAgeFilesLines
* Remove trailing spaces (GH-31695)Serhiy Storchaka2022-03-051-5/+5
* bpo-46091: Correctly calculate indentation levels for whitespace lines with c...Pablo Galindo Salgado2022-01-251-1/+99
* Remove trailing spaces. (GH-28706)Serhiy Storchaka2021-10-031-1/+1
* Add tests for the C tokenizer and expose it as a private module (GH-27924)Pablo Galindo Salgado2021-08-241-2/+861
* bpo-44667: Treat correctly lines ending with comments and no newlines in the ...Pablo Galindo Salgado2021-07-311-0/+10
* bpo-40275: Use new test.support helper submodules in tests (GH-21448)Hai Shi2020-08-031-2/+3
* bpo-41043: Escape literal part of the path for glob(). (GH-20994)Serhiy Storchaka2020-06-201-1/+1
* bpo-35224: PEP 572 Implementation (#10497)Emily Morehouse2019-01-241-0/+1
* bpo-30455: Generate all token related code and docs from Grammar/Tokens. (GH-...Serhiy Storchaka2018-12-221-0/+2
* Fixed several assertTrue() that were intended to be assertEqual(). (GH-8191)Sergey Fedoseev2018-07-091-1/+1
* bpo-33899: Make tokenize module mirror end-of-file is end-of-line behavior (G...Ammar Askar2018-07-061-24/+47
* bpo-12486: Document tokenize.generate_tokens() as public API (#6957)Thomas Kluyver2018-06-051-2/+15
* bpo-30406: Make async and await proper keywords (#1669)Jelle Zijlstra2017-10-061-14/+14
* bpo-31029: test_tokenize Add missing import unittest (#2865)Stéphane Wirtel2017-07-251-0/+1
* bpo-25324: copy tok_name before changing it (#1608)Albert-Jan Nijburg2017-05-311-6/+6
* bpo-30377: Simplify handling of COMMENT and NL in tokenize.py (#1607)Albert-Jan Nijburg2017-05-241-7/+9
* Add ELLIPSIS and RARROW. Add tests (#666)Jim Fasarakis-Hilliard2017-03-141-0/+21
* Issue #26331: Implement the parsing part of PEP 515.Brett Cannon2016-09-091-7/+23
* Rename test_pep####.py filesZachary Ware2016-09-091-5/+6
* Fix running test_tokenize directlyZachary Ware2016-09-091-2/+2
* Issue 25311: Add support for f-strings to tokenize.py. Also added some commen...Eric V. Smith2015-10-261-0/+17
* Issue 25422: Add tests for multi-line string tokenization. Also remove trunca...Eric V. Smith2015-10-171-6/+32
* Issue #25317: Converted doctests in test_tokenize to unittests.Serhiy Storchaka2015-10-061-419/+398
|\
| * Issue #25317: Converted doctests in test_tokenize to unittests.Serhiy Storchaka2015-10-061-357/+332
* | Issue #24619: Simplify async/await tokenization.Yury Selivanov2015-07-231-0/+73
* | Issue #24619: New approach for tokenizing async/await.Yury Selivanov2015-07-221-2/+13
* | Issue #20387: Merge test and patch from 3.4.4Jason R. Coombs2015-06-281-1/+20
|\ \ | |/
| * Issue #20387: Correct test to properly capture expectation.Jason R. Coombs2015-06-261-2/+2
| * Issue #20387: Add test capturing failure to roundtrip indented code in tokeni...Jason R. Coombs2015-06-201-0/+17
| * Remove unused import and remove doctest-only import into doctests.Jason R. Coombs2015-06-201-1/+3
* | (Merge 3.5) Issue #23840: tokenize.open() now closes the temporary binary fileVictor Stinner2015-05-251-1/+9
|\ \ | |/
| * Issue #23840: tokenize.open() now closes the temporary binary file on error toVictor Stinner2015-05-251-1/+9
* | Issue 24226: Fix parsing of many sequential one-line 'def' statements.Yury Selivanov2015-05-181-0/+11
* | PEP 0492 -- Coroutines with async and await syntax. Issue #24017.Yury Selivanov2015-05-121-0/+186
* | Issue #23681: Fixed Python 2 to 3 poring bugs.Serhiy Storchaka2015-03-201-3/+4
|\ \ | |/
| * Issue #23681: Fixed Python 2 to 3 poring bugs.Serhiy Storchaka2015-03-201-3/+4
* | PEP 465: a dedicated infix operator for matrix multiplication (closes #21176)Benjamin Peterson2014-04-101-1/+4
|/
* Issue #9974: When untokenizing, use row info to insert backslash+newline.Terry Jan Reedy2014-02-241-1/+16
* Issue #20750, Enable roundtrip tests for new 5-tuple untokenize. TheTerry Jan Reedy2014-02-231-14/+38
* Issue #8478: Untokenizer.compat now processes first token from iterator input.Terry Jan Reedy2014-02-181-0/+13
* whitespaceTerry Jan Reedy2014-02-171-2/+2
* Untokenize: An logically incorrect assert tested user input validity.Terry Jan Reedy2014-02-171-1/+15
* Issue #18960: Fix bugs with Python source code encoding in the second line.Serhiy Storchaka2014-01-091-0/+33
* Issue #18873: The tokenize module, IDLE, 2to3, and the findnocoding.py scriptSerhiy Storchaka2013-09-161-0/+7
* #16152: merge with 3.2.Ezio Melotti2012-11-031-0/+4
|\
| * #16152: fix tokenize to ignore whitespace at the end of the code when no newl...Ezio Melotti2012-11-031-0/+5
* | Merge branchFlorent Xicluna2012-07-071-0/+4
|\ \ | |/
| * Issue #14990: tokenize: correctly fail with SyntaxError on invalid encoding d...Florent Xicluna2012-07-071-0/+4
* | Issue #15096: Drop support for the ur string prefixChristian Heimes2012-06-201-20/+2
* | Issue #15054: Fix incorrect tokenization of 'b' string literals.Meador Inge2012-06-171-0/+76