index
:
cpython.git
2.7
3.3
3.4
3.5
3.6
benjamin-clang
benjamin-iteration-torture
buildbot-custom
master
https://github.com/python/cpython.git
summary
refs
log
tree
commit
diff
stats
log msg
author
committer
range
path:
root
/
Lib
/
test
/
test_tokenize.py
Commit message (
Expand
)
Author
Age
Files
Lines
*
gh-111031: Check more files in `test_tokenize` (#111032)
Nikita Sobolev
2023-10-19
1
-10/+0
*
gh-104169: Fix test_peg_generator after tokenizer refactoring (#110727)
Lysandros Nikolaou
2023-10-12
1
-2/+2
*
gh-108303: Move all inspect test files to `test_inspect/` (#109607)
Nikita Sobolev
2023-10-10
1
-1/+1
*
gh-110259: Fix f-strings with multiline expressions and format specs (#110271)
Pablo Galindo Salgado
2023-10-05
1
-0/+97
*
gh-108303: Move tokenize-related data to Lib/test/tokenizedata (GH-109265)
Nikita Sobolev
2023-09-12
1
-4/+3
*
gh-108469: Update ast.unparse for unescaped quote support from PEP701 [3.12] ...
Anthony Shaw
2023-09-05
1
-1/+1
*
gh-107015: Remove async_hacks from the tokenizer (#107018)
Pablo Galindo Salgado
2023-07-26
1
-34/+34
*
gh-106200: Remove unused imports (#106201)
Nikita Sobolev
2023-06-28
1
-1/+0
*
gh-71299: Fix __all__ in tokenize (#105907)
Lysandros Nikolaou
2023-06-19
1
-132/+136
*
gh-105820: Fix tok_mode expression buffer in file & readline tokenizer (#105828)
Lysandros Nikolaou
2023-06-15
1
-0/+13
*
gh-105718: Fix buffer allocation in tokenizer with readline (#105728)
Lysandros Nikolaou
2023-06-13
1
-0/+10
*
gh-105549: Tokenize separately NUMBER and NAME tokens and allow 0-prefixed li...
Pablo Galindo Salgado
2023-06-09
1
-0/+33
*
gh-105564: Don't include artificial newlines in the line attribute of tokens ...
Pablo Galindo Salgado
2023-06-09
1
-8/+8
*
gh-105435: Fix spurious NEWLINE token if file ends with comment without a new...
Pablo Galindo Salgado
2023-06-07
1
-5/+26
*
gh-105390: Correctly raise TokenError instead of SyntaxError for tokenize err...
Pablo Galindo Salgado
2023-06-07
1
-5/+6
*
gh-105259: Ensure we don't show newline characters for trailing NEWLINE token...
Pablo Galindo Salgado
2023-06-06
1
-1/+1
*
gh-105042: Disable unmatched parens syntax error in python tokenize (#105061)
Lysandros Nikolaou
2023-05-30
1
-0/+7
*
gh-105069: Add a readline-like callable to the tokenizer to consume input ite...
Pablo Galindo Salgado
2023-05-30
1
-49/+96
*
gh-105017: Include CRLF lines in strings and column numbers (#105030)
Marta Gómez Macías
2023-05-28
1
-8/+36
*
gh-105017: Fix including additional NL token when using CRLF (#105022)
Marta Gómez Macías
2023-05-27
1
-0/+8
*
gh-104976: Ensure trailing dedent tokens are emitted as the previous tokenize...
Pablo Galindo Salgado
2023-05-26
1
-7/+8
*
gh-104972: Ensure that line attributes in tokens in the tokenize module are c...
Pablo Galindo Salgado
2023-05-26
1
-2/+13
*
gh-104866: Tokenize should emit NEWLINE after exiting block with comment (#10...
Lysandros Nikolaou
2023-05-24
1
-0/+17
*
gh-104825: Remove implicit newline in the line attribute in tokens emitted in...
Pablo Galindo Salgado
2023-05-24
1
-2/+2
*
gh-104741: Add line number attribute to indentation error exception (#104743)
Marta Gómez Macías
2023-05-22
1
-1/+10
*
gh-102856: Python tokenizer implementation for PEP 701 (#104323)
Marta Gómez Macías
2023-05-21
1
-48/+135
*
gh-103824: fix use-after-free error in Parser/tokenizer.c (#103993)
chgnrdv
2023-05-01
1
-1/+14
*
gh-102856: Initial implementation of PEP 701 (#102855)
Pablo Galindo Salgado
2023-04-19
1
-5/+23
*
gh-99581: Fix a buffer overflow in the tokenizer when copying lines that fill...
Pablo Galindo Salgado
2022-11-20
1
-0/+16
*
gh-94808: Coverage: Test that maximum indentation level is handled (#95926)
Michael Droettboom
2022-10-06
1
-1/+21
*
Remove trailing spaces (GH-31695)
Serhiy Storchaka
2022-03-05
1
-5/+5
*
bpo-46091: Correctly calculate indentation levels for whitespace lines with c...
Pablo Galindo Salgado
2022-01-25
1
-1/+99
*
Remove trailing spaces. (GH-28706)
Serhiy Storchaka
2021-10-03
1
-1/+1
*
Add tests for the C tokenizer and expose it as a private module (GH-27924)
Pablo Galindo Salgado
2021-08-24
1
-2/+861
*
bpo-44667: Treat correctly lines ending with comments and no newlines in the ...
Pablo Galindo Salgado
2021-07-31
1
-0/+10
*
bpo-40275: Use new test.support helper submodules in tests (GH-21448)
Hai Shi
2020-08-03
1
-2/+3
*
bpo-41043: Escape literal part of the path for glob(). (GH-20994)
Serhiy Storchaka
2020-06-20
1
-1/+1
*
bpo-35224: PEP 572 Implementation (#10497)
Emily Morehouse
2019-01-24
1
-0/+1
*
bpo-30455: Generate all token related code and docs from Grammar/Tokens. (GH-...
Serhiy Storchaka
2018-12-22
1
-0/+2
*
Fixed several assertTrue() that were intended to be assertEqual(). (GH-8191)
Sergey Fedoseev
2018-07-09
1
-1/+1
*
bpo-33899: Make tokenize module mirror end-of-file is end-of-line behavior (G...
Ammar Askar
2018-07-06
1
-24/+47
*
bpo-12486: Document tokenize.generate_tokens() as public API (#6957)
Thomas Kluyver
2018-06-05
1
-2/+15
*
bpo-30406: Make async and await proper keywords (#1669)
Jelle Zijlstra
2017-10-06
1
-14/+14
*
bpo-31029: test_tokenize Add missing import unittest (#2865)
Stéphane Wirtel
2017-07-25
1
-0/+1
*
bpo-25324: copy tok_name before changing it (#1608)
Albert-Jan Nijburg
2017-05-31
1
-6/+6
*
bpo-30377: Simplify handling of COMMENT and NL in tokenize.py (#1607)
Albert-Jan Nijburg
2017-05-24
1
-7/+9
*
Add ELLIPSIS and RARROW. Add tests (#666)
Jim Fasarakis-Hilliard
2017-03-14
1
-0/+21
*
Issue #26331: Implement the parsing part of PEP 515.
Brett Cannon
2016-09-09
1
-7/+23
*
Rename test_pep####.py files
Zachary Ware
2016-09-09
1
-5/+6
*
Fix running test_tokenize directly
Zachary Ware
2016-09-09
1
-2/+2
[next]