index
:
cpython.git
2.7
3.3
3.4
3.5
3.6
benjamin-clang
benjamin-iteration-torture
buildbot-custom
master
https://github.com/python/cpython.git
summary
refs
log
tree
commit
diff
stats
log msg
author
committer
range
path:
root
/
Lib
/
test
/
test_tokenize.py
Commit message (
Expand
)
Author
Age
Files
Lines
*
[3.12] gh-105820: Fix tok_mode expression buffer in file & readline tokenizer...
Miss Islington (bot)
2023-06-15
1
-0/+13
*
[3.12] gh-105718: Fix buffer allocation in tokenizer with readline (GH-105728...
Miss Islington (bot)
2023-06-13
1
-0/+10
*
[3.12] gh-105549: Tokenize separately NUMBER and NAME tokens and allow 0-pref...
Miss Islington (bot)
2023-06-09
1
-0/+33
*
[3.12] gh-105564: Don't include artificial newlines in the line attribute of ...
Miss Islington (bot)
2023-06-09
1
-8/+8
*
[3.12] gh-105435: Fix spurious NEWLINE token if file ends with comment withou...
Miss Islington (bot)
2023-06-07
1
-5/+26
*
[3.12] gh-105390: Correctly raise TokenError instead of SyntaxError for token...
Miss Islington (bot)
2023-06-07
1
-5/+6
*
[3.12] gh-105259: Ensure we don't show newline characters for trailing NEWLIN...
Miss Islington (bot)
2023-06-06
1
-1/+1
*
[3.12] gh-105069: Add a readline-like callable to the tokenizer to consume in...
Miss Islington (bot)
2023-05-31
1
-49/+96
*
[3.12] gh-105042: Disable unmatched parens syntax error in python tokenize (G...
Miss Islington (bot)
2023-05-31
1
-0/+7
*
[3.12] gh-105017: Include CRLF lines in strings and column numbers (GH-105030...
Miss Islington (bot)
2023-05-28
1
-8/+36
*
[3.12] gh-105017: Fix including additional NL token when using CRLF (GH-10502...
Miss Islington (bot)
2023-05-27
1
-0/+8
*
[3.12] gh-104976: Ensure trailing dedent tokens are emitted as the previous t...
Miss Islington (bot)
2023-05-26
1
-7/+8
*
[3.12] gh-104972: Ensure that line attributes in tokens in the tokenize modul...
Miss Islington (bot)
2023-05-26
1
-2/+13
*
[3.12] gh-104866: Tokenize should emit NEWLINE after exiting block with comme...
Miss Islington (bot)
2023-05-24
1
-0/+17
*
[3.12] gh-104825: Remove implicit newline in the line attribute in tokens emi...
Pablo Galindo Salgado
2023-05-24
1
-2/+2
*
gh-104741: Add line number attribute to indentation error exception (#104743)
Marta Gómez Macías
2023-05-22
1
-1/+10
*
gh-102856: Python tokenizer implementation for PEP 701 (#104323)
Marta Gómez Macías
2023-05-21
1
-48/+135
*
gh-103824: fix use-after-free error in Parser/tokenizer.c (#103993)
chgnrdv
2023-05-01
1
-1/+14
*
gh-102856: Initial implementation of PEP 701 (#102855)
Pablo Galindo Salgado
2023-04-19
1
-5/+23
*
gh-99581: Fix a buffer overflow in the tokenizer when copying lines that fill...
Pablo Galindo Salgado
2022-11-20
1
-0/+16
*
gh-94808: Coverage: Test that maximum indentation level is handled (#95926)
Michael Droettboom
2022-10-06
1
-1/+21
*
Remove trailing spaces (GH-31695)
Serhiy Storchaka
2022-03-05
1
-5/+5
*
bpo-46091: Correctly calculate indentation levels for whitespace lines with c...
Pablo Galindo Salgado
2022-01-25
1
-1/+99
*
Remove trailing spaces. (GH-28706)
Serhiy Storchaka
2021-10-03
1
-1/+1
*
Add tests for the C tokenizer and expose it as a private module (GH-27924)
Pablo Galindo Salgado
2021-08-24
1
-2/+861
*
bpo-44667: Treat correctly lines ending with comments and no newlines in the ...
Pablo Galindo Salgado
2021-07-31
1
-0/+10
*
bpo-40275: Use new test.support helper submodules in tests (GH-21448)
Hai Shi
2020-08-03
1
-2/+3
*
bpo-41043: Escape literal part of the path for glob(). (GH-20994)
Serhiy Storchaka
2020-06-20
1
-1/+1
*
bpo-35224: PEP 572 Implementation (#10497)
Emily Morehouse
2019-01-24
1
-0/+1
*
bpo-30455: Generate all token related code and docs from Grammar/Tokens. (GH-...
Serhiy Storchaka
2018-12-22
1
-0/+2
*
Fixed several assertTrue() that were intended to be assertEqual(). (GH-8191)
Sergey Fedoseev
2018-07-09
1
-1/+1
*
bpo-33899: Make tokenize module mirror end-of-file is end-of-line behavior (G...
Ammar Askar
2018-07-06
1
-24/+47
*
bpo-12486: Document tokenize.generate_tokens() as public API (#6957)
Thomas Kluyver
2018-06-05
1
-2/+15
*
bpo-30406: Make async and await proper keywords (#1669)
Jelle Zijlstra
2017-10-06
1
-14/+14
*
bpo-31029: test_tokenize Add missing import unittest (#2865)
Stéphane Wirtel
2017-07-25
1
-0/+1
*
bpo-25324: copy tok_name before changing it (#1608)
Albert-Jan Nijburg
2017-05-31
1
-6/+6
*
bpo-30377: Simplify handling of COMMENT and NL in tokenize.py (#1607)
Albert-Jan Nijburg
2017-05-24
1
-7/+9
*
Add ELLIPSIS and RARROW. Add tests (#666)
Jim Fasarakis-Hilliard
2017-03-14
1
-0/+21
*
Issue #26331: Implement the parsing part of PEP 515.
Brett Cannon
2016-09-09
1
-7/+23
*
Rename test_pep####.py files
Zachary Ware
2016-09-09
1
-5/+6
*
Fix running test_tokenize directly
Zachary Ware
2016-09-09
1
-2/+2
*
Issue 25311: Add support for f-strings to tokenize.py. Also added some commen...
Eric V. Smith
2015-10-26
1
-0/+17
*
Issue 25422: Add tests for multi-line string tokenization. Also remove trunca...
Eric V. Smith
2015-10-17
1
-6/+32
*
Issue #25317: Converted doctests in test_tokenize to unittests.
Serhiy Storchaka
2015-10-06
1
-419/+398
|
\
|
*
Issue #25317: Converted doctests in test_tokenize to unittests.
Serhiy Storchaka
2015-10-06
1
-357/+332
*
|
Issue #24619: Simplify async/await tokenization.
Yury Selivanov
2015-07-23
1
-0/+73
*
|
Issue #24619: New approach for tokenizing async/await.
Yury Selivanov
2015-07-22
1
-2/+13
*
|
Issue #20387: Merge test and patch from 3.4.4
Jason R. Coombs
2015-06-28
1
-1/+20
|
\
\
|
|
/
|
*
Issue #20387: Correct test to properly capture expectation.
Jason R. Coombs
2015-06-26
1
-2/+2
|
*
Issue #20387: Add test capturing failure to roundtrip indented code in tokeni...
Jason R. Coombs
2015-06-20
1
-0/+17
[next]