index
:
cpython.git
2.7
3.3
3.4
3.5
3.6
benjamin-clang
benjamin-iteration-torture
buildbot-custom
master
https://github.com/python/cpython.git
summary
refs
log
tree
commit
diff
stats
log msg
author
committer
range
path:
root
/
Lib
/
test
/
test_tokenize.py
Commit message (
Expand
)
Author
Age
Files
Lines
*
bpo-35224: PEP 572 Implementation (#10497)
Emily Morehouse
2019-01-24
1
-0/+1
*
bpo-30455: Generate all token related code and docs from Grammar/Tokens. (GH-...
Serhiy Storchaka
2018-12-22
1
-0/+2
*
Fixed several assertTrue() that were intended to be assertEqual(). (GH-8191)
Sergey Fedoseev
2018-07-09
1
-1/+1
*
bpo-33899: Make tokenize module mirror end-of-file is end-of-line behavior (G...
Ammar Askar
2018-07-06
1
-24/+47
*
bpo-12486: Document tokenize.generate_tokens() as public API (#6957)
Thomas Kluyver
2018-06-05
1
-2/+15
*
bpo-30406: Make async and await proper keywords (#1669)
Jelle Zijlstra
2017-10-06
1
-14/+14
*
bpo-31029: test_tokenize Add missing import unittest (#2865)
Stéphane Wirtel
2017-07-25
1
-0/+1
*
bpo-25324: copy tok_name before changing it (#1608)
Albert-Jan Nijburg
2017-05-31
1
-6/+6
*
bpo-30377: Simplify handling of COMMENT and NL in tokenize.py (#1607)
Albert-Jan Nijburg
2017-05-24
1
-7/+9
*
Add ELLIPSIS and RARROW. Add tests (#666)
Jim Fasarakis-Hilliard
2017-03-14
1
-0/+21
*
Issue #26331: Implement the parsing part of PEP 515.
Brett Cannon
2016-09-09
1
-7/+23
*
Rename test_pep####.py files
Zachary Ware
2016-09-09
1
-5/+6
*
Fix running test_tokenize directly
Zachary Ware
2016-09-09
1
-2/+2
*
Issue 25311: Add support for f-strings to tokenize.py. Also added some commen...
Eric V. Smith
2015-10-26
1
-0/+17
*
Issue 25422: Add tests for multi-line string tokenization. Also remove trunca...
Eric V. Smith
2015-10-17
1
-6/+32
*
Issue #25317: Converted doctests in test_tokenize to unittests.
Serhiy Storchaka
2015-10-06
1
-419/+398
|
\
|
*
Issue #25317: Converted doctests in test_tokenize to unittests.
Serhiy Storchaka
2015-10-06
1
-357/+332
*
|
Issue #24619: Simplify async/await tokenization.
Yury Selivanov
2015-07-23
1
-0/+73
*
|
Issue #24619: New approach for tokenizing async/await.
Yury Selivanov
2015-07-22
1
-2/+13
*
|
Issue #20387: Merge test and patch from 3.4.4
Jason R. Coombs
2015-06-28
1
-1/+20
|
\
\
|
|
/
|
*
Issue #20387: Correct test to properly capture expectation.
Jason R. Coombs
2015-06-26
1
-2/+2
|
*
Issue #20387: Add test capturing failure to roundtrip indented code in tokeni...
Jason R. Coombs
2015-06-20
1
-0/+17
|
*
Remove unused import and remove doctest-only import into doctests.
Jason R. Coombs
2015-06-20
1
-1/+3
*
|
(Merge 3.5) Issue #23840: tokenize.open() now closes the temporary binary file
Victor Stinner
2015-05-25
1
-1/+9
|
\
\
|
|
/
|
*
Issue #23840: tokenize.open() now closes the temporary binary file on error to
Victor Stinner
2015-05-25
1
-1/+9
*
|
Issue 24226: Fix parsing of many sequential one-line 'def' statements.
Yury Selivanov
2015-05-18
1
-0/+11
*
|
PEP 0492 -- Coroutines with async and await syntax. Issue #24017.
Yury Selivanov
2015-05-12
1
-0/+186
*
|
Issue #23681: Fixed Python 2 to 3 poring bugs.
Serhiy Storchaka
2015-03-20
1
-3/+4
|
\
\
|
|
/
|
*
Issue #23681: Fixed Python 2 to 3 poring bugs.
Serhiy Storchaka
2015-03-20
1
-3/+4
*
|
PEP 465: a dedicated infix operator for matrix multiplication (closes #21176)
Benjamin Peterson
2014-04-10
1
-1/+4
|
/
*
Issue #9974: When untokenizing, use row info to insert backslash+newline.
Terry Jan Reedy
2014-02-24
1
-1/+16
*
Issue #20750, Enable roundtrip tests for new 5-tuple untokenize. The
Terry Jan Reedy
2014-02-23
1
-14/+38
*
Issue #8478: Untokenizer.compat now processes first token from iterator input.
Terry Jan Reedy
2014-02-18
1
-0/+13
*
whitespace
Terry Jan Reedy
2014-02-17
1
-2/+2
*
Untokenize: An logically incorrect assert tested user input validity.
Terry Jan Reedy
2014-02-17
1
-1/+15
*
Issue #18960: Fix bugs with Python source code encoding in the second line.
Serhiy Storchaka
2014-01-09
1
-0/+33
*
Issue #18873: The tokenize module, IDLE, 2to3, and the findnocoding.py script
Serhiy Storchaka
2013-09-16
1
-0/+7
*
#16152: merge with 3.2.
Ezio Melotti
2012-11-03
1
-0/+4
|
\
|
*
#16152: fix tokenize to ignore whitespace at the end of the code when no newl...
Ezio Melotti
2012-11-03
1
-0/+5
*
|
Merge branch
Florent Xicluna
2012-07-07
1
-0/+4
|
\
\
|
|
/
|
*
Issue #14990: tokenize: correctly fail with SyntaxError on invalid encoding d...
Florent Xicluna
2012-07-07
1
-0/+4
*
|
Issue #15096: Drop support for the ur string prefix
Christian Heimes
2012-06-20
1
-20/+2
*
|
Issue #15054: Fix incorrect tokenization of 'b' string literals.
Meador Inge
2012-06-17
1
-0/+76
*
|
Issue #14629: Mention the filename in SyntaxError exceptions from
Brett Cannon
2012-04-20
1
-0/+29
*
|
merge 3.2: issue 14629
Martin v. Löwis
2012-04-20
1
-0/+10
|
\
\
|
|
/
|
*
Issue #14629: Raise SyntaxError in tokenizer.detect_encoding
Martin v. Löwis
2012-04-20
1
-0/+10
*
|
Updated tokenize to support the inverse byte literals new in 3.3
Armin Ronacher
2012-03-04
1
-0/+12
*
|
Issue #2134: Add support for tokenize.TokenInfo.exact_type.
Meador Inge
2012-01-19
1
-1/+74
*
|
#13012: use splitlines(keepends=True/False) instead of splitlines(0/1).
Ezio Melotti
2011-09-28
1
-1/+1
|
/
*
tokenize is just broken on test_pep3131.py
Benjamin Peterson
2011-08-13
1
-0/+3
[next]