index
:
cpython.git
2.7
3.3
3.4
3.5
3.6
benjamin-clang
benjamin-iteration-torture
buildbot-custom
master
https://github.com/python/cpython.git
summary
refs
log
tree
commit
diff
stats
log msg
author
committer
range
path:
root
/
Python
/
Python-tokenize.c
Commit message (
Expand
)
Author
Age
Files
Lines
*
gh-104169: Refactor tokenizer into lexer and wrappers (#110684)
Lysandros Nikolaou
2023-10-11
1
-1/+3
*
gh-107015: Remove async_hacks from the tokenizer (#107018)
Pablo Galindo Salgado
2023-07-26
1
-3/+0
*
gh-105564: Don't include artificial newlines in the line attribute of tokens ...
Pablo Galindo Salgado
2023-06-09
1
-0/+3
*
gh-105390: Add explicit type cast (#105466)
Kirill Podoprigora
2023-06-07
1
-1/+2
*
gh-105435: Fix spurious NEWLINE token if file ends with comment without a new...
Pablo Galindo Salgado
2023-06-07
1
-0/+11
*
gh-105390: Correctly raise TokenError instead of SyntaxError for tokenize err...
Pablo Galindo Salgado
2023-06-07
1
-7/+2
*
gh-105259: Ensure we don't show newline characters for trailing NEWLINE token...
Pablo Galindo Salgado
2023-06-06
1
-4/+6
*
gh-105042: Disable unmatched parens syntax error in python tokenize (#105061)
Lysandros Nikolaou
2023-05-30
1
-1/+1
*
gh-105069: Add a readline-like callable to the tokenizer to consume input ite...
Pablo Galindo Salgado
2023-05-30
1
-5/+7
*
gh-105017: Include CRLF lines in strings and column numbers (#105030)
Marta Gómez Macías
2023-05-28
1
-2/+7
*
gh-104976: Ensure trailing dedent tokens are emitted as the previous tokenize...
Pablo Galindo Salgado
2023-05-26
1
-3/+23
*
gh-104972: Ensure that line attributes in tokens in the tokenize module are c...
Pablo Galindo Salgado
2023-05-26
1
-5/+4
*
gh-104825: Remove implicit newline in the line attribute in tokens emitted in...
Pablo Galindo Salgado
2023-05-24
1
-0/+4
*
gh-104741: Add line number attribute to indentation error exception (#104743)
Marta Gómez Macías
2023-05-22
1
-6/+9
*
gh-102856: Tokenize performance improvement (#104731)
Marta Gómez Macías
2023-05-22
1
-1/+16
*
gh-102856: Python tokenizer implementation for PEP 701 (#104323)
Marta Gómez Macías
2023-05-21
1
-14/+126
*
gh-99113: Add Py_MOD_PER_INTERPRETER_GIL_SUPPORTED (gh-104205)
Eric Snow
2023-05-05
1
-0/+1
*
gh-102856: Initial implementation of PEP 701 (#102855)
Pablo Galindo Salgado
2023-04-19
1
-2/+2
*
gh-97973: Return all necessary information from the tokenizer (GH-97984)
Lysandros Nikolaou
2022-10-06
1
-9/+8
*
gh-90928: Statically Initialize the Keywords Tuple in Clinic-Generated Code (...
Eric Snow
2022-08-11
1
-0/+1
*
bpo-46613: Add PyType_GetModuleByDef to the public API (GH-31081)
Petr Viktorin
2022-02-11
1
-1/+1
*
bpo-45434: Mark the PyTokenizer C API as private (GH-28924)
Victor Stinner
2021-10-13
1
-3/+3
*
Remove trailing spaces. (GH-28706)
Serhiy Storchaka
2021-10-03
1
-1/+1
*
Format the Python-tokenize module and fix exit path (GH-27935)
Pablo Galindo Salgado
2021-08-25
1
-47/+46
*
Add tests for the C tokenizer and expose it as a private module (GH-27924)
Pablo Galindo Salgado
2021-08-24
1
-0/+195