summaryrefslogtreecommitdiffstats
path: root/Python/Python-tokenize.c
Commit message (Expand)AuthorAgeFilesLines
* gh-112943: Correctly compute end offsets for multiline tokens in the tokenize...Pablo Galindo Salgado2023-12-111-1/+1
* Remove unnecessary includes (GH-111633)Serhiy Storchaka2023-11-021-1/+0
* gh-104169: Refactor tokenizer into lexer and wrappers (#110684)Lysandros Nikolaou2023-10-111-1/+3
* gh-107015: Remove async_hacks from the tokenizer (#107018)Pablo Galindo Salgado2023-07-261-3/+0
* gh-105564: Don't include artificial newlines in the line attribute of tokens ...Pablo Galindo Salgado2023-06-091-0/+3
* gh-105390: Add explicit type cast (#105466)Kirill Podoprigora2023-06-071-1/+2
* gh-105435: Fix spurious NEWLINE token if file ends with comment without a new...Pablo Galindo Salgado2023-06-071-0/+11
* gh-105390: Correctly raise TokenError instead of SyntaxError for tokenize err...Pablo Galindo Salgado2023-06-071-7/+2
* gh-105259: Ensure we don't show newline characters for trailing NEWLINE token...Pablo Galindo Salgado2023-06-061-4/+6
* gh-105042: Disable unmatched parens syntax error in python tokenize (#105061)Lysandros Nikolaou2023-05-301-1/+1
* gh-105069: Add a readline-like callable to the tokenizer to consume input ite...Pablo Galindo Salgado2023-05-301-5/+7
* gh-105017: Include CRLF lines in strings and column numbers (#105030)Marta Gómez Macías2023-05-281-2/+7
* gh-104976: Ensure trailing dedent tokens are emitted as the previous tokenize...Pablo Galindo Salgado2023-05-261-3/+23
* gh-104972: Ensure that line attributes in tokens in the tokenize module are c...Pablo Galindo Salgado2023-05-261-5/+4
* gh-104825: Remove implicit newline in the line attribute in tokens emitted in...Pablo Galindo Salgado2023-05-241-0/+4
* gh-104741: Add line number attribute to indentation error exception (#104743)Marta Gómez Macías2023-05-221-6/+9
* gh-102856: Tokenize performance improvement (#104731)Marta Gómez Macías2023-05-221-1/+16
* gh-102856: Python tokenizer implementation for PEP 701 (#104323)Marta Gómez Macías2023-05-211-14/+126
* gh-99113: Add Py_MOD_PER_INTERPRETER_GIL_SUPPORTED (gh-104205)Eric Snow2023-05-051-0/+1
* gh-102856: Initial implementation of PEP 701 (#102855)Pablo Galindo Salgado2023-04-191-2/+2
* gh-97973: Return all necessary information from the tokenizer (GH-97984)Lysandros Nikolaou2022-10-061-9/+8
* gh-90928: Statically Initialize the Keywords Tuple in Clinic-Generated Code (...Eric Snow2022-08-111-0/+1
* bpo-46613: Add PyType_GetModuleByDef to the public API (GH-31081)Petr Viktorin2022-02-111-1/+1
* bpo-45434: Mark the PyTokenizer C API as private (GH-28924)Victor Stinner2021-10-131-3/+3
* Remove trailing spaces. (GH-28706)Serhiy Storchaka2021-10-031-1/+1
* Format the Python-tokenize module and fix exit path (GH-27935)Pablo Galindo Salgado2021-08-251-47/+46
* Add tests for the C tokenizer and expose it as a private module (GH-27924)Pablo Galindo Salgado2021-08-241-0/+195