summaryrefslogtreecommitdiffstats
path: root/Parser/tokenizer.h
Commit message (Expand)AuthorAgeFilesLines
* gh-105718: Fix buffer allocation in tokenizer with readline (#105728)Lysandros Nikolaou2023-06-131-1/+1
* gh-105259: Ensure we don't show newline characters for trailing NEWLINE token...Pablo Galindo Salgado2023-06-061-0/+1
* gh-105069: Add a readline-like callable to the tokenizer to consume input ite...Pablo Galindo Salgado2023-05-301-0/+2
* gh-105017: Include CRLF lines in strings and column numbers (#105030)Marta Gómez Macías2023-05-281-2/+2
* Fix typo in the tokenizer (#104950)Stepfen Shawn2023-05-261-1/+1
* gh-102856: Python tokenizer implementation for PEP 701 (#104323)Marta Gómez Macías2023-05-211-0/+4
* gh-104658: Fix location of unclosed quote error for multiline f-strings (#104...Pablo Galindo Salgado2023-05-201-0/+1
* gh-104016: Fixed off by 1 error in f string tokenizer (#104047)jx1242023-05-011-3/+4
* gh-103656: Transfer f-string buffers to parser to avoid use-after-free (GH-10...Lysandros Nikolaou2023-04-271-0/+2
* GH-103718: Correctly cache and restore f-string buffers when needed (GH-103719)Lysandros Nikolaou2023-04-231-0/+3
* gh-102856: Clean some of the PEP 701 tokenizer implementation (#103634)Pablo Galindo Salgado2023-04-191-3/+2
* gh-102856: Initial implementation of PEP 701 (#102855)Pablo Galindo Salgado2023-04-191-0/+29
* gh-99891: Fix infinite recursion in the tokenizer when showing warnings (GH-9...Pablo Galindo Salgado2022-11-301-0/+1
* gh-97997: Add col_offset field to tokenizer and use that for AST nodes (#98000)Lysandros Nikolaou2022-10-071-0/+2
* gh-97973: Return all necessary information from the tokenizer (GH-97984)Lysandros Nikolaou2022-10-061-1/+7
* gh-93103: Parser uses PyConfig.parser_debug instead of Py_DebugFlag (#93106)Victor Stinner2022-05-241-0/+3
* gh-92651: Remove the Include/token.h header file (#92652)Victor Stinner2022-05-111-1/+1
* Ensure the str member of the tokenizer is always initialised (GH-29681)Pablo Galindo Salgado2021-11-211-1/+1
* bpo-45434: Mark the PyTokenizer C API as private (GH-28924)Victor Stinner2021-10-131-5/+5
* Fix typos in the Objects directory (GH-28766)Christian Clauss2021-10-061-1/+1
* bpo-44854: Remove trailing whitespaces (GH-27689)Serhiy Storchaka2021-08-091-1/+1
* bpo-44201: Avoid side effects of "invalid_*" rules in the REPL (GH-26298)Pablo Galindo2021-05-221-0/+10
* bpo-25643: Refactor the C tokenizer into smaller, logical units (GH-25050)Pablo Galindo2021-03-281-3/+2
* bpo-43410: Fix crash in the parser when producing syntax errors when reading ...Pablo Galindo2021-03-141-1/+3
* bpo-42864: Improve error messages regarding unclosed parentheses (GH-24161)Pablo Galindo2021-01-191-0/+1
* bpo-42827: Fix crash on SyntaxError in multiline expressions (GH-24140)Lysandros Nikolaou2021-01-141-0/+1
* closes bpo-39721: Fix constness of members of tok_state struct. (GH-18600)Andy Lester2020-02-281-5/+5
* bpo-36623: Clean parser headers and include files (GH-12253)Pablo Galindo2019-04-131-0/+2
* bpo-35975: Support parsing earlier minor versions of Python 3 (GH-12086)Guido van Rossum2019-03-071-0/+7
* bpo-35808: Retire pgen and use pgen2 to generate the parser (GH-11814)Pablo Galindo2019-03-011-8/+0
* bpo-35766: Merge typed_ast back into CPython (GH-11645)Guido van Rossum2019-01-311-0/+2
* bpo-16806: Fix `lineno` and `col_offset` for multi-line string tokens (GH-10021)Anthony Sottile2019-01-131-0/+5
* bpo-33306: Improve SyntaxError messages for unbalanced parentheses. (GH-6516)Serhiy Storchaka2018-12-171-1/+4
* tokenizer: Remove unused tabs options (#4422)Victor Stinner2017-11-171-3/+0
* bpo-30406: Make async and await proper keywords (#1669)Jelle Zijlstra2017-10-061-7/+0
* Remove obsolete declaration in tokenizer.h (#962)Jim Fasarakis-Hilliard2017-04-031-2/+0
* Issue #24619: Simplify async/await tokenization.Yury Selivanov2015-07-231-15/+6
* Issue #24619: New approach for tokenizing async/await.Yury Selivanov2015-07-221-6/+15
* PEP 0492 -- Coroutines with async and await syntax. Issue #24017.Yury Selivanov2015-05-121-0/+7
* Issue #1772673: The type of `char*` arguments now changed to `const char*`.Serhiy Storchaka2013-10-191-3/+3
* Issue #9319: Include the filename in "Non-UTF8 code ..." syntax error.Victor Stinner2011-04-041-1/+0
* Issue #10785: Store the filename as Unicode in the Python parser.Victor Stinner2011-04-041-1/+7
* #10222: fix for overzealous AIX compiler.Georg Brandl2010-10-291-1/+1
* Issue #9713, #10114: Parser functions (eg. PyParser_ASTFromFile) expectsVictor Stinner2010-10-161-1/+1
* Issue #10095: fp_setreadl() doesn't reopen the file, reuse instead the fileVictor Stinner2010-10-141-1/+1
* Recorded merge of revisions 81029 via svnmerge fromAntoine Pitrou2010-05-091-45/+45
* Merged revisions 76230 via svnmerge fromBenjamin Peterson2009-11-131-2/+3
* ignore the coding cookie in compile(), exec(), and eval() if the source is a ...Benjamin Peterson2009-03-021-0/+1
* Latin-1 source code was not being properly decoded when passed throughBrett Cannon2008-10-171-2/+2
* Issue 1267, continued.Guido van Rossum2007-10-221-1/+1