summaryrefslogtreecommitdiffstats
path: root/Parser/tokenizer.c
Commit message (Expand)AuthorAgeFilesLines
* Update URLs in comments and metadata to use HTTPS (GH-27458)Noah Kantrowitz2021-07-301-1/+1
* bpo-44317: Improve tokenizer errors with more informative locations (GH-26555)Pablo Galindo Salgado2021-07-101-18/+54
* Fix typos in multiple files (GH-26689)Binbin2021-06-131-3/+3
* bpo-44396: Update multi-line-start location when reallocating tokenizer buffe...Pablo Galindo2021-06-121-0/+5
* bpo-43833: Emit warnings for numeric literals followed by keyword (GH-25466)Serhiy Storchaka2021-06-081-0/+128
* bpo-44201: Avoid side effects of "invalid_*" rules in the REPL (GH-26298)Pablo Galindo2021-05-221-0/+9
* Fix tokenizer error when raw decoding null bytes (GH-25080)Pablo Galindo2021-03-291-1/+4
* bpo-25643: Refactor the C tokenizer into smaller, logical units (GH-25050)Pablo Galindo2021-03-281-354/+332
* bpo-43410: Fix crash in the parser when producing syntax errors when reading ...Pablo Galindo2021-03-141-26/+52
* bpo-40176: Improve error messages for unclosed string literals (GH-19346)Batuhan Taskaya2021-01-201-10/+16
* bpo-42864: Fix compiler warning in the tokenizer with the new paren stack for...Pablo Galindo2021-01-201-1/+1
* bpo-42864: Improve error messages regarding unclosed parentheses (GH-24161)Pablo Galindo2021-01-191-1/+4
* bpo-42827: Fix crash on SyntaxError in multiline expressions (GH-24140)Lysandros Nikolaou2021-01-141-0/+21
* bpo-42519: Replace PyMem_MALLOC() with PyMem_Malloc() (GH-23586)Victor Stinner2020-12-011-30/+30
* bpo-36020: Remove snprintf macro in pyerrors.h (GH-20889)Victor Stinner2020-06-151-1/+1
* bpo-40847: Consider a line with only a LINECONT a blank line (GH-20769)Lysandros Nikolaou2020-06-101-1/+2
* Fix peg_generator compiler warnings under MSVC (GH-20405)Ammar Askar2020-05-261-4/+0
* bpo-40593: Improve syntax errors for invalid characters in source code. (GH-2...Serhiy Storchaka2020-05-121-9/+37
* bpo-40246: Revert reporting of invalid string prefixes (GH-19888)Lysandros Nikolaou2020-05-041-4/+0
* bpo-40335: Correctly handle multi-line strings in tokenize error scenarios (G...Pablo Galindo2020-04-211-3/+4
* bpo-40246: Report a better error message for invalid string prefixes (GH-19476)Lysandros Nikolaou2020-04-121-0/+4
* bpo-39882: Add _Py_FatalErrorFormat() function (GH-19157)Victor Stinner2020-03-251-1/+1
* bpo-39882: Py_FatalError() logs the function name (GH-18819)Victor Stinner2020-03-061-3/+5
* closes bpo-39721: Fix constness of members of tok_state struct. (GH-18600)Andy Lester2020-02-281-20/+30
* bpo-39219: Fix SyntaxError attributes in the tokenizer. (GH-17828)Serhiy Storchaka2020-02-121-4/+32
* bpo-39500: Document PyUnicode_IsIdentifier() function (GH-18397)Victor Stinner2020-02-111-1/+2
* bpo-39209: Manage correctly multi-line tokens in interactive mode (GH-17860)Pablo Galindo2020-01-061-0/+2
* bpo-38673: dont switch to ps2 if the line starts with comment or whitespace (...Batuhan Taşkaya2019-12-091-0/+6
* Indent code inside if block. (GH-15284)Hansraj Das2019-08-151-1/+1
* Fix `SyntaxError` indicator printing too many spaces for multi-line strings (...Anthony Sottile2019-07-291-0/+2
* bpo-36878: Only allow text after `# type: ignore` if first character ASCII (G...Michael J. Sullivan2019-05-221-2/+3
* bpo-36878: Track extra text added to 'type: ignore' in the AST (GH-13479)Michael J. Sullivan2019-05-221-2/+6
* bpo-2180: Treat line continuation at EOF as a `SyntaxError` (GH-13401)Anthony Sottile2019-05-181-1/+10
* bpo-36878: Allow extra text after `# type: ignore` comments (GH-13238)Michael J. Sullivan2019-05-111-8/+5
* bpo-36623: Clean parser headers and include files (GH-12253)Pablo Galindo2019-04-131-1/+0
* bpo-36459: Fix a possible double PyMem_FREE() due to tokenizer.c's tok_nextc(...Zackery Spytz2019-03-281-1/+0
* bpo-36367: Free buffer if realloc fails in tokenize.c (GH-12442)Pablo Galindo2019-03-191-2/+8
* bpo-35975: Support parsing earlier minor versions of Python 3 (GH-12086)Guido van Rossum2019-03-071-0/+79
* bpo-35808: Retire pgen and use pgen2 to generate the parser (GH-11814)Pablo Galindo2019-03-011-56/+0
* bpo-35766: Merge typed_ast back into CPython (GH-11645)Guido van Rossum2019-01-311-1/+56
* bpo-16806: Fix `lineno` and `col_offset` for multi-line string tokens (GH-10021)Anthony Sottile2019-01-131-0/+7
* bpo-30455: Generate all token related code and docs from Grammar/Tokens. (GH-...Serhiy Storchaka2018-12-221-237/+0
* bpo-33306: Improve SyntaxError messages for unbalanced parentheses. (GH-6516)Serhiy Storchaka2018-12-171-0/+32
* bpo-35436: Add missing PyErr_NoMemory() calls and other minor bug fixes. (GH-...Zackery Spytz2018-12-071-0/+5
* Remove unneeded PyUnicode_READY() in tokenizer.c (GH-9114)Zackery Spytz2018-09-101-1/+1
* Fix Windows compiler warning in tokenize.c (GH-8359)Victor Stinner2018-07-211-1/+1
* bpo-33305: Improve SyntaxError for invalid numerical literals. (GH-6517)Serhiy Storchaka2018-07-091-13/+52
* tokenizer: Remove unused tabs options (#4422)Victor Stinner2017-11-171-31/+11
* bpo-30406: Make async and await proper keywords (#1669)Jelle Zijlstra2017-10-061-63/+0
* bpo-25324: add missing comma in Parser/tokenizer.c (GH-1910)Albert-Jan Nijburg2017-06-011-1/+1