summaryrefslogtreecommitdiffstats
path: root/Parser/tokenizer.c
Commit message (Expand)AuthorAgeFilesLines
* gh-104922: remove PY_SSIZE_T_CLEAN (#106315)Inada Naoki2023-07-021-1/+0
* gh-105938: Emit a SyntaxWarning for escaped braces in an f-string (#105939)Lysandros Nikolaou2023-06-201-3/+3
* gh-105820: Fix tok_mode expression buffer in file & readline tokenizer (#105828)Lysandros Nikolaou2023-06-151-3/+8
* gh-105718: Fix buffer allocation in tokenizer with readline (#105728)Lysandros Nikolaou2023-06-131-4/+0
* gh-105549: Tokenize separately NUMBER and NAME tokens and allow 0-prefixed li...Pablo Galindo Salgado2023-06-091-3/+10
* gh-105259: Ensure we don't show newline characters for trailing NEWLINE token...Pablo Galindo Salgado2023-06-061-0/+7
* gh-105042: Disable unmatched parens syntax error in python tokenize (#105061)Lysandros Nikolaou2023-05-301-32/+33
* gh-105069: Add a readline-like callable to the tokenizer to consume input ite...Pablo Galindo Salgado2023-05-301-3/+133
* gh-105017: Include CRLF lines in strings and column numbers (#105030)Marta Gómez Macías2023-05-281-12/+26
* gh-105017: Fix including additional NL token when using CRLF (#105022)Marta Gómez Macías2023-05-271-1/+1
* Fix indentation in Parser/tokenizer.c (#105012)Petr Vaněk2023-05-271-1/+1
* gh-104866: Tokenize should emit NEWLINE after exiting block with comment (#10...Lysandros Nikolaou2023-05-241-3/+6
* gh-102856: Allow comments inside multi-line f-string expresions (#104006)Cristián Maureira-Fredes2023-05-221-4/+0
* gh-98836: Extend PyUnicode_FromFormat() (GH-98838)Serhiy Storchaka2023-05-211-8/+3
* gh-102856: Python tokenizer implementation for PEP 701 (#104323)Marta Gómez Macías2023-05-211-2/+55
* gh-104658: Fix location of unclosed quote error for multiline f-strings (#104...Pablo Galindo Salgado2023-05-201-2/+5
* Trim trailing whitespace and test on CI (#104275)Hugo van Kemenade2023-05-081-1/+1
* gh-104169: Ensure the tokenizer doesn't overwrite previous errors (#104170)Pablo Galindo Salgado2023-05-041-0/+6
* gh-97556: Raise null bytes syntax error upon null in multiline string (GH-104...Lysandros Nikolaou2023-05-041-1/+8
* gh-104016: Fixed off by 1 error in f string tokenizer (#104047)jx1242023-05-011-2/+5
* gh-103824: fix use-after-free error in Parser/tokenizer.c (#103993)chgnrdv2023-05-011-0/+4
* gh-103656: Transfer f-string buffers to parser to avoid use-after-free (GH-10...Lysandros Nikolaou2023-04-271-2/+32
* gh-103718: Correctly set f-string buffers in all cases (GH-103815)Lysandros Nikolaou2023-04-251-8/+6
* GH-103727: Avoid advancing tokenizer too far in f-string mode (GH-103775)Lysandros Nikolaou2023-04-241-8/+10
* GH-103718: Correctly cache and restore f-string buffers when needed (GH-103719)Lysandros Nikolaou2023-04-231-11/+27
* gh-102856: Clean some of the PEP 701 tokenizer implementation (#103634)Pablo Galindo Salgado2023-04-191-71/+65
* gh-102856: Initial implementation of PEP 701 (#102855)Pablo Galindo Salgado2023-04-191-6/+483
* gh-99891: Fix infinite recursion in the tokenizer when showing warnings (GH-9...Pablo Galindo Salgado2022-11-301-0/+8
* gh-99581: Fix a buffer overflow in the tokenizer when copying lines that fill...Pablo Galindo Salgado2022-11-201-1/+6
* gh-99300: Use Py_NewRef() in Parser/ directory (#99330)Victor Stinner2022-11-101-2/+1
* gh-97997: Add col_offset field to tokenizer and use that for AST nodes (#98000)Lysandros Nikolaou2022-10-071-11/+41
* gh-97973: Return all necessary information from the tokenizer (GH-97984)Lysandros Nikolaou2022-10-061-103/+117
* gh-96670: Raise SyntaxError when parsing NULL bytes (#97594)Pablo Galindo Salgado2022-09-271-4/+15
* gh-96678: Fix UB of null pointer arithmetic (GH-96782)Matthias Görgens2022-09-131-1/+1
* gh-96268: Fix loading invalid UTF-8 (#96270)Michael Droettboom2022-09-071-13/+45
* gh-96611: Fix error message for invalid UTF-8 in mid-multiline string (#96623)Michael Droettboom2022-09-061-0/+2
* gh-94360: Fix a tokenizer crash when reading encoded files with syntax errors...Pablo Galindo Salgado2022-07-051-1/+9
* gh-93741: Add private C API _PyImport_GetModuleAttrString() (GH-93742)Serhiy Storchaka2022-06-141-5/+5
* GH-93207: Remove HAVE_STDARG_PROTOTYPES configure check for stdarg.h (#93215)Kumar Aditya2022-05-271-12/+0
* gh-93103: Parser uses PyConfig.parser_debug instead of Py_DebugFlag (#93106)Victor Stinner2022-05-241-1/+4
* gh-92651: Remove the Include/token.h header file (#92652)Victor Stinner2022-05-111-3/+3
* gh-87999: Change warning type for numeric literal followed by keyword (GH-91980)Serhiy Storchaka2022-04-271-4/+6
* bpo-46315: Use fopencookie only on Emscripten 3.x and newer (GH-32266)Christian Heimes2022-04-021-1/+1
* bpo-47126: Update to canonical PEP URLs specified by PEP 676 (GH-32124)Hugo van Kemenade2022-03-301-1/+1
* bpo-46315: Use fopencookie() to avoid dup() in _PyTokenizer_FindEncodingFilen...Christian Heimes2022-03-221-6/+34
* bpo-46920: Remove code that has explainers why it was disabled (GH-31813)Oleg Iarygin2022-03-141-24/+0
* bpo-46820: Fix a SyntaxError in a numeric literal followed by "not in" (GH-31...Serhiy Storchaka2022-02-221-0/+3
* bpo-46541: Replace core use of _Py_IDENTIFIER() with statically initialized g...Eric Snow2022-02-081-9/+10
* bpo-46521: Fix codeop to use a new partial-input mode of the parser (GH-31010)Pablo Galindo Salgado2022-02-081-10/+16
* bpo-14916: use specified tokenizer fd for file input (GH-31006)Paul m. p. P2022-02-011-1/+1