index
:
cpython.git
2.7
3.3
3.4
3.5
3.6
benjamin-clang
benjamin-iteration-torture
buildbot-custom
master
https://github.com/python/cpython.git
summary
refs
log
tree
commit
diff
stats
log msg
author
committer
range
path:
root
/
Parser
/
tokenizer.c
Commit message (
Expand
)
Author
Age
Files
Lines
*
gh-104922: remove PY_SSIZE_T_CLEAN (#106315)
Inada Naoki
2023-07-02
1
-1/+0
*
gh-105938: Emit a SyntaxWarning for escaped braces in an f-string (#105939)
Lysandros Nikolaou
2023-06-20
1
-3/+3
*
gh-105820: Fix tok_mode expression buffer in file & readline tokenizer (#105828)
Lysandros Nikolaou
2023-06-15
1
-3/+8
*
gh-105718: Fix buffer allocation in tokenizer with readline (#105728)
Lysandros Nikolaou
2023-06-13
1
-4/+0
*
gh-105549: Tokenize separately NUMBER and NAME tokens and allow 0-prefixed li...
Pablo Galindo Salgado
2023-06-09
1
-3/+10
*
gh-105259: Ensure we don't show newline characters for trailing NEWLINE token...
Pablo Galindo Salgado
2023-06-06
1
-0/+7
*
gh-105042: Disable unmatched parens syntax error in python tokenize (#105061)
Lysandros Nikolaou
2023-05-30
1
-32/+33
*
gh-105069: Add a readline-like callable to the tokenizer to consume input ite...
Pablo Galindo Salgado
2023-05-30
1
-3/+133
*
gh-105017: Include CRLF lines in strings and column numbers (#105030)
Marta Gómez Macías
2023-05-28
1
-12/+26
*
gh-105017: Fix including additional NL token when using CRLF (#105022)
Marta Gómez Macías
2023-05-27
1
-1/+1
*
Fix indentation in Parser/tokenizer.c (#105012)
Petr Vaněk
2023-05-27
1
-1/+1
*
gh-104866: Tokenize should emit NEWLINE after exiting block with comment (#10...
Lysandros Nikolaou
2023-05-24
1
-3/+6
*
gh-102856: Allow comments inside multi-line f-string expresions (#104006)
Cristián Maureira-Fredes
2023-05-22
1
-4/+0
*
gh-98836: Extend PyUnicode_FromFormat() (GH-98838)
Serhiy Storchaka
2023-05-21
1
-8/+3
*
gh-102856: Python tokenizer implementation for PEP 701 (#104323)
Marta Gómez Macías
2023-05-21
1
-2/+55
*
gh-104658: Fix location of unclosed quote error for multiline f-strings (#104...
Pablo Galindo Salgado
2023-05-20
1
-2/+5
*
Trim trailing whitespace and test on CI (#104275)
Hugo van Kemenade
2023-05-08
1
-1/+1
*
gh-104169: Ensure the tokenizer doesn't overwrite previous errors (#104170)
Pablo Galindo Salgado
2023-05-04
1
-0/+6
*
gh-97556: Raise null bytes syntax error upon null in multiline string (GH-104...
Lysandros Nikolaou
2023-05-04
1
-1/+8
*
gh-104016: Fixed off by 1 error in f string tokenizer (#104047)
jx124
2023-05-01
1
-2/+5
*
gh-103824: fix use-after-free error in Parser/tokenizer.c (#103993)
chgnrdv
2023-05-01
1
-0/+4
*
gh-103656: Transfer f-string buffers to parser to avoid use-after-free (GH-10...
Lysandros Nikolaou
2023-04-27
1
-2/+32
*
gh-103718: Correctly set f-string buffers in all cases (GH-103815)
Lysandros Nikolaou
2023-04-25
1
-8/+6
*
GH-103727: Avoid advancing tokenizer too far in f-string mode (GH-103775)
Lysandros Nikolaou
2023-04-24
1
-8/+10
*
GH-103718: Correctly cache and restore f-string buffers when needed (GH-103719)
Lysandros Nikolaou
2023-04-23
1
-11/+27
*
gh-102856: Clean some of the PEP 701 tokenizer implementation (#103634)
Pablo Galindo Salgado
2023-04-19
1
-71/+65
*
gh-102856: Initial implementation of PEP 701 (#102855)
Pablo Galindo Salgado
2023-04-19
1
-6/+483
*
gh-99891: Fix infinite recursion in the tokenizer when showing warnings (GH-9...
Pablo Galindo Salgado
2022-11-30
1
-0/+8
*
gh-99581: Fix a buffer overflow in the tokenizer when copying lines that fill...
Pablo Galindo Salgado
2022-11-20
1
-1/+6
*
gh-99300: Use Py_NewRef() in Parser/ directory (#99330)
Victor Stinner
2022-11-10
1
-2/+1
*
gh-97997: Add col_offset field to tokenizer and use that for AST nodes (#98000)
Lysandros Nikolaou
2022-10-07
1
-11/+41
*
gh-97973: Return all necessary information from the tokenizer (GH-97984)
Lysandros Nikolaou
2022-10-06
1
-103/+117
*
gh-96670: Raise SyntaxError when parsing NULL bytes (#97594)
Pablo Galindo Salgado
2022-09-27
1
-4/+15
*
gh-96678: Fix UB of null pointer arithmetic (GH-96782)
Matthias Görgens
2022-09-13
1
-1/+1
*
gh-96268: Fix loading invalid UTF-8 (#96270)
Michael Droettboom
2022-09-07
1
-13/+45
*
gh-96611: Fix error message for invalid UTF-8 in mid-multiline string (#96623)
Michael Droettboom
2022-09-06
1
-0/+2
*
gh-94360: Fix a tokenizer crash when reading encoded files with syntax errors...
Pablo Galindo Salgado
2022-07-05
1
-1/+9
*
gh-93741: Add private C API _PyImport_GetModuleAttrString() (GH-93742)
Serhiy Storchaka
2022-06-14
1
-5/+5
*
GH-93207: Remove HAVE_STDARG_PROTOTYPES configure check for stdarg.h (#93215)
Kumar Aditya
2022-05-27
1
-12/+0
*
gh-93103: Parser uses PyConfig.parser_debug instead of Py_DebugFlag (#93106)
Victor Stinner
2022-05-24
1
-1/+4
*
gh-92651: Remove the Include/token.h header file (#92652)
Victor Stinner
2022-05-11
1
-3/+3
*
gh-87999: Change warning type for numeric literal followed by keyword (GH-91980)
Serhiy Storchaka
2022-04-27
1
-4/+6
*
bpo-46315: Use fopencookie only on Emscripten 3.x and newer (GH-32266)
Christian Heimes
2022-04-02
1
-1/+1
*
bpo-47126: Update to canonical PEP URLs specified by PEP 676 (GH-32124)
Hugo van Kemenade
2022-03-30
1
-1/+1
*
bpo-46315: Use fopencookie() to avoid dup() in _PyTokenizer_FindEncodingFilen...
Christian Heimes
2022-03-22
1
-6/+34
*
bpo-46920: Remove code that has explainers why it was disabled (GH-31813)
Oleg Iarygin
2022-03-14
1
-24/+0
*
bpo-46820: Fix a SyntaxError in a numeric literal followed by "not in" (GH-31...
Serhiy Storchaka
2022-02-22
1
-0/+3
*
bpo-46541: Replace core use of _Py_IDENTIFIER() with statically initialized g...
Eric Snow
2022-02-08
1
-9/+10
*
bpo-46521: Fix codeop to use a new partial-input mode of the parser (GH-31010)
Pablo Galindo Salgado
2022-02-08
1
-10/+16
*
bpo-14916: use specified tokenizer fd for file input (GH-31006)
Paul m. p. P
2022-02-01
1
-1/+1
[next]