index
:
cpython.git
2.7
3.3
3.4
3.5
3.6
benjamin-clang
benjamin-iteration-torture
buildbot-custom
master
https://github.com/python/cpython.git
summary
refs
log
tree
commit
diff
stats
log msg
author
committer
range
path:
root
/
Parser
/
tokenizer.c
Commit message (
Expand
)
Author
Age
Files
Lines
*
Update URLs in comments and metadata to use HTTPS (GH-27458) (GH-27478)
Miss Islington (bot)
2021-07-30
1
-1/+1
*
bpo-44317: Improve tokenizer errors with more informative locations (GH-26555...
Miss Islington (bot)
2021-07-10
1
-18/+54
*
bpo-44396: Update multi-line-start location when reallocating tokenizer buffe...
Miss Islington (bot)
2021-06-12
1
-0/+5
*
bpo-43833: Emit warnings for numeric literals followed by keyword (GH-25466)
Miss Islington (bot)
2021-06-08
1
-0/+128
*
bpo-44201: Avoid side effects of "invalid_*" rules in the REPL (GH-26298) (GH...
Miss Islington (bot)
2021-05-22
1
-0/+9
*
Fix tokenizer error when raw decoding null bytes (GH-25080)
Pablo Galindo
2021-03-29
1
-1/+4
*
bpo-25643: Refactor the C tokenizer into smaller, logical units (GH-25050)
Pablo Galindo
2021-03-28
1
-354/+332
*
bpo-43410: Fix crash in the parser when producing syntax errors when reading ...
Pablo Galindo
2021-03-14
1
-26/+52
*
bpo-40176: Improve error messages for unclosed string literals (GH-19346)
Batuhan Taskaya
2021-01-20
1
-10/+16
*
bpo-42864: Fix compiler warning in the tokenizer with the new paren stack for...
Pablo Galindo
2021-01-20
1
-1/+1
*
bpo-42864: Improve error messages regarding unclosed parentheses (GH-24161)
Pablo Galindo
2021-01-19
1
-1/+4
*
bpo-42827: Fix crash on SyntaxError in multiline expressions (GH-24140)
Lysandros Nikolaou
2021-01-14
1
-0/+21
*
bpo-42519: Replace PyMem_MALLOC() with PyMem_Malloc() (GH-23586)
Victor Stinner
2020-12-01
1
-30/+30
*
bpo-36020: Remove snprintf macro in pyerrors.h (GH-20889)
Victor Stinner
2020-06-15
1
-1/+1
*
bpo-40847: Consider a line with only a LINECONT a blank line (GH-20769)
Lysandros Nikolaou
2020-06-10
1
-1/+2
*
Fix peg_generator compiler warnings under MSVC (GH-20405)
Ammar Askar
2020-05-26
1
-4/+0
*
bpo-40593: Improve syntax errors for invalid characters in source code. (GH-2...
Serhiy Storchaka
2020-05-12
1
-9/+37
*
bpo-40246: Revert reporting of invalid string prefixes (GH-19888)
Lysandros Nikolaou
2020-05-04
1
-4/+0
*
bpo-40335: Correctly handle multi-line strings in tokenize error scenarios (G...
Pablo Galindo
2020-04-21
1
-3/+4
*
bpo-40246: Report a better error message for invalid string prefixes (GH-19476)
Lysandros Nikolaou
2020-04-12
1
-0/+4
*
bpo-39882: Add _Py_FatalErrorFormat() function (GH-19157)
Victor Stinner
2020-03-25
1
-1/+1
*
bpo-39882: Py_FatalError() logs the function name (GH-18819)
Victor Stinner
2020-03-06
1
-3/+5
*
closes bpo-39721: Fix constness of members of tok_state struct. (GH-18600)
Andy Lester
2020-02-28
1
-20/+30
*
bpo-39219: Fix SyntaxError attributes in the tokenizer. (GH-17828)
Serhiy Storchaka
2020-02-12
1
-4/+32
*
bpo-39500: Document PyUnicode_IsIdentifier() function (GH-18397)
Victor Stinner
2020-02-11
1
-1/+2
*
bpo-39209: Manage correctly multi-line tokens in interactive mode (GH-17860)
Pablo Galindo
2020-01-06
1
-0/+2
*
bpo-38673: dont switch to ps2 if the line starts with comment or whitespace (...
Batuhan Taşkaya
2019-12-09
1
-0/+6
*
Indent code inside if block. (GH-15284)
Hansraj Das
2019-08-15
1
-1/+1
*
Fix `SyntaxError` indicator printing too many spaces for multi-line strings (...
Anthony Sottile
2019-07-29
1
-0/+2
*
bpo-36878: Only allow text after `# type: ignore` if first character ASCII (G...
Michael J. Sullivan
2019-05-22
1
-2/+3
*
bpo-36878: Track extra text added to 'type: ignore' in the AST (GH-13479)
Michael J. Sullivan
2019-05-22
1
-2/+6
*
bpo-2180: Treat line continuation at EOF as a `SyntaxError` (GH-13401)
Anthony Sottile
2019-05-18
1
-1/+10
*
bpo-36878: Allow extra text after `# type: ignore` comments (GH-13238)
Michael J. Sullivan
2019-05-11
1
-8/+5
*
bpo-36623: Clean parser headers and include files (GH-12253)
Pablo Galindo
2019-04-13
1
-1/+0
*
bpo-36459: Fix a possible double PyMem_FREE() due to tokenizer.c's tok_nextc(...
Zackery Spytz
2019-03-28
1
-1/+0
*
bpo-36367: Free buffer if realloc fails in tokenize.c (GH-12442)
Pablo Galindo
2019-03-19
1
-2/+8
*
bpo-35975: Support parsing earlier minor versions of Python 3 (GH-12086)
Guido van Rossum
2019-03-07
1
-0/+79
*
bpo-35808: Retire pgen and use pgen2 to generate the parser (GH-11814)
Pablo Galindo
2019-03-01
1
-56/+0
*
bpo-35766: Merge typed_ast back into CPython (GH-11645)
Guido van Rossum
2019-01-31
1
-1/+56
*
bpo-16806: Fix `lineno` and `col_offset` for multi-line string tokens (GH-10021)
Anthony Sottile
2019-01-13
1
-0/+7
*
bpo-30455: Generate all token related code and docs from Grammar/Tokens. (GH-...
Serhiy Storchaka
2018-12-22
1
-237/+0
*
bpo-33306: Improve SyntaxError messages for unbalanced parentheses. (GH-6516)
Serhiy Storchaka
2018-12-17
1
-0/+32
*
bpo-35436: Add missing PyErr_NoMemory() calls and other minor bug fixes. (GH-...
Zackery Spytz
2018-12-07
1
-0/+5
*
Remove unneeded PyUnicode_READY() in tokenizer.c (GH-9114)
Zackery Spytz
2018-09-10
1
-1/+1
*
Fix Windows compiler warning in tokenize.c (GH-8359)
Victor Stinner
2018-07-21
1
-1/+1
*
bpo-33305: Improve SyntaxError for invalid numerical literals. (GH-6517)
Serhiy Storchaka
2018-07-09
1
-13/+52
*
tokenizer: Remove unused tabs options (#4422)
Victor Stinner
2017-11-17
1
-31/+11
*
bpo-30406: Make async and await proper keywords (#1669)
Jelle Zijlstra
2017-10-06
1
-63/+0
*
bpo-25324: add missing comma in Parser/tokenizer.c (GH-1910)
Albert-Jan Nijburg
2017-06-01
1
-1/+1
*
bpo-25324: copy tok_name before changing it (#1608)
Albert-Jan Nijburg
2017-05-31
1
-0/+3
[next]