index
:
cpython.git
2.7
3.3
3.4
3.5
3.6
benjamin-clang
benjamin-iteration-torture
buildbot-custom
master
https://github.com/python/cpython.git
summary
refs
log
tree
commit
diff
stats
log msg
author
committer
range
path:
root
/
Parser
/
tokenizer.h
Commit message (
Expand
)
Author
Age
Files
Lines
*
gh-105718: Fix buffer allocation in tokenizer with readline (#105728)
Lysandros Nikolaou
2023-06-13
1
-1/+1
*
gh-105259: Ensure we don't show newline characters for trailing NEWLINE token...
Pablo Galindo Salgado
2023-06-06
1
-0/+1
*
gh-105069: Add a readline-like callable to the tokenizer to consume input ite...
Pablo Galindo Salgado
2023-05-30
1
-0/+2
*
gh-105017: Include CRLF lines in strings and column numbers (#105030)
Marta Gómez Macías
2023-05-28
1
-2/+2
*
Fix typo in the tokenizer (#104950)
Stepfen Shawn
2023-05-26
1
-1/+1
*
gh-102856: Python tokenizer implementation for PEP 701 (#104323)
Marta Gómez Macías
2023-05-21
1
-0/+4
*
gh-104658: Fix location of unclosed quote error for multiline f-strings (#104...
Pablo Galindo Salgado
2023-05-20
1
-0/+1
*
gh-104016: Fixed off by 1 error in f string tokenizer (#104047)
jx124
2023-05-01
1
-3/+4
*
gh-103656: Transfer f-string buffers to parser to avoid use-after-free (GH-10...
Lysandros Nikolaou
2023-04-27
1
-0/+2
*
GH-103718: Correctly cache and restore f-string buffers when needed (GH-103719)
Lysandros Nikolaou
2023-04-23
1
-0/+3
*
gh-102856: Clean some of the PEP 701 tokenizer implementation (#103634)
Pablo Galindo Salgado
2023-04-19
1
-3/+2
*
gh-102856: Initial implementation of PEP 701 (#102855)
Pablo Galindo Salgado
2023-04-19
1
-0/+29
*
gh-99891: Fix infinite recursion in the tokenizer when showing warnings (GH-9...
Pablo Galindo Salgado
2022-11-30
1
-0/+1
*
gh-97997: Add col_offset field to tokenizer and use that for AST nodes (#98000)
Lysandros Nikolaou
2022-10-07
1
-0/+2
*
gh-97973: Return all necessary information from the tokenizer (GH-97984)
Lysandros Nikolaou
2022-10-06
1
-1/+7
*
gh-93103: Parser uses PyConfig.parser_debug instead of Py_DebugFlag (#93106)
Victor Stinner
2022-05-24
1
-0/+3
*
gh-92651: Remove the Include/token.h header file (#92652)
Victor Stinner
2022-05-11
1
-1/+1
*
Ensure the str member of the tokenizer is always initialised (GH-29681)
Pablo Galindo Salgado
2021-11-21
1
-1/+1
*
bpo-45434: Mark the PyTokenizer C API as private (GH-28924)
Victor Stinner
2021-10-13
1
-5/+5
*
Fix typos in the Objects directory (GH-28766)
Christian Clauss
2021-10-06
1
-1/+1
*
bpo-44854: Remove trailing whitespaces (GH-27689)
Serhiy Storchaka
2021-08-09
1
-1/+1
*
bpo-44201: Avoid side effects of "invalid_*" rules in the REPL (GH-26298)
Pablo Galindo
2021-05-22
1
-0/+10
*
bpo-25643: Refactor the C tokenizer into smaller, logical units (GH-25050)
Pablo Galindo
2021-03-28
1
-3/+2
*
bpo-43410: Fix crash in the parser when producing syntax errors when reading ...
Pablo Galindo
2021-03-14
1
-1/+3
*
bpo-42864: Improve error messages regarding unclosed parentheses (GH-24161)
Pablo Galindo
2021-01-19
1
-0/+1
*
bpo-42827: Fix crash on SyntaxError in multiline expressions (GH-24140)
Lysandros Nikolaou
2021-01-14
1
-0/+1
*
closes bpo-39721: Fix constness of members of tok_state struct. (GH-18600)
Andy Lester
2020-02-28
1
-5/+5
*
bpo-36623: Clean parser headers and include files (GH-12253)
Pablo Galindo
2019-04-13
1
-0/+2
*
bpo-35975: Support parsing earlier minor versions of Python 3 (GH-12086)
Guido van Rossum
2019-03-07
1
-0/+7
*
bpo-35808: Retire pgen and use pgen2 to generate the parser (GH-11814)
Pablo Galindo
2019-03-01
1
-8/+0
*
bpo-35766: Merge typed_ast back into CPython (GH-11645)
Guido van Rossum
2019-01-31
1
-0/+2
*
bpo-16806: Fix `lineno` and `col_offset` for multi-line string tokens (GH-10021)
Anthony Sottile
2019-01-13
1
-0/+5
*
bpo-33306: Improve SyntaxError messages for unbalanced parentheses. (GH-6516)
Serhiy Storchaka
2018-12-17
1
-1/+4
*
tokenizer: Remove unused tabs options (#4422)
Victor Stinner
2017-11-17
1
-3/+0
*
bpo-30406: Make async and await proper keywords (#1669)
Jelle Zijlstra
2017-10-06
1
-7/+0
*
Remove obsolete declaration in tokenizer.h (#962)
Jim Fasarakis-Hilliard
2017-04-03
1
-2/+0
*
Issue #24619: Simplify async/await tokenization.
Yury Selivanov
2015-07-23
1
-15/+6
*
Issue #24619: New approach for tokenizing async/await.
Yury Selivanov
2015-07-22
1
-6/+15
*
PEP 0492 -- Coroutines with async and await syntax. Issue #24017.
Yury Selivanov
2015-05-12
1
-0/+7
*
Issue #1772673: The type of `char*` arguments now changed to `const char*`.
Serhiy Storchaka
2013-10-19
1
-3/+3
*
Issue #9319: Include the filename in "Non-UTF8 code ..." syntax error.
Victor Stinner
2011-04-04
1
-1/+0
*
Issue #10785: Store the filename as Unicode in the Python parser.
Victor Stinner
2011-04-04
1
-1/+7
*
#10222: fix for overzealous AIX compiler.
Georg Brandl
2010-10-29
1
-1/+1
*
Issue #9713, #10114: Parser functions (eg. PyParser_ASTFromFile) expects
Victor Stinner
2010-10-16
1
-1/+1
*
Issue #10095: fp_setreadl() doesn't reopen the file, reuse instead the file
Victor Stinner
2010-10-14
1
-1/+1
*
Recorded merge of revisions 81029 via svnmerge from
Antoine Pitrou
2010-05-09
1
-45/+45
*
Merged revisions 76230 via svnmerge from
Benjamin Peterson
2009-11-13
1
-2/+3
*
ignore the coding cookie in compile(), exec(), and eval() if the source is a ...
Benjamin Peterson
2009-03-02
1
-0/+1
*
Latin-1 source code was not being properly decoded when passed through
Brett Cannon
2008-10-17
1
-2/+2
*
Issue 1267, continued.
Guido van Rossum
2007-10-22
1
-1/+1
[next]