diff options
| author | Lysandros Nikolaou <lisandrosnik@gmail.com> | 2025-04-30 09:46:41 (GMT) |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2025-04-30 09:46:41 (GMT) |
| commit | 60202609a2c2d0971aadfa4729ba30b50e89c6ea (patch) | |
| tree | d821f3f8f277de56e5d8da457d492f1288cb2bb9 /Lib/token.py | |
| parent | 5ea9010e8910cb97555c3aef4ed95cca93a74aab (diff) | |
| download | cpython-60202609a2c2d0971aadfa4729ba30b50e89c6ea.zip cpython-60202609a2c2d0971aadfa4729ba30b50e89c6ea.tar.gz cpython-60202609a2c2d0971aadfa4729ba30b50e89c6ea.tar.bz2 | |
gh-132661: Implement PEP 750 (#132662)
Co-authored-by: Lysandros Nikolaou <lisandrosnik@gmail.com>
Co-authored-by: Bénédikt Tran <10796600+picnixz@users.noreply.github.com>
Co-authored-by: Adam Turner <9087854+AA-Turner@users.noreply.github.com>
Co-authored-by: Hugo van Kemenade <1324225+hugovk@users.noreply.github.com>
Co-authored-by: Wingy <git@wingysam.xyz>
Co-authored-by: Koudai Aono <koxudaxi@gmail.com>
Co-authored-by: Dave Peck <davepeck@gmail.com>
Co-authored-by: Terry Jan Reedy <tjreedy@udel.edu>
Co-authored-by: Paul Everitt <pauleveritt@me.com>
Co-authored-by: sobolevn <mail@sobolevn.me>
Diffstat (limited to 'Lib/token.py')
| -rw-r--r-- | Lib/token.py | 13 |
1 files changed, 8 insertions, 5 deletions
diff --git a/Lib/token.py b/Lib/token.py index 54d7cdc..a1fde61 100644 --- a/Lib/token.py +++ b/Lib/token.py @@ -66,12 +66,15 @@ SOFT_KEYWORD = 58 FSTRING_START = 59 FSTRING_MIDDLE = 60 FSTRING_END = 61 -COMMENT = 62 -NL = 63 +TSTRING_START = 62 +TSTRING_MIDDLE = 63 +TSTRING_END = 64 +COMMENT = 65 +NL = 66 # These aren't used by the C tokenizer but are needed for tokenize.py -ERRORTOKEN = 64 -ENCODING = 65 -N_TOKENS = 66 +ERRORTOKEN = 67 +ENCODING = 68 +N_TOKENS = 69 # Special definitions for cooperation with parser NT_OFFSET = 256 |