diff options
| author | Lysandros Nikolaou <lisandrosnik@gmail.com> | 2022-10-06 23:07:17 (GMT) |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2022-10-06 23:07:17 (GMT) |
| commit | cbf0afd8a1474d68310331af9218606959d4cc22 (patch) | |
| tree | cd421653d73d25c89fa8c02e5819517efa76f7b3 /Misc | |
| parent | b9d2e8171696514e9226164005f7bf24bf69e66d (diff) | |
| download | cpython-cbf0afd8a1474d68310331af9218606959d4cc22.zip cpython-cbf0afd8a1474d68310331af9218606959d4cc22.tar.gz cpython-cbf0afd8a1474d68310331af9218606959d4cc22.tar.bz2 | |
gh-97973: Return all necessary information from the tokenizer (GH-97984)
Right now, the tokenizer only returns type and two pointers to the start and end of the token.
This PR modifies the tokenizer to return the type and set all of the necessary information,
so that the parser does not have to this.
Diffstat (limited to 'Misc')
| -rw-r--r-- | Misc/NEWS.d/next/Core and Builtins/2022-10-06-20-41-29.gh-issue-97973.gB-xWi.rst | 1 |
1 files changed, 1 insertions, 0 deletions
diff --git a/Misc/NEWS.d/next/Core and Builtins/2022-10-06-20-41-29.gh-issue-97973.gB-xWi.rst b/Misc/NEWS.d/next/Core and Builtins/2022-10-06-20-41-29.gh-issue-97973.gB-xWi.rst new file mode 100644 index 0000000..a0095a6 --- /dev/null +++ b/Misc/NEWS.d/next/Core and Builtins/2022-10-06-20-41-29.gh-issue-97973.gB-xWi.rst @@ -0,0 +1 @@ +Modify the tokenizer to return all necessary information the parser needs to set location information in the AST nodes, so that the parser does not have to calculate those doing pointer arithmetic. |