summaryrefslogtreecommitdiffstats
path: root/Misc
diff options
context:
space:
mode:
authorAmmar Askar <ammar_askar@hotmail.com>2018-07-06 07:19:08 (GMT)
committerTal Einat <taleinat+github@gmail.com>2018-07-06 07:19:08 (GMT)
commitc4ef4896eac86a6759901c8546e26de4695a1389 (patch)
tree47ad8191fbe9f8fe4bb4272509410bc229ec7c6e /Misc
parent3c8aae9ffe13d0f2ad4ff81cdf56bc6393af362a (diff)
downloadcpython-c4ef4896eac86a6759901c8546e26de4695a1389.zip
cpython-c4ef4896eac86a6759901c8546e26de4695a1389.tar.gz
cpython-c4ef4896eac86a6759901c8546e26de4695a1389.tar.bz2
bpo-33899: Make tokenize module mirror end-of-file is end-of-line behavior (GH-7891)
Most of the change involves fixing up the test suite, which previously made the assumption that there wouldn't be a new line if the input didn't end in one. Contributed by Ammar Askar.
Diffstat (limited to 'Misc')
-rw-r--r--Misc/NEWS.d/next/Library/2018-06-24-01-57-14.bpo-33899.IaOcAr.rst3
1 files changed, 3 insertions, 0 deletions
diff --git a/Misc/NEWS.d/next/Library/2018-06-24-01-57-14.bpo-33899.IaOcAr.rst b/Misc/NEWS.d/next/Library/2018-06-24-01-57-14.bpo-33899.IaOcAr.rst
new file mode 100644
index 0000000..21c9095
--- /dev/null
+++ b/Misc/NEWS.d/next/Library/2018-06-24-01-57-14.bpo-33899.IaOcAr.rst
@@ -0,0 +1,3 @@
+Tokenize module now implicitly emits a NEWLINE when provided with input that
+does not have a trailing new line. This behavior now matches what the C
+tokenizer does internally. Contributed by Ammar Askar.