summaryrefslogtreecommitdiffstats
path: root/Doc/library/tokenize.rst
diff options
context:
space:
mode:
authorMariatta <Mariatta@users.noreply.github.com>2017-09-13 04:00:00 (GMT)
committerGitHub <noreply@github.com>2017-09-13 04:00:00 (GMT)
commitea0f7c26cef4550bf4db1a9bae17d41b79ab7c0d (patch)
tree99631ed6b6663b67dc9d680a7fd0c6d06be8bdc0 /Doc/library/tokenize.rst
parent5f8fbf917ebf2398aa75a1f271617e2e50ab7c88 (diff)
downloadcpython-ea0f7c26cef4550bf4db1a9bae17d41b79ab7c0d.zip
cpython-ea0f7c26cef4550bf4db1a9bae17d41b79ab7c0d.tar.gz
cpython-ea0f7c26cef4550bf4db1a9bae17d41b79ab7c0d.tar.bz2
bpo-31394: Make tokenize.rst PEP 8-compliant (GH-3526)
The last commit contained lines longer than 80 characters.
Diffstat (limited to 'Doc/library/tokenize.rst')
-rw-r--r--Doc/library/tokenize.rst5
1 files changed, 3 insertions, 2 deletions
diff --git a/Doc/library/tokenize.rst b/Doc/library/tokenize.rst
index e6ddc05..02a0428 100644
--- a/Doc/library/tokenize.rst
+++ b/Doc/library/tokenize.rst
@@ -16,8 +16,9 @@ implemented in Python. The scanner in this module returns comments as tokens
as well, making it useful for implementing "pretty-printers," including
colorizers for on-screen displays.
-To simplify token stream handling, all :ref:`operator <operators>` and :ref:`delimiter <delimiters>`
-tokens and :data:`Ellipsis` are returned using the generic :data:`~token.OP` token type. The exact
+To simplify token stream handling, all :ref:`operator <operators>` and
+:ref:`delimiter <delimiters>` tokens and :data:`Ellipsis` are returned using
+the generic :data:`~token.OP` token type. The exact
type can be determined by checking the ``exact_type`` property on the
:term:`named tuple` returned from :func:`tokenize.tokenize`.