summaryrefslogtreecommitdiffstats
path: root/Doc/library
diff options
context:
space:
mode:
authorAivar Annamaa <aivarannamaa@users.noreply.github.com>2017-09-13 03:24:03 (GMT)
committerMariatta <Mariatta@users.noreply.github.com>2017-09-13 03:24:03 (GMT)
commit5f8fbf917ebf2398aa75a1f271617e2e50ab7c88 (patch)
tree8032d572d683f82be85111f93e5b38b6bb583b33 /Doc/library
parent3bcf157c115ba3e48bce62ac8cb13c703475a113 (diff)
downloadcpython-5f8fbf917ebf2398aa75a1f271617e2e50ab7c88.zip
cpython-5f8fbf917ebf2398aa75a1f271617e2e50ab7c88.tar.gz
cpython-5f8fbf917ebf2398aa75a1f271617e2e50ab7c88.tar.bz2
bpo-31394: Clarify documentation about token type attribute (GH-3469)
Make it clear that Ellipsis tokens also have type attribute set to token.OP.
Diffstat (limited to 'Doc/library')
-rw-r--r--Doc/library/tokenize.rst4
1 files changed, 2 insertions, 2 deletions
diff --git a/Doc/library/tokenize.rst b/Doc/library/tokenize.rst
index cd27a10..e6ddc05 100644
--- a/Doc/library/tokenize.rst
+++ b/Doc/library/tokenize.rst
@@ -16,8 +16,8 @@ implemented in Python. The scanner in this module returns comments as tokens
as well, making it useful for implementing "pretty-printers," including
colorizers for on-screen displays.
-To simplify token stream handling, all :ref:`operators` and :ref:`delimiters`
-tokens are returned using the generic :data:`~token.OP` token type. The exact
+To simplify token stream handling, all :ref:`operator <operators>` and :ref:`delimiter <delimiters>`
+tokens and :data:`Ellipsis` are returned using the generic :data:`~token.OP` token type. The exact
type can be determined by checking the ``exact_type`` property on the
:term:`named tuple` returned from :func:`tokenize.tokenize`.