diff options
Diffstat (limited to 'Doc')
| -rw-r--r-- | Doc/library/tokenize.rst | 3 |
1 files changed, 2 insertions, 1 deletions
diff --git a/Doc/library/tokenize.rst b/Doc/library/tokenize.rst index 7017045..ac6ae36 100644 --- a/Doc/library/tokenize.rst +++ b/Doc/library/tokenize.rst @@ -95,7 +95,8 @@ function it uses to do this is available: It detects the encoding from the presence of a UTF-8 BOM or an encoding cookie as specified in :pep:`263`. If both a BOM and a cookie are present, - but disagree, a SyntaxError will be raised. + but disagree, a SyntaxError will be raised. Note that if the BOM is found, + ``'utf-8-sig'`` will be returned as an encoding. If no encoding is specified, then the default of ``'utf-8'`` will be returned. |