diff options
Diffstat (limited to 'Doc/library/re.rst')
| -rw-r--r-- | Doc/library/re.rst | 9 |
1 files changed, 6 insertions, 3 deletions
diff --git a/Doc/library/re.rst b/Doc/library/re.rst index 6df3106..e10c794 100644 --- a/Doc/library/re.rst +++ b/Doc/library/re.rst @@ -1331,12 +1331,15 @@ successive matches:: if pos != len(s): raise RuntimeError('Unexpected character %r on line %d' %(s[pos], line)) - >>> statements = '''\ + statements = '''\ total := total + price * quantity; tax := price * 0.05; ''' - >>> for token in tokenize(statements): - print(token) + + for token in tokenize(statements): + print(token) + +The tokenizer produces the following output:: Token(typ='ID', value='total', line=1, column=8) Token(typ='ASSIGN', value=':=', line=1, column=14) |