diff options
| author | Terry Jan Reedy <tjreedy@udel.edu> | 2016-06-11 19:02:54 (GMT) |
|---|---|---|
| committer | Terry Jan Reedy <tjreedy@udel.edu> | 2016-06-11 19:02:54 (GMT) |
| commit | fa089b9b0b926c04e5d57812b7d7653472787965 (patch) | |
| tree | 8dc5960aa04533868f942b0e325df1048ef05999 /Doc/library/urllib.robotparser.rst | |
| parent | c92bf83a829956e683a3d6bb1ae65aed74d7b92a (diff) | |
| download | cpython-fa089b9b0b926c04e5d57812b7d7653472787965.zip cpython-fa089b9b0b926c04e5d57812b7d7653472787965.tar.gz cpython-fa089b9b0b926c04e5d57812b7d7653472787965.tar.bz2 | |
Issue #22558: Add remaining doc links to source code for Python-coded modules.
Reformat header above separator line (added if missing) to a common format.
Patch by Yoni Lavi.
Diffstat (limited to 'Doc/library/urllib.robotparser.rst')
| -rw-r--r-- | Doc/library/urllib.robotparser.rst | 4 |
1 files changed, 4 insertions, 0 deletions
diff --git a/Doc/library/urllib.robotparser.rst b/Doc/library/urllib.robotparser.rst index f179de2..ba701c3 100644 --- a/Doc/library/urllib.robotparser.rst +++ b/Doc/library/urllib.robotparser.rst @@ -4,8 +4,10 @@ .. module:: urllib.robotparser :synopsis: Load a robots.txt file and answer questions about fetchability of other URLs. + .. sectionauthor:: Skip Montanaro <skip@pobox.com> +**Source code:** :source:`Lib/urllib/robotparser.py` .. index:: single: WWW @@ -13,6 +15,8 @@ single: URL single: robots.txt +-------------- + This module provides a single class, :class:`RobotFileParser`, which answers questions about whether or not a particular user agent can fetch a URL on the Web site that published the :file:`robots.txt` file. For more details on the |