diff options
| author | Rémi Lapeyre <remi.lapeyre@henki.fr> | 2019-06-16 06:48:57 (GMT) |
|---|---|---|
| committer | Tal Einat <taleinat@gmail.com> | 2019-06-16 06:48:57 (GMT) |
| commit | 8047e0e1c620f69cc21f9ca48b24bf2cdd5c3668 (patch) | |
| tree | 7b22a0fce0ff2d1170bfbbc41f929bcc8d68fc9f /Misc | |
| parent | 3a1d50e7e573efb577714146bed5c03b9c95f466 (diff) | |
| download | cpython-8047e0e1c620f69cc21f9ca48b24bf2cdd5c3668.zip cpython-8047e0e1c620f69cc21f9ca48b24bf2cdd5c3668.tar.gz cpython-8047e0e1c620f69cc21f9ca48b24bf2cdd5c3668.tar.bz2 | |
bpo-35922: Fix RobotFileParser when robots.txt has no relevant crawl delay or request rate (GH-11791)
Co-Authored-By: Tal Einat <taleinat+github@gmail.com>
Diffstat (limited to 'Misc')
| -rw-r--r-- | Misc/NEWS.d/next/Library/2019-06-11-19-34-29.bpo-35922.rxpzWr.rst | 4 |
1 files changed, 4 insertions, 0 deletions
diff --git a/Misc/NEWS.d/next/Library/2019-06-11-19-34-29.bpo-35922.rxpzWr.rst b/Misc/NEWS.d/next/Library/2019-06-11-19-34-29.bpo-35922.rxpzWr.rst new file mode 100644 index 0000000..5271a49 --- /dev/null +++ b/Misc/NEWS.d/next/Library/2019-06-11-19-34-29.bpo-35922.rxpzWr.rst @@ -0,0 +1,4 @@ +Fix :meth:`RobotFileParser.crawl_delay` and +:meth:`RobotFileParser.request_rate` to return ``None`` rather than +raise :exc:`AttributeError` when no relevant rule is defined in the +robots.txt file. Patch by Rémi Lapeyre. |