| Commit message (Expand) | Author | Age | Files | Lines |
|---|
| * | bpo-21475: Support the Sitemap extension in robotparser (GH-6883) | Christopher Beacham | 2018-05-16 | 1 | -0/+12 |
|
|
| * | bpo-32861: urllib.robotparser fix incomplete __str__ methods. (GH-5711) | Michael Lazar | 2018-05-14 | 1 | -5/+12 |
|
|
| * | bpo-31325: Fix usage of namedtuple in RobotFileParser.parse() (#4529) | Berker Peksag | 2017-11-23 | 1 | -5/+4 |
|
|
| * | Issue #25400: RobotFileParser now correctly returns default values for crawl_... | Berker Peksag | 2016-09-18 | 1 | -2/+6 |
|
|
| * | Merge typo fixes from 3.5 | Martin Panter | 2016-05-08 | 1 | -1/+1 |
| |\ |
|
| | * | Fix typos in comments, documentation and test method names | Martin Panter | 2016-05-08 | 1 | -1/+1 |
|
|
| * | | Issue #16099: RobotFileParser now supports Crawl-delay and Request-rate | Berker Peksag | 2015-10-08 | 1 | -2/+37 |
| |/ |
|
| * | Issue 21469: Minor code modernization (convert and/or expression to an if/el... | Raymond Hettinger | 2014-05-13 | 1 | -1/+1 |
|
|
| * | Issue 21469: Mitigate risk of false positives with robotparser. | Raymond Hettinger | 2014-05-13 | 1 | -2/+9 |
|
|
| * | #17403: urllib.parse.robotparser normalizes the urls before adding to ruleline. | Senthil Kumaran | 2013-05-29 | 1 | -0/+1 |
|
|
| * | #4108: the first default entry (User-agent: *) wins. | Georg Brandl | 2010-07-29 | 1 | -2/+4 |
|
|
| * | Fix Issue6325 - robotparse to honor urls with query strings. | Senthil Kumaran | 2010-07-28 | 1 | -2/+4 |
|
|
| * | Merged revisions 65209-65216,65225-65226,65233,65239,65246-65247,65255-65256 ... | Benjamin Peterson | 2008-07-31 | 1 | -0/+5 |
|
|
| * | Bug 3347: robotparser failed because it didn't convert bytes to string. | Jeremy Hylton | 2008-07-18 | 1 | -2/+6 |
|
|
| * | Make a new urllib package . | Jeremy Hylton | 2008-06-18 | 1 | -0/+191 |
|
|
