| Commit message (Expand) | Author | Age | Files | Lines |
|---|
| * | bpo-35922: Fix RobotFileParser when robots.txt has no relevant crawl delay or... | Miss Islington (bot) | 2019-06-16 | 1 | -12/+16 |
|
|
| * | bpo-21475: Support the Sitemap extension in robotparser (GH-6883) | Christopher Beacham | 2018-05-16 | 1 | -0/+21 |
|
|
| * | bpo-32861: urllib.robotparser fix incomplete __str__ methods. (GH-5711) | Michael Lazar | 2018-05-14 | 1 | -0/+26 |
|
|
| * | bpo-31325: Fix usage of namedtuple in RobotFileParser.parse() (#4529) | Berker Peksag | 2017-11-23 | 1 | -3/+6 |
|
|
| * | bpo-31370: Remove support for threads-less builds (#3385) | Antoine Pitrou | 2017-09-07 | 1 | -5/+1 |
|
|
| * | Issue #25400: RobotFileParser now correctly returns default values for crawl_... | Berker Peksag | 2016-09-18 | 1 | -18/+36 |
|
|
| * | Issue #28151: Use pythontest.net in test_robotparser | Berker Peksag | 2016-09-18 | 1 | -7/+36 |
|
|
| * | Use HTTP in testPythonOrg | Berker Peksag | 2016-09-11 | 1 | -1/+1 |
|
|
| * | Unskip testPythonOrg in test_robotparser | Berker Peksag | 2016-09-11 | 1 | -2/+1 |
|
|
| * | Wrap testPasswordProtectedSite with @reap_threads | Berker Peksag | 2016-09-11 | 1 | -0/+1 |
|
|
| * | Issue #25497: Rewrite test_robotparser to use a class based design | Berker Peksag | 2016-09-11 | 1 | -220/+139 |
|
|
| * | Issue #23277: Remove unused imports in tests. | Serhiy Storchaka | 2016-04-24 | 1 | -2/+0 |
|
|
| * | Issue #16099: RobotFileParser now supports Crawl-delay and Request-rate | Berker Peksag | 2015-10-08 | 1 | -21/+69 |
|
|
| * | Issue #20753: Skip PasswordProtectedSiteTestCase when Python is built without... | Berker Peksag | 2014-06-29 | 1 | -1/+5 |
|
|
| * | issue20753 - robotparser tests should not rely upon external resource when no... | Senthil Kumaran | 2014-06-25 | 1 | -25/+47 |
|
|
| * | Issue #18492: Allow all resources when tests are not run by regrtest.py. | Zachary Ware | 2014-06-02 | 1 | -1/+0 |
|
|
| * | #20719: Disable the robotparser python.org test until the gzip encoding issue... | Georg Brandl | 2014-02-23 | 1 | -0/+1 |
|
|
| * | #17403: urllib.parse.robotparser normalizes the urls before adding to ruleline. | Senthil Kumaran | 2013-05-29 | 1 | -0/+12 |
|
|
| * | #17066: test_robotparser now works with unittest test discovery. Patch by Za... | Ezio Melotti | 2013-03-12 | 1 | -6/+10 |
|
|
| * | Avoid failing in test_robotparser when mueblesmoraleda.com is flaky and | Antoine Pitrou | 2011-07-08 | 1 | -2/+17 |
|
|
| * | Improve transient_internet() again to detect more network errors, | Antoine Pitrou | 2010-09-07 | 1 | -14/+15 |
|
|
| * | #4108: the first default entry (User-agent: *) wins. | Georg Brandl | 2010-07-29 | 1 | -0/+14 |
|
|
| * | Fix Issue6325 - robotparse to honor urls with query strings. | Senthil Kumaran | 2010-07-28 | 1 | -0/+11 |
|
|
| * | (partially) | Florent Xicluna | 2010-04-02 | 1 | -7/+5 |
|
|
| * | Furniture is not very reliable these days (buildbot failures). | Antoine Pitrou | 2010-04-02 | 1 | -2/+6 |
|
|
| * | convert old fail* assertions to assert* | Benjamin Peterson | 2009-06-30 | 1 | -2/+2 |
|
|
| * | Merged revisions 65209-65216,65225-65226,65233,65239,65246-65247,65255-65256 ... | Benjamin Peterson | 2008-07-31 | 1 | -0/+69 |
|
|
| * | Merged revisions 65012,65035,65037-65040,65048,65057,65077,65091-65095,65097-... | Georg Brandl | 2008-07-23 | 1 | -3/+5 |
|
|
| * | Bug 3347: robotparser failed because it didn't convert bytes to string. | Jeremy Hylton | 2008-07-18 | 1 | -3/+12 |
|
|
| * | Make a new urllib package . | Jeremy Hylton | 2008-06-18 | 1 | -3/+4 |
|
|
| * | #2621 rename test.test_support to test.support | Benjamin Peterson | 2008-05-20 | 1 | -4/+4 |
|
|
| * | Merged revisions 57620-57771 via svnmerge from | Thomas Wouters | 2007-08-30 | 1 | -0/+11 |
|
|
| * | SF patch# 1770008 by Christian Heimes (plus some extras). | Guido van Rossum | 2007-08-09 | 1 | -2/+3 |
|
|
| * | Merged revisions 53952-54987 via svnmerge from | Guido van Rossum | 2007-04-27 | 1 | -2/+2 |
|
|
| * | Get rid of relative imports in all unittests. Now anything that | Barry Warsaw | 2002-07-23 | 1 | -1/+2 |
|
|
| * | Whitespace normalization. | Tim Peters | 2002-04-16 | 1 | -9/+9 |
|
|
| * | Correct various errors: | Martin v. Löwis | 2002-02-28 | 1 | -0/+141 |
|
|
