Commit message (Expand) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | #17403: urllib.parse.robotparser normalizes the urls before adding to ruleline. | Senthil Kumaran | 2013-05-29 | 1 | -0/+1 |
* | #4108: the first default entry (User-agent: *) wins. | Georg Brandl | 2010-07-29 | 1 | -2/+4 |
* | Fix Issue6325 - robotparse to honor urls with query strings. | Senthil Kumaran | 2010-07-28 | 1 | -2/+4 |
* | Merged revisions 65209-65216,65225-65226,65233,65239,65246-65247,65255-65256 ... | Benjamin Peterson | 2008-07-31 | 1 | -0/+5 |
* | Bug 3347: robotparser failed because it didn't convert bytes to string. | Jeremy Hylton | 2008-07-18 | 1 | -2/+6 |
* | Make a new urllib package . | Jeremy Hylton | 2008-06-18 | 1 | -0/+191 |