summaryrefslogtreecommitdiffstats
path: root/Lib/urllib/robotparser.py
Commit message (Expand)AuthorAgeFilesLines
* #17403: urllib.parse.robotparser normalizes the urls before adding to ruleline.Senthil Kumaran2013-05-291-0/+1
* #4108: the first default entry (User-agent: *) wins.Georg Brandl2010-07-291-2/+4
* Fix Issue6325 - robotparse to honor urls with query strings.Senthil Kumaran2010-07-281-2/+4
* Merged revisions 65209-65216,65225-65226,65233,65239,65246-65247,65255-65256 ...Benjamin Peterson2008-07-311-0/+5
* Bug 3347: robotparser failed because it didn't convert bytes to string.Jeremy Hylton2008-07-181-2/+6
* Make a new urllib package .Jeremy Hylton2008-06-181-0/+191