summaryrefslogtreecommitdiffstats
path: root/Tools/webchecker/robotparser.py
Commit message (Expand)AuthorAgeFilesLines
* Give in to tabnannyGuido van Rossum1998-04-061-60/+60
* Skip Montanaro's robots.txt parser.Guido van Rossum1997-01-301-0/+97