Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | Moved robotparser.py to the Lib directory. | Guido van Rossum | 2000-03-29 | 1 | -97/+0 |
| | | | | If you do a "cvs update" in the Lib directory, it will pop up there. | ||||
* | Skip Montanaro: | Guido van Rossum | 2000-03-27 | 1 | -17/+17 |
| | | | | | | | | | | | | The robotparser.py module currently lives in Tools/webchecker. In preparation for its migration to Lib, I made the following changes: * renamed the test() function _test * corrected the URLs in _test() so they refer to actual documents * added an "if __name__ == '__main__'" catcher to invoke _test() when run as a main program * added doc strings for the two main methods, parse and can_fetch * replaced usage of regsub and regex with corresponding re code | ||||
* | Give in to tabnanny | Guido van Rossum | 1998-04-06 | 1 | -60/+60 |
| | |||||
* | Skip Montanaro's robots.txt parser. | Guido van Rossum | 1997-01-30 | 1 | -0/+97 |