Commit message (Expand) | Author | Age | Files | Lines | ||
---|---|---|---|---|---|---|
... | ||||||
* | Added -x option to check external links. Slooooow! | Guido van Rossum | 1997-01-30 | 1 | -10/+32 | |
* | Catch I/O errors when parsing robots.txt file. | Guido van Rossum | 1997-01-30 | 1 | -5/+13 | |
* | Basic README file | Guido van Rossum | 1997-01-30 | 1 | -0/+14 | |
* | Added robots.txt support, using Skip Montanaro's parser. | Guido van Rossum | 1997-01-30 | 1 | -3/+38 | |
* | Skip Montanaro's robots.txt parser. | Guido van Rossum | 1997-01-30 | 1 | -0/+97 | |
* | web tree checker | Guido van Rossum | 1997-01-30 | 1 | -0/+488 | |
* | mime types guesser | Guido van Rossum | 1997-01-30 | 1 | -0/+190 | |