cpython.git - https://github.com/python/cpython.git

	Commit message (Expand)	Author	Age	Files	Lines
*	bpo-35922: Fix RobotFileParser when robots.txt has no relevant crawl delay or...	Rémi Lapeyre	2019-06-16	1	-2/+6

*	bpo-21475: Support the Sitemap extension in robotparser (GH-6883)	Christopher Beacham	2018-05-16	1	-0/+12

*	bpo-32861: urllib.robotparser fix incomplete __str__ methods. (GH-5711)	Michael Lazar	2018-05-14	1	-5/+12

*	bpo-31325: Fix usage of namedtuple in RobotFileParser.parse() (#4529)	Berker Peksag	2017-11-23	1	-5/+4

*	Issue #25400: RobotFileParser now correctly returns default values for crawl_...	Berker Peksag	2016-09-18	1	-2/+6

*	Merge typo fixes from 3.5	Martin Panter	2016-05-08	1	-1/+1
\|\
\| *	Fix typos in comments, documentation and test method names	Martin Panter	2016-05-08	1	-1/+1

* \|	Issue #16099: RobotFileParser now supports Crawl-delay and Request-rate	Berker Peksag	2015-10-08	1	-2/+37
\|/
*	Issue 21469: Minor code modernization (convert and/or expression to an if/el...	Raymond Hettinger	2014-05-13	1	-1/+1

*	Issue 21469: Mitigate risk of false positives with robotparser.	Raymond Hettinger	2014-05-13	1	-2/+9

*	#17403: urllib.parse.robotparser normalizes the urls before adding to ruleline.	Senthil Kumaran	2013-05-29	1	-0/+1

*	#4108: the first default entry (User-agent: *) wins.	Georg Brandl	2010-07-29	1	-2/+4

*	Fix Issue6325 - robotparse to honor urls with query strings.	Senthil Kumaran	2010-07-28	1	-2/+4

*	Merged revisions 65209-65216,65225-65226,65233,65239,65246-65247,65255-65256 ...	Benjamin Peterson	2008-07-31	1	-0/+5

*	Bug 3347: robotparser failed because it didn't convert bytes to string.	Jeremy Hylton	2008-07-18	1	-2/+6

*	Make a new urllib package .	Jeremy Hylton	2008-06-18	1	-0/+191