summaryrefslogtreecommitdiffstats
path: root/Lib/urllib
Commit message (Collapse)AuthorAgeFilesLines
* Issue #12319: Support for chunked encoding of HTTP request bodiesMartin Panter2016-08-241-23/+19
| | | | | | | | | | | | | | | When the body object is a file, its size is no longer determined with fstat(), since that can report the wrong result (e.g. reading from a pipe). Instead, determine the size using seek(), or fall back to chunked encoding for unseekable files. Also, change the logic for detecting text files to check for TextIOBase inheritance, rather than inspecting the “mode” attribute, which may not exist (e.g. BytesIO and StringIO). The Content-Length for text files is no longer determined ahead of time, because the original logic could have been wrong depending on the codec and newline translation settings. Patch by Demian Brecht and Rolf Krahl, with a few tweaks by me.
* [merge from 3.5] - Prevent HTTPoxy attack (CVE-2016-1000110)Senthil Kumaran2016-07-311-0/+6
|\ | | | | | | | | | | | | Ignore the HTTP_PROXY variable when REQUEST_METHOD environment is set, which indicates that the script is in CGI mode. Issue #27568 Reported and patch contributed by Rémi Rampin.
| * [merge from 3.4] - Prevent HTTPoxy attack (CVE-2016-1000110)Senthil Kumaran2016-07-311-0/+6
| |\ | | | | | | | | | | | | | | | | | | Ignore the HTTP_PROXY variable when REQUEST_METHOD environment is set, which indicates that the script is in CGI mode. Issue #27568 Reported and patch contributed by Rémi Rampin.
| | * [merge from 3.3] Prevent HTTPoxy attack (CVE-2016-1000110)Senthil Kumaran2016-07-311-0/+7
| | |\ | | | | | | | | | | | | | | | | | | | | | | | | Ignore the HTTP_PROXY variable when REQUEST_METHOD environment is set, which indicates that the script is in CGI mode. Issue #27568 Reported and patch contributed by Rémi Rampin.
| | | * Prevent HTTPoxy attack (CVE-2016-1000110)Senthil Kumaran2016-07-311-0/+7
| | | | | | | | | | | | | | | | | | | | | | | | | | | | Ignore the HTTP_PROXY variable when REQUEST_METHOD environment is set, which indicates that the script is in CGI mode. Issue #27568 Reported and patch contributed by Rémi Rampin.
* | | | Issue #22797: Synchronize urlopen() doc string with RST documentationMartin Panter2016-06-041-6/+11
| | | |
* | | | More typo fixes for 3.6Martin Panter2016-06-041-1/+1
| | | |
* | | | Clean up urlopen doc string.R David Murray2016-06-041-6/+6
| | | | | | | | | | | | | | | | | | | | | | | | Clarifies what is returned when and that the methods are common between the two. Patch by Alexander Liu as part of #22797.
* | | | Issue #14132, Issue #17214: Merge two redirect handling fixes from 3.5Martin Panter2016-05-161-2/+12
|\ \ \ \ | |/ / /
| * | | Issue #17214: Percent-encode non-ASCII bytes in redirect targetsMartin Panter2016-05-161-1/+11
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Some servers send Location header fields with non-ASCII bytes, but "http. client" requires the request target to be ASCII-encodable, otherwise a UnicodeEncodeError is raised. Based on patch by Christian Heimes. Python 2 does not suffer any problem because it allows non-ASCII bytes in the HTTP request target.
| * | | Issue #14132: Fix redirect handling when target is just a query stringMartin Panter2016-05-161-1/+1
| | | |
* | | | merge from 3.5Senthil Kumaran2016-05-131-0/+1
|\ \ \ \ | |/ / / | | | | | | | | | | | | | | | | Issue #26892: Honor debuglevel flag in urllib.request.HTTPHandler. Patch contributed by Chi Hsuan Yen.
| * | | Issue #26892: Honor debuglevel flag in urllib.request.HTTPHandler.Senthil Kumaran2016-05-131-0/+1
| | | | | | | | | | | | | | | | Patch contributed by Chi Hsuan Yen.
* | | | Merge typo fixes from 3.5Martin Panter2016-05-081-1/+1
|\ \ \ \ | |/ / /
| * | | Fix typos in comments, documentation and test method namesMartin Panter2016-05-081-1/+1
| | | |
* | | | Issue #26864: Merge no_proxy fixes from 3.5Martin Panter2016-04-301-2/+6
|\ \ \ \ | |/ / /
| * | | Issue #26864: Fix case insensitivity and suffix comparison with no_proxyMartin Panter2016-04-301-2/+6
| | | | | | | | | | | | | | | | Patch by Xiang Zhang.
* | | | merge 3.5Senthil Kumaran2016-04-251-10/+34
|\ \ \ \ | |/ / / | | | | | | | | | | | | | | | | | | | | Issue #26804: urllib.request will prefer lower_case proxy environment variables over UPPER_CASE or Mixed_Case ones. Patch contributed by Hans-Peter Jansen. Reviewed by Martin Panter and Senthil Kumaran.
| * | | Issue #26804: urllib.request will prefer lower_case proxy environment variablesSenthil Kumaran2016-04-251-10/+34
| | | | | | | | | | | | | | | | | | | | | | | | over UPPER_CASE or Mixed_Case ones. Patch contributed by Hans-Peter Jansen. Reviewed by Martin Panter and Senthil Kumaran.
* | | | Issue #2202: Fix UnboundLocalError in ↵Berker Peksag2016-03-061-0/+3
|\ \ \ \ | |/ / / | | | | | | | | | | | | | | | | | | | | | | | | AbstractDigestAuthHandler.get_algorithm_impls Raise ValueError if algorithm is not MD5 or SHA. Initial patch by Mathieu Dupuy.
| * | | Issue #2202: Fix UnboundLocalError in ↵Berker Peksag2016-03-061-0/+3
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | AbstractDigestAuthHandler.get_algorithm_impls Raise ValueError if algorithm is not MD5 or SHA. Initial patch by Mathieu Dupuy.
* | | | Issue #25985: sys.version_info is now used instead of sys.versionSerhiy Storchaka2016-02-111-1/+1
| | | | | | | | | | | | | | | | to format short Python version.
* | | | Issue #12923: Merge FancyURLopener fix from 3.5Martin Panter2016-02-061-11/+13
|\ \ \ \ | |/ / /
| * | | Issue #12923: Reset FancyURLopener's redirect counter even on exceptionMartin Panter2016-02-041-11/+13
| | | | | | | | | | | | | | | | Based on patches by Brian Brazil and Daniel Rocco.
* | | | merge from 3.5Senthil Kumaran2016-01-261-15/+0
|\ \ \ \ | |/ / / | | | | | | | | Remove unnecessary test case comment in urllib.parse.py. These are asserted as test cases.
| * | | Remove unnecessary test case comment in urllib.parse.py. These are asserted ↵Senthil Kumaran2016-01-261-15/+0
| | | | | | | | | | | | | | | | as test cases.
* | | | Issue #25822: Add docstrings to the fields of urllib.parse results.Senthil Kumaran2016-01-141-2/+65
| | | | | | | | | | | | | | | | Patch contributed by Swati Jaiswal.
* | | | Issue #25899: Converted non-ASCII characters in docstrings and manpageSerhiy Storchaka2015-12-181-3/+3
|\ \ \ \ | |/ / / | | | | | | | | | | | | to ASCII replacements. Removed UTF-8 BOM from Misc/NEWS. Original patch by Chris Angelico.
* | | | Issue #25576: Apply fix to new urlopen() doc stringMartin Panter2015-11-241-7/+2
| | | |
* | | | Issue #16099: RobotFileParser now supports Crawl-delay and Request-rateBerker Peksag2015-10-081-2/+37
| | | | | | | | | | | | | | | | | | | | | | | | extensions. Patch by Nikolay Bogoychev.
* | | | Add missing docstringRaymond Hettinger2015-08-181-0/+65
| | | |
* | | | Issue #20059: urllib.parse raises ValueError on all invalid ports.Robert Collins2015-08-091-2/+1
|/ / / | | | | | | | | | Patch by Martin Panter.
* | | Issue #24021: docstring for urllib.urlcleanup.Robert Collins2015-08-041-0/+1
|\ \ \ | |/ / | | | | | | Patch from Daniel Andrade Groppe and Peter Lovett
| * | Issue #24021: docstring for urllib.urlcleanup.Robert Collins2015-08-041-0/+1
| | | | | | | | | | | | Patch from Daniel Andrade Groppe and Peter Lovett
* | | Issue #13866: add *quote_via* argument to urlencode.R David Murray2015-05-181-14/+15
| | | | | | | | | | | | | | | Patch by samwyse, completed by Arnon Yaari, and reviewed by Martin Panter.
* | | Issue #23887: urllib.error.HTTPError now has a proper repr() representation.Facundo Batista2015-04-221-1/+6
| | |
* | | #7159: generalize urllib prior auth support.R David Murray2015-04-161-18/+60
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This fix is a superset of the functionality introduced by the issue #19494 enhancement, and supersedes that fix. Instead of a new handler, we have a new password manager that tracks whether we should send the auth for a given uri. This allows us to say "always send", satisfying #19494, or track that we've succeeded in auth and send the creds right away on every *subsequent* request. The support for using the password manager is added to AbstractBasicAuth, which means the proxy handler also now can handle prior auth if passed the new password manager. Patch by Akshit Khurana, docs mostly by me.
* | | Issue #23703: Fix a regression in urljoin() introduced in 901e4e52b20a.Berker Peksag2015-04-151-2/+1
| | | | | | | | | | | | Patch by Demian Brecht.
* | | Issue #23865: close() methods in multiple modules now are idempotent and moreSerhiy Storchaka2015-04-101-5/+9
|\ \ \ | |/ / | | | | | | | | | robust at shutdown. If needs to release multiple resources, they are released even if errors are occured.
| * | Issue #23865: close() methods in multiple modules now are idempotent and moreSerhiy Storchaka2015-04-101-5/+9
| | | | | | | | | | | | | | | robust at shutdown. If needs to release multiple resources, they are released even if errors are occured.
* | | Issue #23411: Added DefragResult, ParseResult, SplitResult, DefragResultBytes,Serhiy Storchaka2015-04-071-1/+3
| | | | | | | | | | | | | | | ParseResultBytes, and SplitResultBytes to urllib.parse.__all__. Patch by Martin Panter.
* | | (Merge 3.4) Issue #23881: urllib.request.ftpwrapper constructor now closes theVictor Stinner2015-04-071-1/+5
|\ \ \ | |/ / | | | | | | socket if the FTP connection failed to fix a ResourceWarning.
| * | Issue #23881: urllib.request.ftpwrapper constructor now closes the socket ifVictor Stinner2015-04-071-1/+5
| | | | | | | | | | | | the FTP connection failed to fix a ResourceWarning.
* | | Issue #23563: Optimized utility functions in urllib.parse.Serhiy Storchaka2015-03-031-60/+28
| | |
* | | Merge: #23040: Clarify treatment of encoding and errors when component is bytes.R David Murray2014-12-251-4/+5
|\ \ \ | |/ /
| * | #23040: Clarify treatment of encoding and errors when component is bytes.R David Murray2014-12-251-4/+5
| | | | | | | | | | | | Patch by Wojtek Ruszczewski.
* | | merge 3.4Benjamin Peterson2014-12-071-2/+2
|\ \ \ | |/ /
| * | use context's check_hostname attribute rather than the HTTPSHandler ↵Benjamin Peterson2014-12-071-2/+2
| | | | | | | | | | | | check_hostname parameter
| * | backport context argument of urlopen (#22366) for pep 476Senthil Kumaran2014-09-191-1/+9
| | |
* | | Close #19494: add urrlib.request.HTTPBasicPriorAuthHandlerNick Coghlan2014-11-121-0/+15
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This auth handler adds the Authorization header to the first HTTP request rather than waiting for a HTTP 401 Unauthorized response from the server as the default HTTPBasicAuthHandler does. This allows working with websites like https://api.github.com which do not follow the strict interpretation of RFC, but more the dicta in the end of section 2 of RFC 2617: > A client MAY preemptively send the corresponding Authorization > header with requests for resources in that space without receipt > of another challenge from the server. Similarly, when a client > sends a request to a proxy, it may reuse a userid and password in > the Proxy-Authorization header field without receiving another > challenge from the proxy server. See section 4 for security > considerations associated with Basic authentication. Patch by Matej Cepl.