summaryrefslogtreecommitdiffstats
path: root/Lib/shutil.py
Commit message (Collapse)AuthorAgeFilesLines
* gh-127001: Fix PATHEXT issues in shutil.which() on Windows (GH-127035)Serhiy Storchaka2024-11-221-11/+11
| | | | | | | | | * Name without a PATHEXT extension is only searched if the mode does not include X_OK. * Support multi-component PATHEXT extensions (e.g. ".foo.bar"). * Support files without extensions in PATHEXT contains dot-only extension (".", "..", etc). * Support PATHEXT extensions that end with a dot (e.g. ".foo.").
* gh-117151: increase default buffer size of shutil.copyfileobj() to 256k. ↵morotti2024-10-041-1/+1
| | | | | | | | | | | | | | | | | | | | (GH-119783) * gh-117151: increase default buffer size of shutil.copyfileobj() to 256k. it was set to 16k in the 1990s. it was raised to 64k in 2019. the discussion at the time mentioned another 5% improvement by raising to 128k and settled for a very conservative setting. it's 2024 now, I think it should be revisited to match modern hardware. I am measuring 0-15% performance improvement when raising to 256k on various types of disk. there is no downside as far as I can tell. this function is only intended for sequential copy of full files (or file like objects). it's the typical use case that benefits from larger operations. for reference, I came across this function while trying to profile pip that is using it to copy files when installing python packages. * add news --------- Co-authored-by: rmorotti <romain.morotti@man.com>
* gh-86009: Fix solaris detection in `_USE_CP_SENDFILE` check (GH-124289)Jakub Kulík2024-09-241-1/+1
|
* bpo-41843: Reenable use of sendfile in shutil module on Solaris (GH-23893)Jakub Kulík2024-09-191-3/+3
|
* gh-123084: Turn `shutil.ExecError` into a deprecated alias of `RuntimeError` ↵Peter Bierma2024-08-211-3/+13
| | | | (#123125)
* Fix typos in comments and docstring (#122720)Xie Yanbo2024-08-071-1/+1
| | | Co-authored-by: Alex Waygood <Alex.Waygood@Gmail.com>
* GH-73991: Use same signature for `shutil._rmtree_[un]safe()`. (#120517)Barney Gale2024-06-181-37/+38
| | | | | | | | | | | | | | Preparatory work for moving `_rmtree_unsafe()` and `_rmtree_safe_fd()` to `pathlib._os` so that they can be used from both `shutil` and `pathlib`. Move implementation-specific setup from `rmtree()` into the safe/unsafe functions, and give them the same signature `(path, dir_fd, onexc)`. In the tests, mock `os.open` rather than `_rmtree_safe_fd()` to ensure the FD-based walk is used, and replace a couple references to `shutil._use_fd_functions` with `shutil.rmtree.avoids_symlink_attacks` (which has the same value). No change of behaviour.
* GH-89727: Fix `shutil.rmtree()` recursion error on deep trees (#119808)Barney Gale2024-06-011-96/+66
| | | | | Implement `shutil._rmtree_safe_fd()` using a list as a stack to avoid emitting recursion errors on deeply nested trees. `shutil._rmtree_unsafe()` was fixed in a150679f90.
* GH-89727: Partially fix `shutil.rmtree()` recursion error on deep trees ↵Barney Gale2024-05-291-27/+11
| | | | | | | | | | | (#119634) Make `shutil._rmtree_unsafe()` call `os.walk()`, which is implemented without recursion. `shutil._rmtree_safe_fd()` is not affected and can still raise a recursion error. Co-authored-by: Jelle Zijlstra <jelle.zijlstra@gmail.com>
* docs: typo: tiny grammar change: "pointed by" -> "pointed to by" (#118411)Andrew Zipperer2024-05-021-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * docs: tiny grammar change: "pointed by" -> "pointed to by" This commit uses "file pointed to by" to replace "file pointed by" in - doc for shutil.copytree - docstring for shutil.copytree - docstring _abc.PathBase.open - docstring for pathlib.Path.open - doc for os.copy_file_range - doc for os.splice The docs use "file pointed to by" more frequently than "file pointed by". So, this commit replaces the uses of "file pointed by" in order to make the uses consistent through the docs. ```bash $ grep -ri 'pointed to by' cpython/ ``` yields more results than ```bash $ grep -ri 'pointed by' cpython/ ``` Separately: There are two occurrences of "tree pointed by": - cpython/Doc/library/xml.etree.elementtree.rst for `xml.etree.ElementInclude.include` - cpython/Lib/xml/etree/ElementInclude.py for `include` For those uses of "tree pointed by", I expect "tree pointed to by" instead. However, I found enough uses online of (a) "tree pointed by" rather than (b) "tree pointed to by" to convince me that (a) is in common use. So, this commit does not replace those occurrences of "tree pointed by" to "tree pointed to by". But I will replace them if a reviewer believes it is correct to replace them. * docs: typo: "exists and executable" -> "exists and is executable" --------- Co-authored-by: Andrew-Zipperer <atzipperer@gmail.com>
* bpo-18108: Adding dir_fd and follow_symlinks keyword args to shutil.chown ↵tahia2024-04-221-2/+10
| | | | | | | | | | | (GH-15811) * Adding dir_fd and follow_symlinks keyword args to shutil.chown * Extending test_shutil.TestShutil.test_chown to include new kwargs * Updating shutil.chown documentation Co-authored-by: Serhiy Storchaka <storchaka@gmail.com> Co-authored-by: Berker Peksag <berker.peksag@gmail.com> Co-authored-by: Zachary Ware <zachary.ware@gmail.com>
* gh-116401: Fix blocking os.fwalk() and shutil.rmtree() on opening a named ↵Serhiy Storchaka2024-03-131-2/+2
| | | | pipe (GH-116421)
* gh-71052: Change Android's `sys.platform` from "linux" to "android"Malcolm Smith2024-03-111-1/+2
| | | | Co-authored-by: Erlend E. Aasland <erlend.aasland@protonmail.com>
* gh-113803: Fix inaccurate documentation for shutil.move when dst is an ↵Dai Wentao2024-02-041-5/+5
| | | | | | existing directory (#113837) * fix the usage of dst and destination in shutil.move doc * update shutil.move doc
* bpo-26791: Update shutil.move() to provide the same symlink move behavior as ↵Jeffrey Kintscher2023-12-271-1/+1
| | | | the mv shell when moving a symlink into a directory that is the target of the symlink (GH-21759)
* gh-113188: Fix shutil.copymode() on Windows (GH-113189)Serhiy Storchaka2023-12-231-1/+6
| | | | | | | | | Previously it worked differently if dst is a symbolic link: it modified the permission bits of dst itself rather than the file it points to if follow_symlinks is true or src is not a symbolic link, and did nothing if follow_symlinks is false and src is a symbolic link. Also document similar changes in shutil.copystat().
* bpo-35332: Handle os.close() errors in shutil.rmtree() (GH-23766)Zackery Spytz2023-12-051-2/+18
| | | | | | | * Ignore os.close() errors when ignore_errors is True. * Pass os.close() errors to the error handler if specified. * os.close no longer retried after error. Co-authored-by: Serhiy Storchaka <storchaka@gmail.com>
* gh-94692: Only catch OSError in shutil.rmtree() (#112756)Serhiy Storchaka2023-12-051-2/+2
| | | | | Previously a symlink attack resistant version of shutil.rmtree() could ignore or pass to the error handler arbitrary exception when invalid arguments were provided.
* gh-81441: shutil.rmtree() FileNotFoundError race condition (GH-14064)Jeffrey Kintscher2023-12-051-11/+34
| | | | | | | Ignore missing files and directories while enumerating directory entries in shutil.rmtree(). Co-authored-by: Serhiy Storchaka <storchaka@gmail.com>
* gh-112645: remove deprecation warning for use of onerror in shutil.rmtree ↵Irit Katriel2023-12-031-5/+0
| | | | (#112659)
* gh-109653: Defer importing `warnings` in several modules (#110286)Alex Waygood2023-10-041-1/+1
|
* gh-109590: Update shutil.which on Windows to prefer a PATHEXT extension on ↵Charles Machalow2023-10-021-2/+10
| | | | | executable files (GH-109995) The default arguments for shutil.which() request an executable file, but extensionless files are not executable on Windows and should be ignored.
* gh-109748: Fix again venv test_zippath_from_non_installed_posix() (#110149)Victor Stinner2023-09-301-1/+1
| | | | | | | Call also copy_python_src_ignore() on listdir() names. shutil.copytree(): replace set() with an empty tuple. An empty tuple becomes a constant in the compiler and checking if an item is in an empty tuple is cheap.
* gh-99203: shutil.make_archive(): restore select CPython <= 3.10.5 behavior ↵6t8k2023-08-161-0/+4
| | | | | | | | | | | | (GH-99802) Restore following CPython <= 3.10.5 behavior of shutil.make_archive() that went away as part of gh-93160: Do not create an empty archive if root_dir is not a directory, and, in that case, raise FileNotFoundError or NotADirectoryError regardless of format choice. Beyond the brought-back behavior, the function may now also raise these exceptions in dry_run mode.
* gh-88745: Add _winapi.CopyFile2 and update shutil.copy2 to use it (GH-105055)Steve Dower2023-05-301-0/+25
|
* gh-82814: fix shutil access error on WSL (#103790)Allan Lago2023-04-251-1/+1
| | | | | | | gh-82814: Adds `errno.EACCES` to the list of ignored errors on `_copyxattr`. EPERM and EACCES are different constants but in general should be treated the same. News entry authored by: Gregory P. Smith <greg@krypto.org>
* gh-102950: Implement PEP 706 – Filter for tarfile.extractall (#102953)Petr Viktorin2023-04-241-5/+12
|
* gh-102828: set stacklevel on deprecation warning (#103422)Irit Katriel2023-04-111-1/+1
|
* GH-75586: Make shutil.which() on Windows more consistent with the OS (GH-103179)Charles Machalow2023-04-041-41/+48
|
* gh-102828: emit deprecation warning for onerror arg to shutil.rmtree (#102850)Irit Katriel2023-03-211-0/+6
|
* gh-102828: add onexc arg to shutil.rmtree. Deprecate onerror. (#102829)Irit Katriel2023-03-191-44/+62
|
* bpo-45975: Simplify some while-loops with walrus operator (GH-29347)Nick Drozd2022-11-261-4/+1
|
* gh-99547: Add isjunction methods for checking if a path is a junction (GH-99548)Charles Machalow2022-11-221-19/+6
|
* bpo-38523: ignore_dangling_symlinks does not apply recursively (GH-22937)Zackery Spytz2022-11-071-2/+3
|
* gh-74696: Pass root_dir to custom archivers which support it (GH-94251)Serhiy Storchaka2022-10-051-9/+11
| | | | Co-authored-by: Éric <merwok@netwok.org>
* gh-94844: Add pathlib support to shutil archive management (GH-94846)Oleg Iarygin2022-07-201-0/+2
| | | Co-authored-by: Barney Gale <barney.gale@gmail.com>
* gh-74696: Do not change the current working directory in ↵Serhiy Storchaka2022-06-221-34/+65
| | | | | | | | | | | shutil.make_archive() if possible (GH-93160) It is no longer changed when create a zip or tar archive. It is still changed for custom archivers registered with shutil.register_archive_format() if root_dir is not None. Co-authored-by: Éric <merwok@netwok.org> Co-authored-by: Łukasz Langa <lukasz@langa.pl>
* shutil._copyfileobj_readinto: tiny speedup (#92377)Lucinda May Phipps2022-05-201-1/+2
|
* gh-88513: clarify shutil.copytree's dirs_exist_ok arg (GH-91434)Jack DeVries2022-04-121-3/+5
| | | | | * add a paragraph to document this kwarg in detail * update docstring in the source accordingly
* bpo-46245: Add optional parameter dir_fd in shutil.rmtree() (GH-30365)Serhiy Storchaka2022-03-091-5/+12
|
* bpo-39327: Close file descriptors as soon as possible in shutil.rmtree ↵Lital Natan2022-02-201-2/+10
| | | | | | | | | (GH-31384) It fixes the "Text File Busy" OSError when using 'rmtree' on a windows-managed filesystem in via the VirtualBox shared folder (and possible other scenarios like a windows-managed network file system).
* bpo-42174: fallback to sane values if the columns or lines are 0 in ↵Filipe Laíns2021-10-191-2/+2
| | | | | | | | | | | | | get_terminal_size (GH-29046) I considered only falling back when both were 0, but that still seems wrong, and the highly popular rich[1] library does it this way, so I thought we should probably inherit that behavior. [1] https://github.com/willmcgugan/rich Signed-off-by: Filipe Laíns <lains@riseup.net> Co-authored-by: Łukasz Langa <lukasz@langa.pl>
* bpo-45234: Fix FileNotFound exception raised instead of IsADirectoryError in ↵andrei kulakov2021-09-211-29/+30
| | | | | shutil.copyfile() (GH-28421) This was a regression from fixing BPO-43219.
* bpo-33671 fix orphaned comment in shutil.copyfileobj (GH-27516)Anthony Sottile2021-07-311-1/+1
|
* bpo-43219: shutil.copyfile, raise a less confusing exception instead of ↵andrei kulakov2021-07-101-21/+29
| | | | | | IsADirectoryError (GH-27049) Fixes the misleading IsADirectoryError to be FileNotFoundError.
* bpo-43650: Fix MemoryError on zip.read in shutil._unpack_zipfile for large ↵Igor Bolshakov2021-05-171-10/+6
| | | | | | | files (GH-25058) `shutil.unpack_archive()` tries to read the whole file into memory, making no use of any kind of smaller buffer. Process crashes for really large files: I.e. archive: ~1.7G, unpacked: ~10G. Before the crash it can easily take away all available RAM on smaller systems. Had to pull the code form `zipfile.Zipfile.extractall()` to fix this Automerge-Triggered-By: GH:gpshead
* bpo-43743 add comment stating _USE_CP_SENDFILE should not be removed (#26024)Giampaolo Rodola2021-05-101-0/+2
|
* bpo-41718: subprocess imports grp and pwd on demand (GH-24987)Victor Stinner2021-03-231-12/+14
| | | | | The shutil and subprocess modules now only import the grp and pwd modules when they are needed, which is not the case by default in subprocess.
* bpo-42782: Fail fast for permission errors in shutil.move() (GH-24001)Winson Luk2021-03-021-0/+11
| | | | | * Fail fast in shutil.move() to avoid creating destination directories on failure. Co-authored-by: Zackery Spytz <zspytz@gmail.com>
* bpo-42014: shutil.rmtree: call onerror with correct function (GH-22585)Michal Čihař2020-11-101-1/+1
| | | | | | | The onerror is supposed to be called with failed function, but in this case lstat is wrongly used instead of open. Not sure if this needs bug or not... Automerge-Triggered-By: GH:hynek
generated by cgit v0.12 at 2025-04-03 00:48:44 (GMT)