diff options
| author | Inada Naoki <methane@users.noreply.github.com> | 2019-03-02 04:31:01 (GMT) |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2019-03-02 04:31:01 (GMT) |
| commit | 4f1903061877776973c1bbfadd3d3f146920856e (patch) | |
| tree | e9ef1a128bbee617b497bedfa52c583d36b48562 /Lib/shutil.py | |
| parent | bcfa450f210074e16feb761ae5b3e966a2532fcf (diff) | |
| download | cpython-4f1903061877776973c1bbfadd3d3f146920856e.zip cpython-4f1903061877776973c1bbfadd3d3f146920856e.tar.gz cpython-4f1903061877776973c1bbfadd3d3f146920856e.tar.bz2 | |
bpo-36103: change default buffer size of shutil.copyfileobj() (GH-12115)
It is changed from 16KiB to 64KiB. The previous default value
is used since 1990.
coreutils chose 128 KiB as minimum buffer size for block device I/O.
But shutil.copyfileobj() can be used for non block devices.
So I choose more conservative value.
As my quick benchmark, performance difference between 64KiB and
128 KiB is up to ~5%. On the other hand, performance difference
between 32 KiB and 64 KiB can be more than 10% when file is fully
buffered.
This is why 64 KiB is rational value.
Diffstat (limited to 'Lib/shutil.py')
| -rw-r--r-- | Lib/shutil.py | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/Lib/shutil.py b/Lib/shutil.py index 9b50c2a..7dd470d 100644 --- a/Lib/shutil.py +++ b/Lib/shutil.py @@ -49,7 +49,7 @@ if os.name == 'posix': elif _WINDOWS: import nt -COPY_BUFSIZE = 1024 * 1024 if _WINDOWS else 16 * 1024 +COPY_BUFSIZE = 1024 * 1024 if _WINDOWS else 64 * 1024 _HAS_SENDFILE = posix and hasattr(os, "sendfile") _HAS_FCOPYFILE = posix and hasattr(posix, "_fcopyfile") # macOS |