summaryrefslogtreecommitdiffstats
path: root/PCbuild/prepare_libffi.bat
diff options
context:
space:
mode:
authorVictor Stinner <vstinner@python.org>2020-11-18 14:36:27 (GMT)
committerGitHub <noreply@github.com>2020-11-18 14:36:27 (GMT)
commit8fba9523cf08029dc2e280d9f48fdd57ab178c9d (patch)
tree8bdf707429cdf7720cfe25720066db25b84ef5c4 /PCbuild/prepare_libffi.bat
parentce04e7105bc396c32667a22b928a712ba0778a3f (diff)
downloadcpython-8fba9523cf08029dc2e280d9f48fdd57ab178c9d.zip
cpython-8fba9523cf08029dc2e280d9f48fdd57ab178c9d.tar.gz
cpython-8fba9523cf08029dc2e280d9f48fdd57ab178c9d.tar.bz2
bpo-42398: Fix "make regen-all" race condition (GH-23362)
Fix a race condition in "make regen-all" when make -jN option is used to run jobs in parallel. The clinic.py script now only use atomic write to write files. Moveover, generated files are now left unchanged if the content does not change, to not change the file modification time. The "make regen-all" command runs "make clinic" and "make regen-importlib" targets: * "make regen-importlib" builds object files (ex: Modules/_weakref.o) from source files (ex: Modules/_weakref.c) and clinic files (ex: Modules/clinic/_weakref.c.h) * "make clinic" always rewrites all clinic files (ex: Modules/clinic/_weakref.c.h) Since there is no dependency between "clinic" and "regen-importlib" Makefile targets, these two targets can be run in parallel. Moreover, half of clinic.py file writes are not atomic and so there is a race condition when "make regen-all" runs jobs in parallel using make -jN option (which can be passed in MAKEFLAGS environment variable). Fix clinic.py to make all file writes atomic: * Add write_file() function to ensure that all file writes are atomic: write into a temporary file and then use os.replace(). * Moreover, write_file() doesn't recreate or modify the file if the content does not change to avoid modifying the file modification file. * Update test_clinic to verify these assertions with a functional test. * Remove Clinic.force attribute which was no longer used, whereas Clinic.verify remains useful.
Diffstat (limited to 'PCbuild/prepare_libffi.bat')
0 files changed, 0 insertions, 0 deletions