summaryrefslogtreecommitdiffstats
path: root/Lib/test/test_regrtest.py
Commit message (Collapse)AuthorAgeFilesLines
* bpo-30822: Exclude tzdata from regrtest --all (#2775) (#2777)Victor Stinner2017-07-201-1/+12
| | | | | | | | | | | | | | When running the test suite using --use=all / -u all, exclude tzdata since it makes test_datetime too slow (15-20 min on some buildbots) which then times out on some buildbots. -u tzdata must now be enabled explicitly, -u tzdata or -u all,tzdata, to run all test_datetime tests. Fix also regrtest command line parser to allow passing -u extralargefile to run test_zipfile64. Travis CI: remove -tzdata. Replace -u all,-tzdata,-cpu with -u all,-cpu since tzdata is now excluded from -u all. (cherry picked from commit 5b392bbaeb9d9b1db961ecfc7315d8c8662c27f6)
* [3.6] bpo-30523, bpo-30764, bpo-30776: Sync regrtest from master (#2441)Victor Stinner2017-06-271-30/+83
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * bpo-30523: regrtest --list-cases --match (#2401) * regrtest --list-cases now supports --match and --match-file options. Example: ./python -m test --list-cases -m FileTests test_os * --list-cases now also sets support.verbose to False to prevent messages to stdout when loading test modules. * Add support._match_test() private function. (cherry picked from commit ace56d583664f855d89d1219ece7c21c2fddcf30) * bpo-30764: regrtest: add --fail-env-changed option (#2402) * bpo-30764: regrtest: change exit code on failure * Exit code 2 if failed tests ("bad") * Exit code 3 if interrupted * bpo-30764: regrtest: add --fail-env-changed option If the option is set, mark a test as failed if it alters the environment, for example if it creates a file without removing it. (cherry picked from commit 63f54c68936d648c70ca411661e4208329edcf26) * bpo-30776: reduce regrtest -R false positives (#2422) * Change the regrtest --huntrleaks checker to decide if a test file leaks or not. Require that each run leaks at least 1 reference. * Warmup runs are now completely ignored: ignored in the checker test and not used anymore to compute the sum. * Add an unit test for a reference leak. Example of reference differences previously considered a failure (leak) and now considered as success (success, no leak): [3, 0, 0] [0, 1, 0] [8, -8, 1] (cherry picked from commit 48b5c422ffb03affb00c184b9a99e5537be92732)
* Synchronize libregrtest from master to 3.6 (#2244)Victor Stinner2017-06-161-4/+101
| | | | | | | * bpo-30523: regrtest: Add --list-cases option (#2238) * bpo-30284: Fix regrtest for out of tree build (#1481) * bpo-30540: regrtest: add --matchfile option (#1909) * bpo-30258: regrtest: Fix run_tests_multiprocess() (#1479) * bpo-30263: regrtest: log system load (#1452)
* Issue #28950: Disallow -j0 combined with -T/-l in regrtest.Xiang Zhang2016-12-191-0/+2
|\
| * Issue #28950: Disallow -j0 combined with -T/-l/-M in regrtest.Xiang Zhang2016-12-191-0/+3
| |
* | Issue #28484: Skip tests if GIL is not used or multithreading is disabledMartin Panter2016-10-201-1/+6
| |
* | Merge 3.6: Issue #28409: regrtest: fix the parser of command line arguments.Victor Stinner2016-10-171-0/+9
|\ \ | |/
| * Issue #28409: regrtest: fix the parser of command line arguments.Victor Stinner2016-10-171-0/+10
| |
* | Fix test_huntrleaks_fd_leak() of test_regrtestVictor Stinner2016-09-181-5/+2
| | | | | | | | | | Issue #28195: Don't expect the fd leak message to be on a specific line number, just make sure that the line is present in the output.
* | #27364: fix "incorrect" uses of escape character in the stdlib.R David Murray2016-09-081-2/+2
| | | | | | | | | | | | | | And most of the tools. Patch by Emanual Barry, reviewed by me, Serhiy Storchaka, and Martin Panter.
* | regrtest: replace "Result:" with "Tests result:"Victor Stinner2016-08-191-1/+1
| |
* | regrtest: add a summary of the summary, "Result: xxx"Victor Stinner2016-08-171-4/+17
| | | | | | | | | | | | | | It's sometimes hard to check quickly if tests succeeded, failed or something bad happened. I added a final "Result: xxx" line which summarizes all outputs into a single line, written at the end (it should always be the last line of the output).
* | regrtest: nicer output for durationsVictor Stinner2016-08-171-2/+2
| | | | | | | | Use milliseconds and minutes units, not only seconds.
* | regrtest: rename --slow option to --slowestVictor Stinner2016-08-171-6/+6
| | | | | | | | Thanks to optparse, --slow syntax still works ;-)
* | Issue #19527: Fixed tests with defined COUNT_ALLOCS.Serhiy Storchaka2016-07-031-0/+3
|\ \ | |/
* | Issue #23277: Remove unused imports in tests.Serhiy Storchaka2016-04-241-2/+0
| |
* | Issue #26295: Enhanc test_regrtest.test_tools_script_run_tests()Victor Stinner2016-03-301-1/+1
| | | | | | | | Pass all regrtest options, not only --testdir.
* | Issue #26295: Fix test_regrtest.test_tools_buildbot_test()Victor Stinner2016-03-301-1/+1
| | | | | | | | Pass also --testdir option.
* | Issue #26295: test_regrtest now uses a temporary directoryVictor Stinner2016-03-301-27/+28
| | | | | | | | | | | | | | test_forever() stores its state into the builtins module since the test module is reloaded at each run. Remove also warning to detect leaked tests of a previous run.
* | regrtest: fix --fromfile featureVictor Stinner2016-03-241-0/+24
| | | | | | | | | | * Update code for the name regrtest output format. * Enhance also test_regrtest test on --fromfile
* | regrtest: display test duration in sequential modeVictor Stinner2016-03-231-2/+3
| | | | | | | | Only display duration if a test takes more than 30 seconds.
* | regrtest: add time to outputVictor Stinner2016-03-221-1/+1
| | | | | | | | | | Timestamps should help to debug slow buildbots, and timeout and hang on buildbots.
* | Issue #25694: Fix test_regrtest for installed PythonVictor Stinner2015-11-221-5/+15
| |
* | Close #25373: Fix regrtest --slow with interrupted testVictor Stinner2015-10-111-2/+41
| | | | | | | | | | | | | | * Fix accumulate_result(): don't use time on interrupted and failed test * Add unit test for interrupted test * Add unit test on --slow with interrupted test, with and without multiprocessing
* | test_regrtest: catch stderr in test_nowindows()Victor Stinner2015-10-111-1/+5
| | | | | | | | Check also that the deprecation warning is emited.
* | Close #25369: Fix test_regrtest without thread supportVictor Stinner2015-10-111-1/+4
| |
* | Issue #25306: Try to fix test_huntrleaks_fd_leak() on WindowsVictor Stinner2015-10-031-2/+12
| | | | | | | | Issue #25306: Disable popup and logs to stderr on assertion failures in MSCRT.
* | Issue #25306: Skip test_huntrleaks_fd_leak() of test_regrtest until the bug isVictor Stinner2015-10-031-0/+2
| | | | | | | | fixed.
* | Issue #18174: Fix test_regrtest when Python is compiled in release modeVictor Stinner2015-10-031-0/+1
| |
* | Issue #22806: Add ``python -m test --list-tests`` command to list tests.Victor Stinner2015-10-021-0/+7
| |
* | Issue #18174: "python -m test --huntrleaks ..." now also checks for leak ofVictor Stinner2015-10-021-14/+49
| | | | | | | | file descriptors. Patch written by Richard Oudkerk.
* | Fix regrtest --coverage on WindowsVictor Stinner2015-09-301-2/+0
| | | | | | | | | | Issue #25260: Fix ``python -m test --coverage`` on Windows. Remove the list of ignored directories.
* | Issue #25220: Fix "-m test --forever"Victor Stinner2015-09-301-39/+94
| | | | | | | | | | | | | | * Fix "-m test --forever": replace _test_forever() with self._test_forever() * Add unit test for --forever * Add unit test for a failing test * Fix also some pyflakes warnings in libregrtest
* | Issue #25220, libregrtest: Call setup_python(ns) in the slavesVictor Stinner2015-09-291-1/+0
| | | | | | | | | | | | | | | | | | | | Slaves (child processes running tests for regrtest -jN) now inherit --memlimit/-M, --threshold/-t and --nowindows/-n options. * -M, -t and -n are now supported with -jN * Factorize code to run tests. * run_test_in_subprocess() now pass the whole "ns" namespace to the child process.
* | Issue #25220: Add test for --wait in test_regrtestVictor Stinner2015-09-291-12/+36
| | | | | | | | Replace script_helper.assert_python_ok() with subprocess.run().
* | Oops, revert unwanted change, sorryVictor Stinner2015-09-291-0/+2
| |
* | testVictor Stinner2015-09-291-2/+0
| |
* | Fix test_regrtest.test_tools_buildbot_test()Victor Stinner2015-09-281-12/+13
| | | | | | | | | | Issue #25220: Fix test_regrtest.test_tools_buildbot_test() on release build (on Windows), pass "+d" option to test.bat.
* | Issue #25220: Add functional tests to test_regrtestVictor Stinner2015-09-281-2/+291
| | | | | | | | | | | | | | * test all available ways to run the Python test suite * test many regrtest options: --slow, --coverage, -r, -u, etc. Note: python -m test --coverage doesn't work on Windows.
* | Issue #25220: Move most regrtest.py code to libregrtestVictor Stinner2015-09-261-47/+48
| |
* | Issue #25220: Create Lib/test/libregrtest/Victor Stinner2015-09-261-2/+2
| | | | | | | | | | | | | | Start to split regrtest.py into smaller parts with the creation of Lib/test/libregrtest/cmdline.py: code to handle the command line, especially parsing command line arguments. This part of the code is tested by test_regrtest.
* | Issue #25220: Backed out changeset eaf9a99b6bb8Victor Stinner2015-09-231-2/+2
| |
* | Issue #25220: Create Lib/test/libregrtest/Victor Stinner2015-09-231-2/+2
|/ | | | | Start to split regrtest.py into smaller parts with the creation of Lib/test/libregrtest/cmdline.py.
* rename some more tests to avoid duplicate names (#19123)Benjamin Peterson2013-09-291-3/+3
|
* delete duplicate test (closes #19123)Benjamin Peterson2013-09-291-6/+0
|
* Issue #18935: Fix test_regrtest.test_timeout when built --without-threads (theCharles-François Natali2013-09-081-0/+3
| | | | '--timeout' option requires faulthandler.dump_traceback_later).
* Remove unused --debug option of regrtest.Eli Bendersky2013-09-031-6/+0
| | | | | If bots fail due to using this flag, the buildbot scripts have to be modified to omit it. Regrtest ignores it anyway.
* Issue #16799: Switched from getopt to argparse style in regrtest's argumentSerhiy Storchaka2013-08-291-69/+253
| | | | parsing. Added more tests for regrtest's argument parsing.
* Issue #16854: Fix regrtest.usage() regression introduced in 6e2e5adc0400.Chris Jerdonek2013-01-081-2/+6
| | | | | This fixes a regression introduced in the commit for issue #15302, which switched regrtest from getopt to argparse.
* Issue #15302: Switch regrtest from using getopt to using argparse.Chris Jerdonek2012-12-281-0/+96
This is the first step in refactoring regrtest to use argparse. The regrtest module's main() function still expects a getopt-style return value rather than an argparse.Namespace instance.
generated by cgit v0.12 at 2025-04-13 07:50:36 (GMT)