summaryrefslogtreecommitdiffstats
path: root/Lib/test/test_regrtest.py
Commit message (Collapse)AuthorAgeFilesLines
...
* bpo-30764: regrtest: add --fail-env-changed option (#2402)Victor Stinner2017-06-261-13/+40
| | | | | | | | | | | | * bpo-30764: regrtest: change exit code on failure * Exit code 2 if failed tests ("bad") * Exit code 3 if interrupted * bpo-30764: regrtest: add --fail-env-changed option If the option is set, mark a test as failed if it alters the environment, for example if it creates a file without removing it.
* bpo-30523: regrtest --list-cases --match (#2401)Victor Stinner2017-06-261-0/+9
| | | | | | | * regrtest --list-cases now supports --match and --match-file options. Example: ./python -m test --list-cases -m FileTests test_os * --list-cases now also sets support.verbose to False to prevent messages to stdout when loading test modules. * Add support._match_test() private function.
* bpo-30523: Add --list-cases unittest (#2243)Louie Lu2017-06-161-1/+17
| | | | | | | | * bpo-30523: Add --list-cases unittest * Addressed haypo's request * Addressed haypo's request
* bpo-30540: regrtest: add --matchfile option (#1909)Victor Stinner2017-06-091-3/+62
| | | | | | | | | | | | | | | * Add a new option taking a filename to get a list of test names to filter tests. * support.match_tests becomes a list. * Modify run_unittest() to accept to match the whole test identifier, not just a part of a test identifier. For example, the following command only runs test_default_timeout() of the BarrierTests class of test_threading: $ ./python -m test -v test_threading -m test.test_threading.BarrierTests.test_default_timeout Remove also some empty lines from test_regrtest.py to make flake8 tool happy.
* bpo-30263: regrtest: log system load (#1452)Victor Stinner2017-05-041-1/+4
| | | | | | | | * bpo-30263: regrtest: log system load * regrtest: log the number of CPUs Log the number of CPUs in the header. --verbose now imply --header.
* regrtest: don't fail immediately if a child does crashVictor Stinner2017-02-061-1/+12
| | | | | | Issue #29362: Catch a crash of a worker process as a normal failure and continue to run next tests. It allows to get the usual test summary: single line result (OK/FAIL), total duration, etc.
* Issue #29035: Simplify a regex in libregrtestVictor Stinner2017-01-031-0/+8
| | | | | regrtest: simplify the regex used to match test names for the --fromfile command line option.
* Issue #28950: Disallow -j0 combined with -T/-l in regrtest.Xiang Zhang2016-12-191-0/+2
|\
| * Issue #28950: Disallow -j0 combined with -T/-l/-M in regrtest.Xiang Zhang2016-12-191-0/+3
| |
* | Issue #28484: Skip tests if GIL is not used or multithreading is disabledMartin Panter2016-10-201-1/+6
| |
* | Merge 3.6: Issue #28409: regrtest: fix the parser of command line arguments.Victor Stinner2016-10-171-0/+9
|\ \ | |/
| * Issue #28409: regrtest: fix the parser of command line arguments.Victor Stinner2016-10-171-0/+10
| |
* | Fix test_huntrleaks_fd_leak() of test_regrtestVictor Stinner2016-09-181-5/+2
| | | | | | | | | | Issue #28195: Don't expect the fd leak message to be on a specific line number, just make sure that the line is present in the output.
* | #27364: fix "incorrect" uses of escape character in the stdlib.R David Murray2016-09-081-2/+2
| | | | | | | | | | | | | | And most of the tools. Patch by Emanual Barry, reviewed by me, Serhiy Storchaka, and Martin Panter.
* | regrtest: replace "Result:" with "Tests result:"Victor Stinner2016-08-191-1/+1
| |
* | regrtest: add a summary of the summary, "Result: xxx"Victor Stinner2016-08-171-4/+17
| | | | | | | | | | | | | | It's sometimes hard to check quickly if tests succeeded, failed or something bad happened. I added a final "Result: xxx" line which summarizes all outputs into a single line, written at the end (it should always be the last line of the output).
* | regrtest: nicer output for durationsVictor Stinner2016-08-171-2/+2
| | | | | | | | Use milliseconds and minutes units, not only seconds.
* | regrtest: rename --slow option to --slowestVictor Stinner2016-08-171-6/+6
| | | | | | | | Thanks to optparse, --slow syntax still works ;-)
* | Issue #19527: Fixed tests with defined COUNT_ALLOCS.Serhiy Storchaka2016-07-031-0/+3
|\ \ | |/
* | Issue #23277: Remove unused imports in tests.Serhiy Storchaka2016-04-241-2/+0
| |
* | Issue #26295: Enhanc test_regrtest.test_tools_script_run_tests()Victor Stinner2016-03-301-1/+1
| | | | | | | | Pass all regrtest options, not only --testdir.
* | Issue #26295: Fix test_regrtest.test_tools_buildbot_test()Victor Stinner2016-03-301-1/+1
| | | | | | | | Pass also --testdir option.
* | Issue #26295: test_regrtest now uses a temporary directoryVictor Stinner2016-03-301-27/+28
| | | | | | | | | | | | | | test_forever() stores its state into the builtins module since the test module is reloaded at each run. Remove also warning to detect leaked tests of a previous run.
* | regrtest: fix --fromfile featureVictor Stinner2016-03-241-0/+24
| | | | | | | | | | * Update code for the name regrtest output format. * Enhance also test_regrtest test on --fromfile
* | regrtest: display test duration in sequential modeVictor Stinner2016-03-231-2/+3
| | | | | | | | Only display duration if a test takes more than 30 seconds.
* | regrtest: add time to outputVictor Stinner2016-03-221-1/+1
| | | | | | | | | | Timestamps should help to debug slow buildbots, and timeout and hang on buildbots.
* | Issue #25694: Fix test_regrtest for installed PythonVictor Stinner2015-11-221-5/+15
| |
* | Close #25373: Fix regrtest --slow with interrupted testVictor Stinner2015-10-111-2/+41
| | | | | | | | | | | | | | * Fix accumulate_result(): don't use time on interrupted and failed test * Add unit test for interrupted test * Add unit test on --slow with interrupted test, with and without multiprocessing
* | test_regrtest: catch stderr in test_nowindows()Victor Stinner2015-10-111-1/+5
| | | | | | | | Check also that the deprecation warning is emited.
* | Close #25369: Fix test_regrtest without thread supportVictor Stinner2015-10-111-1/+4
| |
* | Issue #25306: Try to fix test_huntrleaks_fd_leak() on WindowsVictor Stinner2015-10-031-2/+12
| | | | | | | | Issue #25306: Disable popup and logs to stderr on assertion failures in MSCRT.
* | Issue #25306: Skip test_huntrleaks_fd_leak() of test_regrtest until the bug isVictor Stinner2015-10-031-0/+2
| | | | | | | | fixed.
* | Issue #18174: Fix test_regrtest when Python is compiled in release modeVictor Stinner2015-10-031-0/+1
| |
* | Issue #22806: Add ``python -m test --list-tests`` command to list tests.Victor Stinner2015-10-021-0/+7
| |
* | Issue #18174: "python -m test --huntrleaks ..." now also checks for leak ofVictor Stinner2015-10-021-14/+49
| | | | | | | | file descriptors. Patch written by Richard Oudkerk.
* | Fix regrtest --coverage on WindowsVictor Stinner2015-09-301-2/+0
| | | | | | | | | | Issue #25260: Fix ``python -m test --coverage`` on Windows. Remove the list of ignored directories.
* | Issue #25220: Fix "-m test --forever"Victor Stinner2015-09-301-39/+94
| | | | | | | | | | | | | | * Fix "-m test --forever": replace _test_forever() with self._test_forever() * Add unit test for --forever * Add unit test for a failing test * Fix also some pyflakes warnings in libregrtest
* | Issue #25220, libregrtest: Call setup_python(ns) in the slavesVictor Stinner2015-09-291-1/+0
| | | | | | | | | | | | | | | | | | | | Slaves (child processes running tests for regrtest -jN) now inherit --memlimit/-M, --threshold/-t and --nowindows/-n options. * -M, -t and -n are now supported with -jN * Factorize code to run tests. * run_test_in_subprocess() now pass the whole "ns" namespace to the child process.
* | Issue #25220: Add test for --wait in test_regrtestVictor Stinner2015-09-291-12/+36
| | | | | | | | Replace script_helper.assert_python_ok() with subprocess.run().
* | Oops, revert unwanted change, sorryVictor Stinner2015-09-291-0/+2
| |
* | testVictor Stinner2015-09-291-2/+0
| |
* | Fix test_regrtest.test_tools_buildbot_test()Victor Stinner2015-09-281-12/+13
| | | | | | | | | | Issue #25220: Fix test_regrtest.test_tools_buildbot_test() on release build (on Windows), pass "+d" option to test.bat.
* | Issue #25220: Add functional tests to test_regrtestVictor Stinner2015-09-281-2/+291
| | | | | | | | | | | | | | * test all available ways to run the Python test suite * test many regrtest options: --slow, --coverage, -r, -u, etc. Note: python -m test --coverage doesn't work on Windows.
* | Issue #25220: Move most regrtest.py code to libregrtestVictor Stinner2015-09-261-47/+48
| |
* | Issue #25220: Create Lib/test/libregrtest/Victor Stinner2015-09-261-2/+2
| | | | | | | | | | | | | | Start to split regrtest.py into smaller parts with the creation of Lib/test/libregrtest/cmdline.py: code to handle the command line, especially parsing command line arguments. This part of the code is tested by test_regrtest.
* | Issue #25220: Backed out changeset eaf9a99b6bb8Victor Stinner2015-09-231-2/+2
| |
* | Issue #25220: Create Lib/test/libregrtest/Victor Stinner2015-09-231-2/+2
|/ | | | | Start to split regrtest.py into smaller parts with the creation of Lib/test/libregrtest/cmdline.py.
* rename some more tests to avoid duplicate names (#19123)Benjamin Peterson2013-09-291-3/+3
|
* delete duplicate test (closes #19123)Benjamin Peterson2013-09-291-6/+0
|
* Issue #18935: Fix test_regrtest.test_timeout when built --without-threads (theCharles-François Natali2013-09-081-0/+3
| | | | '--timeout' option requires faulthandler.dump_traceback_later).