summaryrefslogtreecommitdiffstats
path: root/Lib/test/test_regrtest.py
Commit message (Collapse)AuthorAgeFilesLines
* bpo-33718: regrtest: use format_duration() to display failed tests (GH-7686)Victor Stinner2018-06-141-0/+25
| | | | | * Enhance also format_duration(): work on integers and rounds towards +infinity (math.ceil). * Write unit tests on format_duration()
* bpo-33718: regrtest: use "xxx then yyy" result if re-run (GH-7521)Victor Stinner2018-06-081-6/+37
| | | | | | If tests are re-run, use "xxx then yyy" result format (ex: "FAILURE then SUCCESS") to show that some failing tests have been re-run. Add also test_regrtest.test_rerun_fail() test.
* bpo-33352: Skip test_regrtest test if rt.bat does not exist (GH-6654)Andrés Delfino2018-04-301-0/+2
|
* bpo-31370: Remove support for threads-less builds (#3385)Antoine Pitrou2017-09-071-6/+2
| | | | | | * Remove Setup.config * Always define WITH_THREAD for compatibility.
* bpo-31009: Fix support.fd_count() on Windows (#2862)Victor Stinner2017-07-251-13/+1
| | | | | | | | | | * bpo-31009: Fix support.fd_count() on Windows On Windows, test.support.fd_count() now calls msvcrt.CrtSetReportMode() to not kill the process nor log any error on stderr on os.dup(fd) if the file descriptor is invalid. * Fix for release mode
* bpo-30822: Exclude tzdata from regrtest --all (#2775)Victor Stinner2017-07-201-1/+12
| | | | | | | | | | | | | When running the test suite using --use=all / -u all, exclude tzdata since it makes test_datetime too slow (15-20 min on some buildbots) which then times out on some buildbots. -u tzdata must now be enabled explicitly, -u tzdata or -u all,tzdata, to run all test_datetime tests. Fix also regrtest command line parser to allow passing -u extralargefile to run test_zipfile64. Travis CI: remove -tzdata. Replace -u all,-tzdata,-cpu with -u all,-cpu since tzdata is now excluded from -u all.
* bpo-30776: reduce regrtest -R false positives (#2422)Victor Stinner2017-06-271-18/+35
| | | | | | | | | | | | | | * Change the regrtest --huntrleaks checker to decide if a test file leaks or not. Require that each run leaks at least 1 reference. * Warmup runs are now completely ignored: ignored in the checker test and not used anymore to compute the sum. * Add an unit test for a reference leak. Example of reference differences previously considered a failure (leak) and now considered as success (success, no leak): [3, 0, 0] [0, 1, 0] [8, -8, 1]
* bpo-30764: regrtest: add --fail-env-changed option (#2402)Victor Stinner2017-06-261-13/+40
| | | | | | | | | | | | * bpo-30764: regrtest: change exit code on failure * Exit code 2 if failed tests ("bad") * Exit code 3 if interrupted * bpo-30764: regrtest: add --fail-env-changed option If the option is set, mark a test as failed if it alters the environment, for example if it creates a file without removing it.
* bpo-30523: regrtest --list-cases --match (#2401)Victor Stinner2017-06-261-0/+9
| | | | | | | * regrtest --list-cases now supports --match and --match-file options. Example: ./python -m test --list-cases -m FileTests test_os * --list-cases now also sets support.verbose to False to prevent messages to stdout when loading test modules. * Add support._match_test() private function.
* bpo-30523: Add --list-cases unittest (#2243)Louie Lu2017-06-161-1/+17
| | | | | | | | * bpo-30523: Add --list-cases unittest * Addressed haypo's request * Addressed haypo's request
* bpo-30540: regrtest: add --matchfile option (#1909)Victor Stinner2017-06-091-3/+62
| | | | | | | | | | | | | | | * Add a new option taking a filename to get a list of test names to filter tests. * support.match_tests becomes a list. * Modify run_unittest() to accept to match the whole test identifier, not just a part of a test identifier. For example, the following command only runs test_default_timeout() of the BarrierTests class of test_threading: $ ./python -m test -v test_threading -m test.test_threading.BarrierTests.test_default_timeout Remove also some empty lines from test_regrtest.py to make flake8 tool happy.
* bpo-30263: regrtest: log system load (#1452)Victor Stinner2017-05-041-1/+4
| | | | | | | | * bpo-30263: regrtest: log system load * regrtest: log the number of CPUs Log the number of CPUs in the header. --verbose now imply --header.
* regrtest: don't fail immediately if a child does crashVictor Stinner2017-02-061-1/+12
| | | | | | Issue #29362: Catch a crash of a worker process as a normal failure and continue to run next tests. It allows to get the usual test summary: single line result (OK/FAIL), total duration, etc.
* Issue #29035: Simplify a regex in libregrtestVictor Stinner2017-01-031-0/+8
| | | | | regrtest: simplify the regex used to match test names for the --fromfile command line option.
* Issue #28950: Disallow -j0 combined with -T/-l in regrtest.Xiang Zhang2016-12-191-0/+2
|\
| * Issue #28950: Disallow -j0 combined with -T/-l/-M in regrtest.Xiang Zhang2016-12-191-0/+3
| |
* | Issue #28484: Skip tests if GIL is not used or multithreading is disabledMartin Panter2016-10-201-1/+6
| |
* | Merge 3.6: Issue #28409: regrtest: fix the parser of command line arguments.Victor Stinner2016-10-171-0/+9
|\ \ | |/
| * Issue #28409: regrtest: fix the parser of command line arguments.Victor Stinner2016-10-171-0/+10
| |
* | Fix test_huntrleaks_fd_leak() of test_regrtestVictor Stinner2016-09-181-5/+2
| | | | | | | | | | Issue #28195: Don't expect the fd leak message to be on a specific line number, just make sure that the line is present in the output.
* | #27364: fix "incorrect" uses of escape character in the stdlib.R David Murray2016-09-081-2/+2
| | | | | | | | | | | | | | And most of the tools. Patch by Emanual Barry, reviewed by me, Serhiy Storchaka, and Martin Panter.
* | regrtest: replace "Result:" with "Tests result:"Victor Stinner2016-08-191-1/+1
| |
* | regrtest: add a summary of the summary, "Result: xxx"Victor Stinner2016-08-171-4/+17
| | | | | | | | | | | | | | It's sometimes hard to check quickly if tests succeeded, failed or something bad happened. I added a final "Result: xxx" line which summarizes all outputs into a single line, written at the end (it should always be the last line of the output).
* | regrtest: nicer output for durationsVictor Stinner2016-08-171-2/+2
| | | | | | | | Use milliseconds and minutes units, not only seconds.
* | regrtest: rename --slow option to --slowestVictor Stinner2016-08-171-6/+6
| | | | | | | | Thanks to optparse, --slow syntax still works ;-)
* | Issue #19527: Fixed tests with defined COUNT_ALLOCS.Serhiy Storchaka2016-07-031-0/+3
|\ \ | |/
* | Issue #23277: Remove unused imports in tests.Serhiy Storchaka2016-04-241-2/+0
| |
* | Issue #26295: Enhanc test_regrtest.test_tools_script_run_tests()Victor Stinner2016-03-301-1/+1
| | | | | | | | Pass all regrtest options, not only --testdir.
* | Issue #26295: Fix test_regrtest.test_tools_buildbot_test()Victor Stinner2016-03-301-1/+1
| | | | | | | | Pass also --testdir option.
* | Issue #26295: test_regrtest now uses a temporary directoryVictor Stinner2016-03-301-27/+28
| | | | | | | | | | | | | | test_forever() stores its state into the builtins module since the test module is reloaded at each run. Remove also warning to detect leaked tests of a previous run.
* | regrtest: fix --fromfile featureVictor Stinner2016-03-241-0/+24
| | | | | | | | | | * Update code for the name regrtest output format. * Enhance also test_regrtest test on --fromfile
* | regrtest: display test duration in sequential modeVictor Stinner2016-03-231-2/+3
| | | | | | | | Only display duration if a test takes more than 30 seconds.
* | regrtest: add time to outputVictor Stinner2016-03-221-1/+1
| | | | | | | | | | Timestamps should help to debug slow buildbots, and timeout and hang on buildbots.
* | Issue #25694: Fix test_regrtest for installed PythonVictor Stinner2015-11-221-5/+15
| |
* | Close #25373: Fix regrtest --slow with interrupted testVictor Stinner2015-10-111-2/+41
| | | | | | | | | | | | | | * Fix accumulate_result(): don't use time on interrupted and failed test * Add unit test for interrupted test * Add unit test on --slow with interrupted test, with and without multiprocessing
* | test_regrtest: catch stderr in test_nowindows()Victor Stinner2015-10-111-1/+5
| | | | | | | | Check also that the deprecation warning is emited.
* | Close #25369: Fix test_regrtest without thread supportVictor Stinner2015-10-111-1/+4
| |
* | Issue #25306: Try to fix test_huntrleaks_fd_leak() on WindowsVictor Stinner2015-10-031-2/+12
| | | | | | | | Issue #25306: Disable popup and logs to stderr on assertion failures in MSCRT.
* | Issue #25306: Skip test_huntrleaks_fd_leak() of test_regrtest until the bug isVictor Stinner2015-10-031-0/+2
| | | | | | | | fixed.
* | Issue #18174: Fix test_regrtest when Python is compiled in release modeVictor Stinner2015-10-031-0/+1
| |
* | Issue #22806: Add ``python -m test --list-tests`` command to list tests.Victor Stinner2015-10-021-0/+7
| |
* | Issue #18174: "python -m test --huntrleaks ..." now also checks for leak ofVictor Stinner2015-10-021-14/+49
| | | | | | | | file descriptors. Patch written by Richard Oudkerk.
* | Fix regrtest --coverage on WindowsVictor Stinner2015-09-301-2/+0
| | | | | | | | | | Issue #25260: Fix ``python -m test --coverage`` on Windows. Remove the list of ignored directories.
* | Issue #25220: Fix "-m test --forever"Victor Stinner2015-09-301-39/+94
| | | | | | | | | | | | | | * Fix "-m test --forever": replace _test_forever() with self._test_forever() * Add unit test for --forever * Add unit test for a failing test * Fix also some pyflakes warnings in libregrtest
* | Issue #25220, libregrtest: Call setup_python(ns) in the slavesVictor Stinner2015-09-291-1/+0
| | | | | | | | | | | | | | | | | | | | Slaves (child processes running tests for regrtest -jN) now inherit --memlimit/-M, --threshold/-t and --nowindows/-n options. * -M, -t and -n are now supported with -jN * Factorize code to run tests. * run_test_in_subprocess() now pass the whole "ns" namespace to the child process.
* | Issue #25220: Add test for --wait in test_regrtestVictor Stinner2015-09-291-12/+36
| | | | | | | | Replace script_helper.assert_python_ok() with subprocess.run().
* | Oops, revert unwanted change, sorryVictor Stinner2015-09-291-0/+2
| |
* | testVictor Stinner2015-09-291-2/+0
| |
* | Fix test_regrtest.test_tools_buildbot_test()Victor Stinner2015-09-281-12/+13
| | | | | | | | | | Issue #25220: Fix test_regrtest.test_tools_buildbot_test() on release build (on Windows), pass "+d" option to test.bat.
* | Issue #25220: Add functional tests to test_regrtestVictor Stinner2015-09-281-2/+291
| | | | | | | | | | | | | | * test all available ways to run the Python test suite * test many regrtest options: --slow, --coverage, -r, -u, etc. Note: python -m test --coverage doesn't work on Windows.
generated by cgit v0.12 at 2025-11-25 10:51:35 (GMT)