summaryrefslogtreecommitdiffstats
path: root/Tests/RunCMake/CTestCommandLine
Commit message (Collapse)AuthorAgeFilesLines
* Tests/RunCMake: Match dots more precisely, part 3AJIOB2025-10-2037-71/+71
|
* Tests/RunCMake: Match xxx.cmake file name more preciselyAJIOB2025-10-161-1/+1
|
* ci: Add jobs to perform coverage with BullseyeCoverage on LinuxBrad King2025-10-051-1/+1
|
* Merge topic 'ctest-T-test-timeout'Brad King2025-08-203-0/+19
|\ | | | | | | | | | | | | | | 9dc3edbba8 ctest: Restore default test timeout for command-line `-T Test` step 8745e6308e ctest: Restore default of no time limit for command-line `-T Test` step Acked-by: Kitware Robot <kwrobot@kitware.com> Merge-request: !11094
| * ctest: Restore default test timeout for command-line `-T Test` stepBrad King2025-08-183-0/+19
| | | | | | | | | | | | | | | | | | | | | | In commit 774fcbe49c (CTest: Base command line mode on top of scripting commands, 2024-10-05, v4.0.0-rc1~653^2) the implementation of this step was converted to use `ctest_test` internally. That command has its own default test timeout of 600s if the ctest "TimeOut" configuration value is not set. If "TimeOut" is not set then default it to our previous command-line mode default test timeout. Fixes: #27139
* | ctest: Add JSON schema for --show-only=json-v1 outputCraig Scott2025-06-092-1/+33
| | | | | | | | | | | | Add schema validation to the existing test case for --show-only=json-v1 too. Fixes: #26980
* | Merge topic 'test-ctest-regression'Brad King2025-04-231-1/+3
|\ \ | |/ | | | | | | | | | | 6bc5b467a9 Tests: Fix RunCMake.CTestCommandLine under ctest -T Coverage Acked-by: Kitware Robot <kwrobot@kitware.com> Merge-request: !10699
| * Tests: Fix RunCMake.CTestCommandLine under ctest -T CoverageBrad King2025-04-221-1/+3
| | | | | | | | | | | | | | Update commit 712cb8cb14 (ctest: Restore support for -T Test without dashboard configuration, 2025-03-06, v4.0.0-rc4~11^2) to avoid conflating coverage of CMake itself with the coverage mode of ctest being tested.
* | ctest: Add option to specify the --schedule-random seedDaniel Goldberg2025-03-183-0/+26
|/ | | | | | | | | When `--schedule-random` is used in automated CI jobs, failures may occur due to test order. We now log the seed. Provide a way for developers to re-run the same order by specifying the seed. Fixes: #26760 Co-authored-by: Brad King <brad.king@kitware.com>
* ctest: Restore support for -T Test without dashboard configurationDaniel Pfeifer2025-03-064-2/+8
| | | | | | | | | | | Since commit 774fcbe49c (CTest: Base command line mode on top of scripting commands, 2024-10-05, v4.0.0-rc1~653^2) we drive dashboard client steps through `cmCTestHandlerCommand::ExecuteHandlerCommand` instead of calling `ProcessHandler` directly. This requires the `BuildDirectory` to be known to establish a work directory. Fixes: #26743 Co-authored-by: Brad King <brad.king@kitware.com>
* ctest: Print GENERATED_RESOURCE_SPEC_FILE property in show-only outputBrad King2024-11-252-16/+27
| | | | | This was missed in commit c8c1dd0d95 (CTest: Add ability to dynamically generate resource spec file, 2023-07-20, v3.28.0-rc1~233^2).
* ctest: Print custom timeout signal properties in show-only outputBrad King2024-11-253-7/+51
| | | | | This was missed in commit 54c5654f7d (ctest: Optionally terminate tests with a custom signal on timeout, 2023-05-11, v3.27.0-rc1~18^2).
* Tests/RunCMake/CTestCommandLine: Fix python string literal syntaxBrad King2024-11-251-1/+1
|
* cmWorkingDirectory: Unify error messagesDaniel Pfeifer2024-10-182-2/+1
|
* CTest: Base command line mode on top of scripting commandsDaniel Pfeifer2024-10-122-1/+2
| | | | | | | | | | Make sure that all CMake variables that are translated into CTest options in `cmCTest*Command` implementations are translated from CTest options into CMake variables before the functions are called. This back-and-forth translation should be temporary. It is a necessary prerequisite for refactoring `cmCTest*Handler` implementations to operate on CMake variables directly rather than CTest options.
* CTestCommandLine tests: Make sure to test successful runDaniel Pfeifer2024-10-095-5/+6
| | | | | Add a DartConfiguration.tcl file in two places, so that testing the generated Text.xml file does not depend on output in stderr.
* Tests/RunCMake: Update cmake_minimum_required versions to 3.10Brad King2024-10-033-3/+3
| | | | | For policy-specific tests, use the version before the policy was introduced. Otherwise, use 3.10 where possible.
* Tests: Move ctest --print-labels case into RunCMake.CTestCommandLineBrad King2024-07-242-0/+20
|
* ctest: Display test labels in failure summaryWim Colgate2024-07-174-0/+22
| | | | | | | | | | | | In a complex test environment, there may be a desire to add a test property label to indicate context. Here is one such example: set_property(TEST mygoofytest PROPERTY LABELS might-fail-on-config-change) Upon looking at the failed test summary, one can quickly decide whether the failure might be expected or not. 198 - mygoofytest (Failed) might-fail-on-config-change
* ctest: Allow --test-dir override when using presetscastro-ma2024-04-242-3/+30
| | | | Fixes: #23982
* ctest: Cleanup for invalid argument handlingMartin Duffy2024-04-171-1/+2
| | | | Backs out unrelated change and changes error message to 'Unknown argument'
* Merge topic 'ctest-invalid-arg'Brad King2024-04-053-0/+4
|\ | | | | | | | | | | | | | | | | | | 304396d13c ctest: Show error on invalid ctest arguments 06cb978c1b Tests: Fix ctest flag typo in RunCMake.GoogleTest Acked-by: Kitware Robot <kwrobot@kitware.com> Acked-by: buildbot <buildbot@kitware.com> Acked-by: scivision <michael@scivision.dev> Merge-request: !9383
| * ctest: Show error on invalid ctest argumentsJake D'Esposito2024-04-043-0/+4
| | | | | | | | Fixes: #24227
* | ctest: Fall back to CMake environment variable for TLS server verificationBrad King2024-03-309-0/+17
| | | | | | | | | | | | | | Use `ENV{CMAKE_TLS_VERIFY}` if `CTEST_TLS_VERIFY` or `CMAKE_TLS_VERIFY` is not set. Issue: #23608
* | ctest: Test fallback to CMake options for TLS server verificationBrad King2024-03-309-1/+13
| |
* | Tests: Update cmake_minimum_required version in RunCMake ctest casesBrad King2024-03-291-1/+1
|/ | | | | This was missed in commit 1edf138506 (Tests/RunCMake: Update cmake_minimum_required versions, 2023-02-06, v3.27.0-rc1~508^2~1).
* ctest: Fall back to CMake options for TLS versionBrad King2024-03-129-0/+15
| | | | | | | Use `CMAKE_TLS_VERSION` or `ENV{CMAKE_TLS_VERSION}` if `CTEST_TLS_VERSION` is not set. Issue: #25701
* ctest: Fall back to CMake options for TLS server verificationBrad King2024-03-121-1/+1
| | | | Use `CMAKE_TLS_VERIFY` if `CTEST_TLS_VERIFY` is not set.
* ctest: Add explicit options for TLS versionBrad King2024-03-125-0/+6
| | | | | | | Add a dedicated `TLSVersion` ctest option and a `CTEST_TLS_VERSION` variable to control it. Issue: #25701
* ctest: Add explicit options for TLS server verificationBrad King2024-03-1210-0/+28
| | | | | | Add a dedicated `TLSVerify` ctest option and a `CTEST_TLS_VERIFY` variable to control it. Deprecate `CurlOptions` because it exposes internal implementation details.
* Merge topic 'ctest-j-default'Brad King2024-03-1114-0/+102
|\ | | | | | | | | | | | | | | | | | | | | | | | | 5de1e21659 ctest: Allow passing -j without value to choose a contextual default bbcbcff7d9 cmCTestMultiProcessHandler: Modernize member initialization 7457b474a1 Tests: Remove unnecessary parallel suppression from CTestCoverageCollectGCOV ae69801d96 Tests: Convert CTestTestSkipReturnCode to RunCMake.ctest_test case 30dda49416 Tests: Convert CTestTestSerialOrder to RunCMake.ctest_test case Acked-by: Kitware Robot <kwrobot@kitware.com> Acked-by: buildbot <buildbot@kitware.com> Acked-by: scivision <michael@scivision.dev> Merge-request: !9315
| * ctest: Allow passing -j without value to choose a contextual defaultBrad King2024-03-1014-0/+102
| | | | | | | | | | | | | | | | | | | | | | | | | | Under job server integration, added by commit 80fe56c481 (ctest: Add support for running under a make job server on POSIX systems, 2023-11-15, v3.29.0-rc1~324^2), use a very high default so that parallelism is effectively limited only by available job server tokens. Otherwise, choose a default limit based on the number of processors. Also allow passing `0` to specify unbounded parallelism. Fixes: #25739
* | Merge topic 'ctest-tests-from-file'Brad King2024-03-119-3/+23
|\ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | 170ec48601 Help: Improve ctest tests-from-file documentation wording and wrapping 1a4837641e ctest: Remove unnecessary and ambiguous tests-from-file comment syntax d52c66bfb3 ctest: Honor tests-from-file options with empty input 8673264e25 Tests: Make ctest tests-from-file expected output more precise Acked-by: Kitware Robot <kwrobot@kitware.com> Acked-by: buildbot <buildbot@kitware.com> Merge-request: !9322
| * | ctest: Remove unnecessary and ambiguous tests-from-file comment syntaxBrad King2024-03-081-0/+3
| | | | | | | | | | | | | | | | | | | | | | | | Test names can contain `#`. Since we ignore lines that do not match any test names anyway, "commenting" can still work without explicit syntax. Also drop whitespace trimming for similar reasons. Fixes: #25741
| * | ctest: Honor tests-from-file options with empty inputBrad King2024-03-084-0/+13
| | | | | | | | | | | | If the `--tests-from-file` input file is empty, no tests should run.
| * | Tests: Make ctest tests-from-file expected output more preciseBrad King2024-03-085-3/+7
| | |
* | | Merge topic 'gtest-json-test-def-source'Brad King2024-03-082-1/+13
|\ \ \ | | | | | | | | | | | | | | | | | | | | | | | | 06860d5c12 ctest: Show custom test properties in --show-only=json-v1 Acked-by: Kitware Robot <kwrobot@kitware.com> Merge-request: !9305
| * | | ctest: Show custom test properties in --show-only=json-v1Daniel Sim2024-03-062-1/+13
| | | |
* | | | Merge topic 'ctest-tests-from-file'Brad King2024-03-089-4/+16
|\ \ \ \ | |/ / / |/| / / | |/ / | | | | | | | | | | | | ca0a9def2e ctest: Exit with failure when tests-from-file input is missing 60433fc6e8 Tests: Generalize ctest tests-from-file test cases Acked-by: Kitware Robot <kwrobot@kitware.com> Merge-request: !9317
| * | ctest: Exit with failure when tests-from-file input is missingBrad King2024-03-067-0/+12
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | If the options added by * commit 022f20f663 (ctest: add command line option to run the tests listed in a given file, 2023-11-29, v3.29.0-rc1~66^2~2) * commit dbacc1d5a8 (ctest: add command line option to exclude tests listed in a given file, 2023-11-30, v3.29.0-rc1~66^2~1) * commit 701029726f (ctest_test: add options INCLUDE_FROM_FILE and EXCLUDE_FROM_FILE, 2023-12-03, v3.29.0-rc1~66^2) are given a missing file, fail instead of ignoring it. Fixes: #25740
| * | Tests: Generalize ctest tests-from-file test casesBrad King2024-03-063-4/+4
| |/
* | Tests: Allow RunCMake.CTestCommandLine/TestOutputSize to have larger fileKyle Edwards2024-02-271-1/+1
|/
* ctest: add command line option to exclude tests listed in a given fileAlex Neundorf2024-01-252-0/+8
| | | | | | | Add `--exclude-from-file <filename>` to exclude the tests listed in the given file. Issue: #25455
* ctest: add command line option to run the tests listed in a given fileAlex Neundorf2024-01-253-0/+24
| | | | | | | | Add `--tests-from-file <filename>` to run only the tests listed in the given file. The test names must match exactly, no regexps or something. The listed tests can still be filtered with a regexp using -R. Issue: #25455
* cmCTestMultiProcessHandler: Stop searching for tests when limit is reachedBrad King2023-11-172-0/+22
| | | | Avoid an extra loop iteration if we have no room for more tests.
* Tests: Cover ctest waiting on insufficient non-zero spare test-loadBrad King2023-11-172-5/+7
|
* Tests: Migrate CTestTest{NoBuild,NoExe} to RunCMake.ctest_{build,test}Brad King2023-09-072-2/+3
| | | | Avoid duplicating infrastructure provided by the latter.
* ctest: Optionally terminate tests with a custom signal on timeoutBrad King2023-06-027-0/+42
| | | | | | | | CTest normally terminates test processes on timeout using `SIGKILL`. Offer tests a chance to exit gracefully, on platforms supporting POSIX signals, by setting `TIMEOUT_SIGNAL_{NAME,GRACE_PERIOD}` properties. Fixes: #17288
* Tests/RunCMake: Update cmake_minimum_required versionsBrad King2023-02-112-2/+2
| | | | | | | | For policy-specific tests, use the version before the policy was introduced. Otherwise, use 3.5 where possible. Also, remove `cmake_minimum_required()` and `project()` calls from individual cases where they are handled by `CMakeLists.txt`.
* ctest(1): Add CTEST_NO_TESTS_ACTION env varfriendlyanon2023-01-138-0/+15
| | | | | This environment variable provides a default value for the --no-tests=<action> command line argument.