summaryrefslogtreecommitdiffstats
path: root/Source/CTest/cmCTestTestHandler.cxx
Commit message (Collapse)AuthorAgeFilesLines
* ctest: Display test labels in failure summaryWim Colgate2024-07-171-3/+13
| | | | | | | | | | | | In a complex test environment, there may be a desire to add a test property label to indicate context. Here is one such example: set_property(TEST mygoofytest PROPERTY LABELS might-fail-on-config-change) Upon looking at the failed test summary, one can quickly decide whether the failure might be expected or not. 198 - mygoofytest (Failed) might-fail-on-config-change
* Source: Use cmValue::IsOn and IsOffVitaly Stakhovsky2024-03-171-3/+3
| | | | Speed up a bit by calling members directly.
* Merge topic 'ctest-j-default'Brad King2024-03-111-6/+17
|\ | | | | | | | | | | | | | | | | | | | | | | | | 5de1e21659 ctest: Allow passing -j without value to choose a contextual default bbcbcff7d9 cmCTestMultiProcessHandler: Modernize member initialization 7457b474a1 Tests: Remove unnecessary parallel suppression from CTestCoverageCollectGCOV ae69801d96 Tests: Convert CTestTestSkipReturnCode to RunCMake.ctest_test case 30dda49416 Tests: Convert CTestTestSerialOrder to RunCMake.ctest_test case Acked-by: Kitware Robot <kwrobot@kitware.com> Acked-by: buildbot <buildbot@kitware.com> Acked-by: scivision <michael@scivision.dev> Merge-request: !9315
| * ctest: Allow passing -j without value to choose a contextual defaultBrad King2024-03-101-3/+15
| | | | | | | | | | | | | | | | | | | | | | | | | | Under job server integration, added by commit 80fe56c481 (ctest: Add support for running under a make job server on POSIX systems, 2023-11-15, v3.29.0-rc1~324^2), use a very high default so that parallelism is effectively limited only by available job server tokens. Otherwise, choose a default limit based on the number of processors. Also allow passing `0` to specify unbounded parallelism. Fixes: #25739
| * cmCTestMultiProcessHandler: Modernize member initializationBrad King2024-03-101-3/+2
| |
* | Merge topic 'ctest-tests-from-file'Brad King2024-03-111-23/+22
|\ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | 170ec48601 Help: Improve ctest tests-from-file documentation wording and wrapping 1a4837641e ctest: Remove unnecessary and ambiguous tests-from-file comment syntax d52c66bfb3 ctest: Honor tests-from-file options with empty input 8673264e25 Tests: Make ctest tests-from-file expected output more precise Acked-by: Kitware Robot <kwrobot@kitware.com> Acked-by: buildbot <buildbot@kitware.com> Merge-request: !9322
| * | ctest: Remove unnecessary and ambiguous tests-from-file comment syntaxBrad King2024-03-081-5/+2
| | | | | | | | | | | | | | | | | | | | | | | | Test names can contain `#`. Since we ignore lines that do not match any test names anyway, "commenting" can still work without explicit syntax. Also drop whitespace trimming for similar reasons. Fixes: #25741
| * | ctest: Honor tests-from-file options with empty inputBrad King2024-03-081-18/+20
| | | | | | | | | | | | If the `--tests-from-file` input file is empty, no tests should run.
* | | Merge topic 'gtest-json-test-def-source'Brad King2024-03-081-0/+2
|\ \ \ | | | | | | | | | | | | | | | | | | | | | | | | 06860d5c12 ctest: Show custom test properties in --show-only=json-v1 Acked-by: Kitware Robot <kwrobot@kitware.com> Merge-request: !9305
| * | | ctest: Show custom test properties in --show-only=json-v1Daniel Sim2024-03-061-0/+2
| | | |
* | | | Merge topic 'ctest-tests-from-file'Brad King2024-03-081-8/+12
|\ \ \ \ | |/ / / |/| / / | |/ / | | | | | | | | | | | | ca0a9def2e ctest: Exit with failure when tests-from-file input is missing 60433fc6e8 Tests: Generalize ctest tests-from-file test cases Acked-by: Kitware Robot <kwrobot@kitware.com> Merge-request: !9317
| * | ctest: Exit with failure when tests-from-file input is missingBrad King2024-03-061-8/+12
| |/ | | | | | | | | | | | | | | | | | | | | | | | | | | | | If the options added by * commit 022f20f663 (ctest: add command line option to run the tests listed in a given file, 2023-11-29, v3.29.0-rc1~66^2~2) * commit dbacc1d5a8 (ctest: add command line option to exclude tests listed in a given file, 2023-11-30, v3.29.0-rc1~66^2~1) * commit 701029726f (ctest_test: add options INCLUDE_FROM_FILE and EXCLUDE_FROM_FILE, 2023-12-03, v3.29.0-rc1~66^2) are given a missing file, fail instead of ignoring it. Fixes: #25740
* | Remove unused variableChristoph GrĂ¼ninger2024-02-141-1/+0
| | | | | | | | Found by Cppcheck.
* | CTest: Throw error if resource spec is invalidKyle Edwards2024-02-081-1/+3
|/
* ctest: add command line option to exclude tests listed in a given fileAlex Neundorf2024-01-251-3/+24
| | | | | | | Add `--exclude-from-file <filename>` to exclude the tests listed in the given file. Issue: #25455
* ctest: add command line option to run the tests listed in a given fileAlex Neundorf2024-01-251-0/+41
| | | | | | | | Add `--tests-from-file <filename>` to run only the tests listed in the given file. The test names must match exactly, no regexps or something. The listed tests can still be filtered with a regexp using -R. Issue: #25455
* cmCTestTestHandler: Clarify name of member storing RESOURCE_LOCK propertyBrad King2023-11-211-1/+1
| | | | The property represents project-defined resources.
* cmCTestMultiProcessHandler: Clarify resource availability error member namesBrad King2023-11-171-1/+1
| | | | | The members are about the availability of sufficient resources, not allocation of them.
* cmCTestMultiProcessHandler: Clarify representation of pending testsBrad King2023-11-171-1/+1
|
* cmCTestMultiProcessHandler: Avoid extra copy of test mapsBrad King2023-11-171-1/+1
|
* Source: Remove redundant FileIsDirectory checksscivision2023-09-191-4/+2
|
* CTest: Add ability to dynamically generate resource spec fileKyle Edwards2023-08-101-17/+7
| | | | Issue: #25106
* IWYU: Update for Debian 12 CI jobBrad King2023-07-281-0/+1
| | | | | | `include-what-you-use` diagnostics, in practice, are specific to the environment's compiler and standard library. Update includes to satisfy IWYU for our CI job under Debian 12.
* ctest: export test labels to junit xmlAlex Neundorf2023-07-261-0/+15
| | | | | | | | | | | | With this patch, the junit files written by ctest also contain the test labels as testcase properties, see https://github.com/testmoapp/junitxml#properties The name for the property is "cmake_labels", where "cmake_" is used namespace-like. This could be done the same way if we export more properties to junit. Also this makes it clear to consumers that this is coming from cmake, and the list is a cmake-formatted string.
* ctest: Optionally terminate tests with a custom signal on timeoutBrad King2023-06-021-0/+61
| | | | | | | | CTest normally terminates test processes on timeout using `SIGKILL`. Offer tests a chance to exit gracefully, on platforms supporting POSIX signals, by setting `TIMEOUT_SIGNAL_{NAME,GRACE_PERIOD}` properties. Fixes: #17288
* cmCTestRunTest: Consolidate test timeout selection logicBrad King2023-05-041-6/+0
| | | | | Test timeout selection was previously spread out over several locations. Consolidate it in a single place to make it easier to follow.
* ctest: Fix TIMEOUT test property with value 0 with --timeout flagBrad King2023-05-041-1/+1
| | | | | An explicit zero TIMEOUT test property value should not be overridden by the `--timeout` flag.
* cmCTestTestHandler: Use in-class initialization of properties and resultsBrad King2023-05-041-11/+0
|
* CMake code rely on cmList class for CMake lists management (part. 2)Marc Chevrier2023-04-291-3/+2
|
* CMake code rely on cmList class for CMake lists management (part. 1)Marc Chevrier2023-04-241-11/+12
|
* presets: Improve JSON parser and error messagesMartin Duffy2023-03-291-3/+3
|
* CTest: add test failure reason to JUnit XML outputFrank Winklmeier2023-02-021-1/+1
| | | | | | | | In case of test failure, add the test failure reason (e.g. "Timeout") to the failure message in the XML file. This is the same value that is shown in the ctest text output. Fixes: #24184
* cmValue: Use operator* explicitly to convert to std::string; avoid extra callVitaly Stakhovsky2023-01-161-9/+10
|
* ctest: print error for invalid CTEST_CUSTOM_TEST_OUTPUT_TRUNCATIONFrank Winklmeier2022-09-071-1/+5
| | | | | | | | | Print an error message for invalid values of `CTEST_CUSTOM_TEST_OUTPUT_TRUNCATION` in a ctest dashboard script. The option was added by commit 140704d443 (ctest: add option for output truncation, 2022-03-07, v3.24.0-rc1~513^2). Fixes: #23869
* cmSystemTools: Fix 'ErrorOccurred' spellingFeRD (Frank Dana)2022-06-131-1/+1
| | | | | | | | Rename the booleans 's_ErrorOccured' and 's_FatalErrorOccured' to 's_ErrorOccurred' and 's_FatalErrorOccurred', respectively. Rename the getters and setters to 'Get[Fatal]ErrorOccurred' and 'Set[Fatal]ErrorOccurred', and fix all uses across the codebase.
* clang-tidy: address `google-readability-casting` lintsBen Boeckel2022-05-241-1/+2
| | | | At least those involving `static_cast`.
* Source: Fix clang -Wunused-but-set-variable warningsBrad King2022-04-061-5/+2
|
* ctest: add option for output truncationFrank Winklmeier2022-03-081-13/+44
| | | | | | | | | | Add `--test-output-truncation` to `ctest`. This option can be used to customize which part of the test output is being truncated. Currently supported values are `tail`, `middle` and `head`. Also add equivalent `CTEST_CUSTOM_TEST_OUTPUT_TRUNCATION` variable. Fixes: #23206
* cmCTestTestHandler: refactor CleanTestOutput methodFrank Winklmeier2022-03-081-16/+23
| | | | | Refactor the code to skip over UTF-8 multi-bytes into its own lambda function so it can more easily be re-used.
* Merge topic 'ctest-add_subdirectory'Brad King2021-12-091-55/+38
|\ | | | | | | | | | | | | | | | | 7c5a120c38 Tests: Add case covering both ctest subdirectory commands 04deda1d2a CTest: Extract common implementation of add_subdirectory and subdirs Acked-by: Kitware Robot <kwrobot@kitware.com> Acked-by: buildbot <buildbot@kitware.com> Merge-request: !6795
| * CTest: Extract common implementation of add_subdirectory and subdirsfriendlyanon2021-12-081-55/+38
| | | | | | | | | | | | | | | | | | | | The two functions have basically the same functionality in a CTest context, however the add_subdirectory implementation was missing code for changing the current working directory similarly to how it was done for subdirs. This commit extracts the common code and also fixes that bug. Issue: #22921
* | cmListFileBacktrace: Remove unused "bottom" entryBrad King2021-12-081-1/+1
|/ | | | | All uses of `GetBottom` by clients have been removed, so drop the method and its supporting infrastructure.
* Source: Replace most calls to sprintf with snprintfSean McBride2021-10-251-2/+2
|
* Source: Fix Clang -Wdeprecated warningsSean McBride2021-10-151-0/+2
| | | | Applied C++ 'rule of three'.
* Rename cmProp in cmValueMarc Chevrier2021-09-211-5/+5
|
* cmCTestGenericHandler::GetOption returns cmPropMarc Chevrier2021-09-131-12/+12
|
* ctest_memcheck: generate `DynamicAnalysis-Test.xml` as wellBen Boeckel2021-09-091-0/+15
| | | | | | | This is useful so that memcheck results also show up as test results on CDash. It will be submitted with the other `MemCheck` parts. Fixes: #22190
* Merge topic 'ctest-environment-modifications'Brad King2021-07-131-0/+2
|\ | | | | | | | | | | | | | | de4f1f26b0 CTest: add an ENVIRONMENT_MODIFICATION property 4c757fa3c8 Help/prop_test/ENVIRONMENT: clarify the scope of the changes Acked-by: Kitware Robot <kwrobot@kitware.com> Merge-request: !6299
| * CTest: add an ENVIRONMENT_MODIFICATION propertyBen Boeckel2021-07-091-0/+2
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This property allows projects to modify environment variables at test time rather than trying to guess what the state should be based on what is present at configure time. Of particular interest is the ability to use a `PATH` present at test time while adding entries known to be necessary for the test itself. There are multiple operations provided to modify variables, including: - setting and unsetting - appending and prepending as: - strings - path lists - CMake lists Additionally, a `reset` action is provided to cancel any prior modifications to that particular variable in the case of incremental additions to the test property.
* | cmState: Construct with modeBrad King2021-07-121-1/+1
|/