summaryrefslogtreecommitdiffstats
path: root/testing/runtests.py
Commit message (Collapse)AuthorAgeFilesLines
* Running tests with subdirs enabledalbert-github2021-06-051-0/+3
| | | | | | | | | | When running the standard doxygen tests with subdirs enabled (i.e. on windows `nmake tests TESTS_FLAGS==--subdirs`) we get the following type errors: ``` Failed to run xmllint on the doxygen output file ..../testing/test_output_008 ``` this is due to the fact that the file to be checked is in a subdirectory and as directory separator a backslash is used (initially there are 2 backslashes but due to e.g. `check_file = check_file[0]` one backslash disappears. Furthermore everywhere else the backslashes are converted to forward slashes. In the resulting files there are references to the mentioned sub directories path, but the file to compare to is without therse so we have to filter them as well.
* Write out used settings when generating XML outputalbert-github2021-03-281-0/+27
| | | | | When generating XML output is is afterwards unknown which settings have been used to generate the XML output, e.g. whether `EXTRACT_PRIVATE` was set or not as the XML output tries to write out all information contained in the sources and not to limit it. By writing out a Doxyfile.xml with all the used settings this can be overcome.
* Typeerror when running testsalbert-github2021-01-071-1/+1
| | | | | | | | | | Some tests get (#8313): ``` File "/home/runner/work/doxygen/doxygen/testing/runtests.py", line 55, in clean_header rtnmsg+=0 TypeError: can only concatenate str (not "int") to str ``` most likely caused by the fact that `more` has error lines and that here not `0` (zero) but `o` should be used for the concatenation.
* Extend tests with some other default testsalbert-github2020-12-181-0/+29
| | | | | | | | | During the change to GitHub Actions the extra tests as added in #8217 were lost: Extend tests with generating xhtml, docbook, rtf to see if the files can be generated and build, not for Windows as it loos like that the "latex" command cannot always be run (problems with test 28). Check also the generated xsd files in xml mode. Note for the new checks no comparison is done with previous versions.
* Doxygen warnings are not seen as errors during running testsalbert-github2020-11-221-2/+8
| | | | | | Doxygen warnings were on *nix suppressed but shown on Windows though the tests were nevertheless shown as OK - correct redirection under windows - catch doxygen warnings and make the corresponding test fail
* Restructured the split_and_keep functionDimitri van Heesch2020-07-161-20/+7
|
* Superfluous space in "TEST_FLAGS"albert-github2020-07-061-0/+2
| | | | | | | | | | | | | | | | | | | | | | | | | | | When having extra spaces in TEST_FLAGS like(note the double space before `--ip`): ``` make tests TEST_FLAGS="--keep --id=1" ``` or ``` make tests TEST_FLAGS="--id=1 --id=2" ``` we get a message like; ``` [100%] Running doxygen tests... usage: runtests.py [-h] [--updateref] [--doxygen [DOXYGEN]] [--xmllint [XMLLINT]] [--id IDS [IDS ...]] [--start_id START_ID] [--end_id END_ID] [--all] [--inputdir [INPUTDIR]] [--outputdir [OUTPUTDIR]] [--noredir] [--pool [POOL]] [--xml] [--rtf] [--docbook] [--xhtml] [--xmlxsd] [--pdf] [--subdirs] [--clang] [--keep] [--cfg CFGS [CFGS ...]] runtests.py: error: unrecognized arguments: NMAKE : fatal error U1077: 'D:\Programs\Python\Python37\python.exe' : return code '0x2' Stop. ``` By stripping the spaces in the arguments this can be overcome
* Problem with generating test output for Chinese (#7862)albert-github2020-06-201-2/+2
| | | | | | | | | | | | | | * Problem with generating test output for Chinese The log output generated for the Chinese language can contain some extended ASCII characters, this results in a message like: ``` UnicodeDecodeError: 'utf-8' codec can't decode byte 0xf4 in position 36101: invalid continuation byte ``` and a crash of the test application during the read of the file. In case of a crash it is attempted to open the file with another decoding and redo the read. * Problem with generating test output for Chinese It is not necessary to use the fallback, one can, in this case, directly use `encoding='ISO-8859-1'`
* Running doxygen tests with variable with spaces (#7819)albert-github2020-06-131-4/+25
| | | | | | | | | | | | | | | When having a run command like: ``` nmake tests TEST_FLAGS="--xhtml --keep --cfg GENERATE_HTMLHELP=YES --cfg HHC_LOCATION=\"c:\Program Files (x86)\HTML Help Workshop\hhc.exe\" --cfg HTML_FILE_EXTENSION=.html --cfg SEARCHENGINE=NO --id=1" ``` we get an error like ``` Not a doxygen configuration item, missing '=' sign: 'Files'. ``` this is due to the usage of the `split()` that does a brute force split on spaces. Making the splitting a bit more intelligent: - splitting on `--` - splitting on space after "command"
* Addon option --pool to the test run script for parallel execution of tests ↵albert-github2020-06-131-10/+29
| | | | | | (#7827) To make better use of the processors of a computer the possibility has been build to execute the tests in parallel, this is especially of an advantage for PDF tests. To make use of this option the number of parallel tests `np` has to be specified by means of `--pool=np`, the default is 1.
* LaTeX test were hanging for a.o. Hungarian on Windowsalbert-github2020-06-081-6/+13
| | | | | | On Windows a number of tests were hanging when using a language like Hungarian, Russian. The handling of the output of the output is now done differently for Windows and other OS A small (but obvious) error has been corrected (failed_html -> failed_latex), has no effect on the output / results though.
* issue #7464 1.8.17: test suite is failingalbert-github2020-01-011-7/+12
| | | | | | | | On Windows the syntax with the command and arguments in one string worked but on *nix (and Cygwin) it didn't. - changed calls to Popen to split command (see also: https://docs.python.org/3/library/subprocess.html). - explicitly specify files to check for xhtml - changed call to xmllint for xhtml and docbook (due to stdout overflow in some cases, we are not really interested in the, formatted, output of xmllint). - in the update part a `read` was left, should have been removed.
* Making tests valid for python 3albert-github2019-12-191-16/+38
| | | | | In #7254 the tests were made for python 3 for the standard xml tests, now this is extended for the other possible formats. The subprocess call gave some problems as it handles only 1 command and no redirection.
* Making tests valid for python 3albert-github2019-12-181-13/+39
| | | | | | | | | | | | | | | | | | | | | | | Test 65 gave some problems with python3: ``` Traceback (most recent call last): File "D:/Programs/Doxygen/Doxygen-.git/doxygen/testing/runtests.py", line 487, in <module> main() File "D:/Programs/Doxygen/Doxygen-.git/doxygen/testing/runtests.py", line 484, in main sys.exit(testManager.perform_tests()) File "D:/Programs/Doxygen/Doxygen-.git/doxygen/testing/runtests.py", line 388, in perform_tests tester = Tester(self.args,test) File "D:/Programs/Doxygen/Doxygen-.git/doxygen/testing/runtests.py", line 13, in __init__ self.config = self.get_config() File "D:/Programs/Doxygen/Doxygen-.git/doxygen/testing/runtests.py", line 71, in get_config for line in f.readlines(): File "D:\Programs\Python\Python37\lib\encodings\cp1252.py", line 23, in decode return codecs.charmap_decode(input,self.errors,decoding_table)[0] UnicodeDecodeError: 'charmap' codec can't decode byte 0x81 in position 236: character maps to <undefined> ``` this happened on multiple places and also with the `popen` command. Created, analogous to `doc/translator.py`, special open functions so that the code works for Python 2 and Python 3.
* chmod +x runtest.pyAdrian Negreanu2019-07-261-0/+0
|
* Create option to enable CLANG_ASISTED_PARSING in test suitealbert-github2019-04-281-0/+5
| | | | | | Create possibility to use CLANG_ASSISTED_PARSING, works only when doxygen has been compiled with "use_libclang" Note at this moment the test suite gives an error, see issue #6948
* Add possibility of checking XML against XSD in doxygen testsalbert-github2019-03-181-9/+66
| | | | Added option `--xmlxsd` to check generated XML files against XSD in the doxygen tests suite.
* Merge pull request #6743 from albert-github/feature/bug_sorting_testsDimitri van Heesch2019-01-051-1/+1
|\ | | | | Tests are unsorted
| * Tests are unsortedalbert-github2019-01-051-1/+1
| | | | | | | | When requesting all tests they are sorted in the way `glob.glob` returns them, i.e. unsorted, better, more intuitive and easier for finding problems, would be sorted.
* | Fixed alt attribute appearing in <object> tag for SVG imagesDimitri van Heesch2019-01-051-1/+1
|/
* Fixed missing end paragraph marker when inline image appeared as last item.Dimitri van Heesch2019-01-051-2/+3
|
* testing: make runtests.py executable.Vladimír Vondruš2018-12-291-0/+0
| | | | | | | | | | So one can do just ./runtests.py on Unix-like systems, instead of the unusual python runtests.py
* Merge branch 'master' into feature/bug_tests_extensionsDimitri van Heesch2018-09-151-0/+9
|\
| * Add possibility for adding doxygen configuration items to, all, tests during ↵albert-github2018-09-151-1/+10
| | | | | | | | | | | | runtime. Creating possibility to add extra doxygen configuration items to tests (e.g. QUIET=NO)
* | Extending tests with extra possibilitiesalbert-github2018-09-071-13/+104
|/ | | | | | | | | - docbook for docbook output including small test on validity (i.e. basic xml test) - rtf for rtf output - start_id and end_id creating the possibility to run one range of tests -- subdirs us CREATE_SUBDIRS=YES
* Problem with TEST_FLAGS when using CMake for Visual StudioTushar Maheshwari2018-05-131-1/+2
|
* Create test possibilities for xhtml and pdf outputalbert-github2018-04-031-3/+3
| | | | Regression of default output (INPUT setting was overruled).
* Create test possibilities for xhtml and pdf outputalbert-github2018-04-031-43/+164
| | | | | | The tests in the testing directory provided possibilities to do some regression tests based on the xml output. With the option --xhtml it is possible to see whether or not a test or set of tests is xhtml compliant. With the option --pdf it is possible to see whether or not a test or set of tests can be build to a pdf file (per test).
* runtests: Simplify dictionary usageBoris Egorov2015-08-201-4/+1
|
* Problem running tests under Windowsalbert-github2015-06-101-2/+6
| | | | | | The redirection used in the runtests.py script was based on *nix type systems. Corrected for windows. Windows has a different line ending than *nix, resulting in a problem with diff unless the options -b -w are used. Some tests had as directory for some paths a directory . this has been corrected to $INPUTDIR
* Support diff that returns "No differences encountered" when comparing test ↵Dimitri van Heesch2015-06-031-1/+1
| | | | results
* Fixes for running tests and generating docs with cmakeDimitri van Heesch2015-06-031-1/+1
|
* Added missing files and build instructionsDimitri van Heesch2015-05-311-0/+201