If running tests with "make -j<N> fate", the execution will stop after the first failing test. To get an overview of the whole test suite, one rather would run "make -k -j<N> fate", which then again buries the results about what tests actually failed further up in the console log. Add a target so one can run "make fate-list-failing", to see a list of all tests that failed the last time they were executed. Also add a companion target "fate-clear-reports" which removes all the old test reports. (When executing a subset of tests, the report files of all tests that aren't executed stay untouched. This also allows getting rid of reports for tests that no longer are present in the testsuite.) Co-authored-by: Alexander Strasser <eclipse7@gmx.net>
Showing the changes to tests (1 of 3 files). Show all
Unified · Split
| @@ -313,6 +313,12 @@ $(FATE): $(FATE_UTILS:%=tests/%$(HOSTEXESUF)) | $(FATE_OUTDIRS) · 312 unmodified lines | ||
| 313 | 313 | fate-list: |
| 314 | 314 | @printf '%s\n' $(sort $(FATE)) |
| 315 | 315 | |
| 316 | +fate-list-failing: | |
| 317 | + @! ls tests/data/fate/*.rep >/dev/null 2>&1 || awk -F: '$$2 != 0 { print "fate-" $$1 }' tests/data/fate/*.rep | |
| 318 | + | |
| 319 | +fate-clear-reports: | |
| 320 | + @rm -f tests/data/fate/*.rep | |
| 321 | + | |
| 316 | 322 | coverage.info: TAG = LCOV |
| 317 | 323 | coverage.info: |
| 318 | 324 | $(M)lcov -q -d $(CURDIR) -b $(patsubst src%,./,$(SRC_LINK)) --capture | \ |