tree 60c27bed8e5dd3847ce74ce790bde03f31966878
parent 550c4ed1584428645b096efd224cc0af81214493
author jacek-lewandowski <jacek.lewandowski@datastax.com> 1611302128 +0100
committer Mick Semb Wever <mck@apache.org> 1611831652 +0100
gpgsig -----BEGIN PGP SIGNATURE-----
 
 iQIzBAABCgAdFiEEpMRl/qDFUlYaOSph6RM1134+h8sFAmASmWQACgkQ6RM1134+
 h8tTQBAAsdHuaPIvIW2rasKzYqQXIqnjMqMcCAoqvYpSRugniomwRNVXoZd8kxKO
 KcJvQO38pG+7LMoyxMKmbUx/qN61ooPGTfwm1NY8un7dqNLjUjV2tfSZ5WVoojSy
 /zchrzPLELhvAd0uvKatqznTu3/VyEL6FzIimIMxBWGKOLz4SY8v5c2LuGw+jGR7
 VBeq5bIkZy6LhLA+/74/rBg/U9dn3zoZR80oI00bj2suUT/rjonun/1JUHHEO5iB
 GJKlb/r3149RP0u0lfe9RA7s4h8yoCsJ1uknlJ/UUhBBMfSDJZjXYMBe/ORpVP+n
 FlgFrj49dZ4XgeHityFDtXSfuZ/f33GPGRIAnSs4XZcHhxIxZ6jehB1SZVfGTvmX
 jPbz7YwUD/YZJBw5sVRuoCgsSQhWAY/ggi9h/aQYaBoqoGQv0apTBJv6oLneph30
 lBdKhGlu2wq6ZlMvZ2PxEQFNlIDCxgHSsfIKTU4mO/D/tw1JErstxZ634dwkbu8z
 l6suBAhyTCNgBYocs9ate36LIKevZrIldupOLyE7rSCI7S8/Fi8hLVLnDWKkCsFs
 lWG/iDZ5wDUMA5wv5kd/WVAmQ/QppymZdTCfdqlZBmTBa+pUze3yVXBUQNtFy8+9
 J8e20BffdLOXQA6Exjlp+vPx9y6h9I12Hlxj0BY73Ng40AIu5oo=
 =7wto
 -----END PGP SIGNATURE-----

Listing tests (--collect-only and --dtest-print-tests-only) only lists tests that will run according to other arguments specified

This patch fixes behaviour for both `run_dtests.py` and `pytest`.
- Error handling for invalid parameter values / combinations is in a single place (`dtest_config.py`) and is executed before we actually traverse through the tests
- We exit with just a clean error message instead of tons of spam
- `run_dtests.sh` will not loose the exit code of `pytest` any more so we can clearly detect when test cases collection fails
- removed a bit of boilerplate code from `run_dtests.py`, e.g. what it did with xml processing is simply provided with `-q` argument of `pytest`
- tests filtering has been refactored to be cleaner
- fixed filtering of resource intensive tests and other tests (note that except for upgrade tests, we took care only about test method annotations - module level annotations were ignored for vnodes, no_vnodes, no_offheap_memtables and resource_intensive, ...)
- added meta_tests for the filtering and parsing exception handling
- added special parameter --metatests which is enough to run all the meta tests
- fixed Travis configuration so that it runs meta tests

Note that now `run_dtests.py` seems to be redundant. If we need it only for listing dtests, we can simply achieve exactly the same effect using `--collect-only -q --ignore=meta_tests` arguments for `pytest` instead of `--dtest-print-tests-only`, plus  we need to filter output with `grep '.py::'` (in order to not include the summary line) and pipe stdout to the target file. It is now simplified so `run_dtests.sh` just uses `pytest` with those arguments.

patch by Jacek Lewandowski; reviewed by Tomek Łasica and Mick Semb Wever for CASSANDRA-16399