3rd-party/catch2
1
0
Fork 0
mirror of https://github.com/catchorg/Catch2.git synced 2025-08-03 13:55:39 +02:00
Code Issues Packages Projects Releases Wiki Activity

Document that the default test run order is now random

Browse Source
This commit is contained in:
Martin Hořeňovský
2025-07-24 21:55:30 +02:00
parent 2a8a8a7210
commit bdc634e9f1
1 changed files with 9 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files

12
docs/command-line.md
View File

@@ -398,18 +398,24 @@ use test specs to filter this list down to what you want first.
Test cases are ordered one of three ways: Test cases are ordered one of three ways:
### decl ### decl
Declaration order (this is the default order if no --order argument is provided). Declaration order.
Tests in the same translation unit are sorted using their declaration orders, Tests in the same translation unit are sorted using their declaration orders,
different TUs are sorted in an implementation (linking) dependent order. different TUs are sorted in an implementation (linking) dependent order.
### lex ### lex
Lexicographic order. Tests are sorted by their name, their tags are ignored. Lexicographic order.
Tests are sorted by their name, their tags are ignored.
### rand ### rand
Randomized order. The default order.
Randomly ordered. The order is dependent on Catch2's random seed (see > Randomized order has been made default in Catch2 X.Y.Z
The order is dependent on Catch2's random seed (see
[`--rng-seed`](#rng-seed)), and is subset invariant. What this means [`--rng-seed`](#rng-seed)), and is subset invariant. What this means
is that as long as the random seed is fixed, running only some tests is that as long as the random seed is fixed, running only some tests
(e.g. via tag) does not change their relative order. (e.g. via tag) does not change their relative order.