diff --git a/docs/benchmarks.md b/docs/benchmarks.md index bb999367..295bba30 100644 --- a/docs/benchmarks.md +++ b/docs/benchmarks.md @@ -1,6 +1,8 @@ # Authoring benchmarks +> [Introduced](https://github.com/catchorg/Catch2/issues/1616) in Catch 2.9.0. + _Note that benchmarking support is disabled by default and to enable it, you need to define `CATCH_CONFIG_ENABLE_BENCHMARKING`. For more details, see the [compile-time configuration documentation](configuration.md#top)._ diff --git a/docs/command-line.md b/docs/command-line.md index 5d77b714..d204da0e 100644 --- a/docs/command-line.md +++ b/docs/command-line.md @@ -277,6 +277,8 @@ either before running any tests, after running all tests - or both, depending on ## Specify the number of benchmark samples to collect
--benchmark-samples <# of samples>
+> [Introduced](https://github.com/catchorg/Catch2/issues/1616) in Catch 2.9.0. + When running benchmarks a number of "samples" is collected. This is the base data for later statistical analysis. Per sample a clock resolution dependent number of iterations of the user code is run, which is independent of the number of samples. Defaults to 100. @@ -284,6 +286,8 @@ Per sample a clock resolution dependent number of iterations of the user code is ## Specify the number of resamples for bootstrapping
--benchmark-resamples <# of resamples>
+> [Introduced](https://github.com/catchorg/Catch2/issues/1616) in Catch 2.9.0. + After the measurements are performed, statistical [bootstrapping] is performed on the samples. The number of resamples for that bootstrapping is configurable but defaults to 100000. Due to the bootstrapping it is possible to give @@ -297,6 +301,8 @@ defaults to 95%). ## Specify the confidence-interval for bootstrapping
--benchmark-confidence-interval <confidence-interval>
+> [Introduced](https://github.com/catchorg/Catch2/issues/1616) in Catch 2.9.0. + The confidence-interval is used for statistical bootstrapping on the samples to calculate the upper and lower bounds of mean and standard deviation. Must be between 0 and 1 and defaults to 0.95. @@ -305,6 +311,8 @@ Must be between 0 and 1 and defaults to 0.95. ## Disable statistical analysis of collected benchmark samples
--benchmark-no-analysis
+> [Introduced](https://github.com/catchorg/Catch2/issues/1616) in Catch 2.9.0. + When this flag is specified no bootstrapping or any other statistical analysis is performed. Instead the user code is only measured and the plain mean from the samples is reported. diff --git a/docs/test-cases-and-sections.md b/docs/test-cases-and-sections.md index b7f79ef1..bce2978e 100644 --- a/docs/test-cases-and-sections.md +++ b/docs/test-cases-and-sections.md @@ -194,6 +194,8 @@ is very high and should not be encountered in practice._ * **TEMPLATE_LIST_TEST_CASE(** _test name_, _tags_, _type list_ **)** +> [Introduced](https://github.com/catchorg/Catch2/issues/1627) in Catch 2.9.0. + _type list_ is a generic list of types on which test case should be instantiated. List can be `std::tuple`, `boost::mpl::list`, `boost::mp11::mp_list` or anything with `template ` signature.