): mark a successful result, which means this test has neither significant performance regression nor significant standard error
): mark a failing result, which means this test shows a significant performance regression (more than 10%)
): mark a failing result (see above) with a comment explaining this degradation.
or
): mark a failing or successful result with a significant standard error (more than 3%)
): mark an undefined result, which means that deviation on this test is not a number (NaN) or is infinite (happens when the reference value is equals to 0!)(build_test_time - baseline_test_time) / baseline_test_time)sqrt(build_test_stddev^2 / N + baseline_test_stddev^2 / N) / baseline_test_time)