Select which kind of scale you want to use: |
NaN
) or is infinite (happens when the reference value is equals to 0!)(build_test_time - baseline_test_time) / baseline_test_time
)sqrt(build_test_stddev^2 / N + baseline_test_stddev^2 / N) / baseline_test_time
)All 12 scenarios |
SUSE Linux Enterprise Server 12 (x86_64) |
*CollatorPerformanceTest#testCollator() (vs. I20180601-0915) | +12.5% [±42.3] |
*ComboViewerRefreshTest#testRefreshSmall() (vs. I20180601-0915) | +2.9% [±4.0] |
*FastTableViewerRefreshTest#testRefreshMultiple() (vs. I20180530-0200) | +52.9% [±0.6] |
*FastTableViewerRefreshTest#testUpdateMultiple() (vs. I20180530-0200) | +62.3% [±0.8] |
*FastTreeTest#testAddFiftyTenTimes() (vs. I20180530-0200) | - 1.3% [±2.3] |
*FastTreeTest#testAddHundredTenTimes() (vs. I20180530-0200) | Performance criteria not met when compared to 'I20180530-0200': Elapsed Process= 0.43s is not within [0%, 110'%] of 0.37s - 18.7% [±0.7] |
*FastTreeTest#testAddTenTenTimes() (vs. I20180530-0200) | - 9.9% [±7.0] |
*ListViewerRefreshTest#testRefresh() (vs. I20180530-0200) | +32.9% [±1.0] |
*ProgressMonitorDialogPerformanceTest#testLongNames() (vs. I20180601-0915) | Performance criteria not met when compared to 'I20180601-0915': Elapsed Process= 2.3s is not within [0%, 110'%] of 2s - 12.9% [±4.9] |
*ShrinkingTreeTest#testTreeViewerRefresh() (vs. I20180601-0915) | +2.8% [±4.1] |
*TreeAddTest#testAddThousand() (vs. I20180530-0200) | Performance criteria not met when compared to 'I20180530-0200': Elapsed Process= 0.42s is not within [0%, 110'%] of 0.33s - 27.6% [±2.0] |
*TreeAddTest#testAddThousandPreSort() (vs. I20180531-0700) | Performance criteria not met when compared to 'I20180531-0700': Elapsed Process= 0.39s is not within [0%, 110'%] of 0.33s - 19.2% [±9.1] |