Select which kind of scale you want to use: |
NaN
) or is infinite (happens when the reference value is equals to 0!)(build_test_time - baseline_test_time) / baseline_test_time
)sqrt(build_test_stddev^2 / N + baseline_test_stddev^2 / N) / baseline_test_time
)All 12 scenarios |
SLED 10 Sun 1.5.0_10 (2 x 3.00GHz - 3GB RAM) | RHEL 5.0 Sun 6.0_04 (2 x 3.00GHz - 3GB RAM) | Win XP Sun 1.5.0_10 (2 x 3.00GHz - 3GB RAM) |
*CollatorPerformanceTest#testCollator() (vs. R-3.4-200806172000_200911301800) | +0.5% [±0.7] | +3.7% [±1.6] | +1.7% [±1.8] |
*ComboViewerRefreshTest#testRefreshSmall() (vs. R-3.4-200806172000_200911301800) | - 2.1% [±0.3] | - 1.9% [±0.2] | - 0.7% [±0.7] |
*FastTableViewerRefreshTest#testRefreshMultiple() (vs. R-3.4-200806172000_200911301800) | - 5.3% [±7.9] | Performance criteria not met when compared to 'R-3.4-200806172000_200911301800': Elapsed Process= 1.2s is not within [0%, 110'%] of 1.1s - 10.2% [±10.9] | - 3.4% [±1.5] |
*FastTableViewerRefreshTest#testUpdateMultiple() (vs. R-3.4-200806172000_200911301800) | - 4.9% [±8.0] | - 4.9% [±10.5] | - 4.2% [±1.7] |
*FastTreeTest#testAddFiftyTenTimes() (vs. R-3.4-200806172000_200911301800) | - 1.2% [±0.8] | Performance criteria not met when compared to 'R-3.4-200806172000_200911301800': Elapsed Process= 0.6s is not within [0%, 110'%] of 0.22s - 167.1% [±10.9] | +1.0% [±6.4] |
*FastTreeTest#testAddHundredTenTimes() (vs. R-3.4-200806172000_200911301800) | - 3.4% [±0.7] | Performance criteria not met when compared to 'R-3.4-200806172000_200911301800': Elapsed Process= 0.75s is not within [0%, 110'%] of 0.32s - 135.0% [±3.7] | +0.2% [±6.6] |
*FastTreeTest#testAddTenTenTimes() (vs. R-3.4-200806172000_200911301800) | - 0.4% [±3.1] | - 5.6% [±3.0] | +9.7% [±3.8] |
*ListViewerRefreshTest#testRefresh() (vs. R-3.4-200806172000_200911301800) | - 3.8% [±0.2] | - 7.6% [±0.4] | +0.0% [±1.5] |
*ProgressMonitorDialogPerformanceTest#testLongNames() (vs. R-3.4-200806172000_200911301800) | - 1.1% [±2.8] | - 1.3% [±3.7] | +25.0% [±24.8] |
*ShrinkingTreeTest#testTreeViewerRefresh() (vs. R-3.4-200806172000_200911301800) | +0.0% [±0.7] | +0.0% [±0.6] | +0.5% [±0.0] |
*TreeAddTest#testAddThousand() (vs. R-3.4-200806172000_200911301800) | - 3.3% [±0.4] | Performance criteria not met when compared to 'R-3.4-200806172000_200911301800': Elapsed Process= 0.32s is not within [0%, 110'%] of 0.27s - 19.3% [±0.7] | - 5.0% [±0.3] |
*TreeAddTest#testAddThousandPreSort() (vs. R-3.4-200806172000_200911301800) | - 3.5% [±0.4] | Performance criteria not met when compared to 'R-3.4-200806172000_200911301800': Elapsed Process= 0.29s is not within [0%, 110'%] of 0.24s - 17.6% [±0.2] | - 5.5% [±0.2] |