Select which kind of scale you want to use: |
NaN
) or is infinite (happens when the reference value is equals to 0!)(build_test_time - baseline_test_time) / baseline_test_time
)sqrt(build_test_stddev^2 / N + baseline_test_stddev^2 / N) / baseline_test_time
)All 12 scenarios |
SLED 10 Sun 1.6.0_17 (2 x 3.00GHz - 3GB RAM) | RHEL 5.0 Sun 6.0_04 (2 x 3.00GHz - 3GB RAM) | Win XP Sun 1.6.0_17 (2 x 3.00GHz - 3GB RAM) | Win XP Sun 1.6.0_17 (2 x 3.00GHz - 3GB RAM) |
CollatorPerformanceTest#testCollator() | +2.6% [±1.7] | +1.3% [±0.9] | +3.9% [±1.8] | n/a |
ComboViewerRefreshTest#testRefreshSmall() | +4.0% [±0.2] | +1.7% [±0.2] | +0.3% [±0.4] | +0.0% [±0.1] |
FastTableViewerRefreshTest#testRefreshMultiple() | - 2.1% [±7.3] | - 1.2% [±8.9] | +13.7% [±1.2] | +7.5% [±1.3] |
FastTableViewerRefreshTest#testUpdateMultiple() | - 4.0% [±7.6] | +0.6% [±9.4] | +11.9% [±1.7] | +7.3% [±1.9] |
FastTreeTest#testAddFiftyTenTimes() | +3.4% [±0.8] | +0.9% [±13.2] | +55.1% [±1.6] | +0.0% [±4.2] |
FastTreeTest#testAddHundredTenTimes() | +1.7% [±0.6] | +1.3% [±0.8] | +47.7% [±1.4] | - 0.1% [±4.5] |
FastTreeTest#testAddTenTenTimes() | +0.0% [±3.0] | - 0.4% [±3.1] | +38.2% [±1.1] | - 0.1% [±2.1] |
ListViewerRefreshTest#testRefresh() | +4.0% [±0.2] | +4.3% [±0.2] | +0.0% [±1.0] | +0.3% [±1.8] |
ProgressMonitorDialogPerformanceTest#testLongNames() | Performance criteria not met when compared to 'R-3.6-201006080911_201110071800': Elapsed Process= 2.7s is not within [0%, 110'%] of 96ms - 2,752.1% [±2.5] | Performance criteria not met when compared to 'R-3.6-201006080911_201110071800': Elapsed Process= 4.3s is not within [0%, 110'%] of 0.15s - 2,833.6% [±2.8] | Performance criteria not met when compared to 'R-3.6-201006080911_201107151800': Elapsed Process= 0.1s is not within [0%, 110'%] of 3ms - 3,333.3% [±61.3] | Performance criteria not met when compared to 'R-3.6-201006080911_201110071800': Elapsed Process= 0.1s is not within [0%, 110'%] of 4ms - 2,400.0% [±46.5] |
ShrinkingTreeTest#testTreeViewerRefresh() | - 2.3% [±0.5] | +0.0% [±0.5] | +84.2% [±0.1] | n/a |
TreeAddTest#testAddThousand() | +2.0% [±0.3] | +1.5% [±0.3] | +44.4% [±0.2] | - 0.2% [±0.1] |
TreeAddTest#testAddThousandPreSort() | +1.8% [±0.3] | +1.2% [±0.2] | +46.4% [±0.4] | +0.0% [±0.1] |