Select which kind of scale you want to use: |
NaN
) or is infinite (happens when the reference value is equals to 0!)(build_test_time - baseline_test_time) / baseline_test_time
)sqrt(build_test_stddev^2 / N + baseline_test_stddev^2 / N) / baseline_test_time
)All 5 scenarios |
SLED 10 Sun 1.6.0_17 (2 x 3.00GHz - 3GB RAM) | RHEL 5.0 Sun 6.0_04 (2 x 3.00GHz - 3GB RAM) | Win XP Sun 1.6.0_17 (2 x 3.00GHz - 3GB RAM) | Win XP Sun 1.6.0_17 (2 x 3.00GHz - 3GB RAM) |
OpenManifestEditorPerfTest#testEditorOpenMF() | - 6.3% [±1.3] | - 6.7% [±1.3] | +1.4% [±2.0] | +48.1% [±16.5] |
OpenManifestEditorPerfTest#testEditorOpenXML() | - 1.7% [±0.9] | - 1.1% [±0.9] | +4.0% [±0.9] | +26.5% [±9.5] |
SchemaLoaderPerfTest#testSchemaAbbreviated() | +0.0% [±0.2] | +0.0% [±0.1] | +0.8% [±0.1] | +46.8% [±3.1] |
SchemaLoaderPerfTest#testSchemaUnabbreviated() | Performance criteria not met when compared to 'R-3.6-201006080911_201106021708': Elapsed Process= 0.25s is not within [0%, 110'%] of 0.22s - 11.3% [±0.2] | Performance criteria not met when compared to 'R-3.6-201006080911_201106021708': Elapsed Process= 0.25s is not within [0%, 110'%] of 0.23s - 10.6% [±0.1] | Performance criteria not met when compared to 'R-3.6-201006080911_201105201800': Elapsed Process= 0.24s is not within [0%, 110'%] of 0.22s - 14.0% [±0.2] | +2.0% [±1.0] |
SchemaTraversePerfTest#testSchemaTraverse() | +0.0% [±0.2] | +0.0% [±0.2] | +1.6% [±0.2] | +45.4% [±3.6] |