Select which kind of scale you want to use: |
NaN
) or is infinite (happens when the reference value is equals to 0!)(build_test_time - baseline_test_time) / baseline_test_time
)sqrt(build_test_stddev^2 / N + baseline_test_stddev^2 / N) / baseline_test_time
)All 8 scenarios |
SUSE Linux Enterprise Server 11 (x86_64) |
*OpenManifestEditorPerfTest#testEditorOpenMF() (vs. R-4.5.2-201509040015) | - 1.3% [±5.6] |
*OpenManifestEditorPerfTest#testEditorOpenXML() (vs. R-4.5.2-201509040015) | +4.8% [±3.9] |
*PDEModelManagerPerfTest#testModelManagerLoad() (vs. N20160309-2000) | +25.7% [n/a] |
*SchemaLoaderPerfTest#testSchemaAbbreviated() (vs. R-4.5.2-201509040015) | +6.7% [±6.4] |
*SchemaLoaderPerfTest#testSchemaUnabbreviated() (vs. R-4.5.2-201509040015) | - 2.0% [±2.0] |
*SchemaTraversePerfTest#testSchemaTraverse() (vs. R-4.5.2-201509040015) | - 7.1% [±6.7] |
*TargetPlatformPerfTest#testResolveTargetDefinition() (vs. R-4.5.2-201509040015) | Performance criteria not met when compared to 'R-4.5.2-201509040015': Elapsed Process= 0.38s is not within [0%, 110'%] of 0.3s - 26.3% [±2.9] |
*TargetPlatformPerfTest#testSearchModelRegistry() (vs. R-4.5.2-201509040015) | Performance criteria not met when compared to 'R-4.5.2-201509040015': Elapsed Process= 0.1s is not within [0%, 110'%] of 93ms - 10.8% [±6.0] |