Select which kind of scale you want to use: |
NaN
) or is infinite (happens when the reference value is equals to 0!)(build_test_time - baseline_test_time) / baseline_test_time
)sqrt(build_test_stddev^2 / N + baseline_test_stddev^2 / N) / baseline_test_time
)All 8 scenarios |
SUSE Linux Enterprise Server 12 (x86_64) |
*OpenManifestEditorPerfTest#testEditorOpenMF() (vs. I20181001-0920) | +8.7% [±0.3] |
*OpenManifestEditorPerfTest#testEditorOpenXML() (vs. I20181001-0920) | - 3.9% [±0.1] |
*PDEModelManagerPerfTest#testModelManagerLoad() (vs. I20181001-0920) | Performance criteria not met when compared to 'I20181001-0920': Elapsed Process= 4.2s is not within [0%, 110'%] of 3.3s - 28.3% [±38.5] |
*SchemaLoaderPerfTest#testSchemaAbbreviated() (vs. I20181001-0920) | +8.6% [±0.0] |
*SchemaLoaderPerfTest#testSchemaUnabbreviated() (vs. I20181001-0920) | - 2.9% [±0.0] |
*SchemaTraversePerfTest#testSchemaTraverse() (vs. I20181001-0920) | Performance criteria not met when compared to 'I20181001-0920': Elapsed Process= 17ms is not within [0%, 110'%] of 15ms - 12.9% [±0.0] |
*TargetPlatformPerfTest#testResolveTargetDefinition() (vs. I20181001-0920) | +4.6% [±0.1] |
*TargetPlatformPerfTest#testSearchModelRegistry() (vs. I20181001-0920) | +3.8% [±0.0] |