| Select which kind of scale you want to use: |
Help on fingerprints

): mark a successful result, which means this test has neither significant performance regression nor significant standard error
): mark a failing result, which means this test shows a significant performance regression (more than 10%)
): mark a failing result (see above) with a comment explaining this degradation.
or
): mark a failing or successful result with a significant standard error (more than 3%)
): mark an undefined result, which means that deviation on this test is not a number (NaN) or is infinite (happens when the reference value is equals to 0!)(build_test_time - baseline_test_time) / baseline_test_time)sqrt(build_test_stddev^2 / N + baseline_test_stddev^2 / N) / baseline_test_time)All 8 scenarios |
SUSE Linux Enterprise Server 12 (x86_64) |
| *OpenManifestEditorPerfTest#testEditorOpenMF() (vs. I20181001-0920) |
+8.7% [±0.3]
|
| *OpenManifestEditorPerfTest#testEditorOpenXML() (vs. I20181001-0920) |
- 3.9% [±0.1]
|
| *PDEModelManagerPerfTest#testModelManagerLoad() (vs. I20181001-0920) |
Performance criteria not met when compared to 'I20181001-0920': Elapsed Process= 4.2s is not within [0%, 110'%] of 3.3s
- 28.3% [±38.5]
|
| *SchemaLoaderPerfTest#testSchemaAbbreviated() (vs. I20181001-0920) |
+8.6% [±0.0]
|
| *SchemaLoaderPerfTest#testSchemaUnabbreviated() (vs. I20181001-0920) |
- 2.9% [±0.0]
|
| *SchemaTraversePerfTest#testSchemaTraverse() (vs. I20181001-0920) |
Performance criteria not met when compared to 'I20181001-0920': Elapsed Process= 17ms is not within [0%, 110'%] of 15ms
- 12.9% [±0.0]
|
| *TargetPlatformPerfTest#testResolveTargetDefinition() (vs. I20181001-0920) |
+4.6% [±0.1]
|
| *TargetPlatformPerfTest#testSearchModelRegistry() (vs. I20181001-0920) |
+3.8% [±0.0]
|