Select which kind of scale you want to use: |
NaN
) or is infinite (happens when the reference value is equals to 0!)(build_test_time - baseline_test_time) / baseline_test_time
)sqrt(build_test_stddev^2 / N + baseline_test_stddev^2 / N) / baseline_test_time
)All 8 scenarios |
SUSE Linux Enterprise Server 12 (x86_64) |
*BreakpointManagerPerfTests#testStartup100Breakpoints() (vs. I20181001-0920) | +0.0% [±0.0] |
*BreakpointManagerPerfTests#testStartup200Breakpoints() (vs. I20181001-0920) | Performance criteria not met when compared to 'I20181001-0920': Elapsed Process= 3ms is not within [0%, 110'%] of 2ms - 20.0% [±0.0] |
*BreakpointManagerPerfTests#testStartup50Breakpoints() (vs. I20181001-0920) | +33.3% [±0.0] |
*PerfConsoleTests#testProcessConsolePlainOutput10000Lines() (vs. I20181001-0920) | Performance criteria not met when compared to 'I20181001-0920': Elapsed Process= 1.1s is not within [0%, 110'%] of 0.92s - 15.7% [±0.2] |
*PerfConsoleTests#testProcessConsoleStackTraceOutput10000Lines() (vs. I20181001-0920) | Performance criteria not met when compared to 'I20181001-0920': Elapsed Process= 1.6s is not within [0%, 110'%] of 1.3s - 22.4% [±0.1] |
*PerfConsoleTests#testProcessConsoleWrappedOutput10000Lines() (vs. I20181001-0920) | Performance criteria not met when compared to 'I20181001-0920': Elapsed Process= 1s is not within [0%, 110'%] of 0.81s - 28.2% [±0.1] |
*PerfContextualLaunchMenu#testContextualLaunchMenu() (vs. I20181001-0920) | Performance criteria not met when compared to 'I20181001-0920': Elapsed Process= 0.13s is not within [0%, 110'%] of 0.11s - 12.4% [±2.2] |
*PerfVariableDetailTests#testToStringDetails() (vs. I20181001-0920) | - 8.5% [±0.0] |