Select which kind of scale you want to use: |
NaN
) or is infinite (happens when the reference value is equals to 0!)(build_test_time - baseline_test_time) / baseline_test_time
)sqrt(build_test_stddev^2 / N + baseline_test_stddev^2 / N) / baseline_test_time
)All 17 scenarios |
SLED 10 Sun 1.6.0_17 (2 x 3.00GHz - 3GB RAM) | RHEL 5.0 Sun 6.0_04 (2 x 3.00GHz - 3GB RAM) | Win XP Sun 1.6.0_17 (2 x 3.00GHz - 3GB RAM) | Win XP Sun 1.6.0_17 (2 x 3.00GHz - 3GB RAM) |
SyncTests#testSync100NoUI()AddedFiles | +3.9% [±2.6] | +3.3% [±2.7] | n/a | n/a |
SyncTests#testSync100NoUI()ModifiedFiles | Performance criteria not met when compared to 'R-3.6-201006080911_201109021800': Elapsed Process= 3s is not within [0%, 110'%] of 2.3s - 28.8% [±5.9] | Performance criteria not met when compared to 'R-3.6-201006080911_201109021800': Elapsed Process= 2.8s is not within [0%, 110'%] of 2.1s - 29.4% [±4.7] | n/a | n/a |
SyncTests#testSync100NoUI()RemovedFiles | Performance criteria not met when compared to 'R-3.6-201006080911_201109021800': Elapsed Process= 2.9s is not within [0%, 110'%] of 2.3s - 26.1% [±4.9] | Performance criteria not met when compared to 'R-3.6-201006080911_201109021800': Elapsed Process= 2.8s is not within [0%, 110'%] of 2.1s - 33.9% [±1.4] | n/a | n/a |
WorkflowTests#testBigWorkflowNoUI()Checkout | +6.9% [±2.1] | +2.3% [±3.2] | n/a | n/a |
WorkflowTests#testBigWorkflowNoUI()Commit1 | +0.0% [±14.4] | +15.4% [±12.0] | n/a | n/a |
WorkflowTests#testBigWorkflowNoUI()Commit2 | - 8.3% [±9.3] | +7.3% [±6.1] | n/a | n/a |
WorkflowTests#testBigWorkflowNoUI()Commit3 | +28.4% [±8.0] | +10.8% [±14.9] | n/a | n/a |
WorkflowTests#testBigWorkflowNoUI()Commit4 | +16.6% [±10.0] | - 4.8% [±10.9] | n/a | n/a |
WorkflowTests#testBigWorkflowNoUI()Replace1 | +8.4% [±3.7] | +2.5% [±1.4] | n/a | n/a |
WorkflowTests#testBigWorkflowNoUI()Replace2 | +5.6% [±5.8] | +3.5% [±2.3] | n/a | n/a |
WorkflowTests#testBigWorkflowNoUI()Replace3 | +2.1% [±3.6] | +2.4% [±2.0] | n/a | n/a |
WorkflowTests#testBigWorkflowNoUI()Share | +4.0% [±1.9] | +2.0% [±1.2] | n/a | n/a |
WorkflowTests#testBigWorkflowNoUI()Tag1 | +5.5% [±0.5] | +9.6% [±4.0] | n/a | n/a |
WorkflowTests#testBigWorkflowNoUI()Update1 | +4.0% [±3.3] | +5.1% [±2.7] | n/a | n/a |
WorkflowTests#testBigWorkflowNoUI()Update2 | +3.7% [±1.8] | - 6.0% [±1.8] | n/a | n/a |
WorkflowTests#testBigWorkflowNoUI()Update3 | - 1.0% [±3.2] | +3.3% [±1.2] | n/a | n/a |
WorkflowTests#testBigWorkflowNoUI()Update4 | +18.4% [±5.5] | +7.1% [±2.1] | n/a | n/a |