Select which kind of scale you want to use: |
NaN
) or is infinite (happens when the reference value is equals to 0!)(build_test_time - baseline_test_time) / baseline_test_time
)sqrt(build_test_stddev^2 / N + baseline_test_stddev^2 / N) / baseline_test_time
)All 17 scenarios |
SLED 10 Sun 1.6.0_17 (2 x 3.00GHz - 3GB RAM) | RHEL 5.0 Sun 6.0_04 (2 x 3.00GHz - 3GB RAM) | Win XP Sun 1.6.0_17 (2 x 3.00GHz - 3GB RAM) | Win XP Sun 1.6.0_17 (2 x 3.00GHz - 3GB RAM) |
SyncTests#testSync100NoUI()AddedFiles | +11.3% [±2.2] | - 0.8% [±3.4] | n/a | n/a |
SyncTests#testSync100NoUI()ModifiedFiles | Performance criteria not met when compared to 'R-3.6-201006080911_201106021708': Elapsed Process= 2.9s is not within [0%, 110'%] of 2.5s - 17.4% [±5.9] | Performance criteria not met when compared to 'R-3.6-201006080911_201106021708': Elapsed Process= 2.8s is not within [0%, 110'%] of 2.2s - 28.1% [±4.8] | n/a | n/a |
SyncTests#testSync100NoUI()RemovedFiles | - 0.6% [±6.3] | Performance criteria not met when compared to 'R-3.6-201006080911_201106021708': Elapsed Process= 2.8s is not within [0%, 110'%] of 2.1s - 33.4% [±4.3] | n/a | n/a |
WorkflowTests#testBigWorkflowNoUI()Checkout | +7.7% [±3.5] | +5.5% [±1.9] | n/a | n/a |
WorkflowTests#testBigWorkflowNoUI()Commit1 | Performance criteria not met when compared to 'R-3.6-201006080911_201106021708': Elapsed Process= 1.7s is not within [0%, 110'%] of 1.5s - 11.3% [±14.5] | +19.6% [±11.6] | n/a | n/a |
WorkflowTests#testBigWorkflowNoUI()Commit2 | - 4.0% [±9.4] | +4.5% [±5.6] | n/a | n/a |
WorkflowTests#testBigWorkflowNoUI()Commit3 | +25.3% [±8.2] | +4.5% [±8.9] | n/a | n/a |
WorkflowTests#testBigWorkflowNoUI()Commit4 | +12.6% [±11.7] | +1.4% [±10.5] | n/a | n/a |
WorkflowTests#testBigWorkflowNoUI()Replace1 | +5.7% [±1.5] | +1.9% [±1.7] | n/a | n/a |
WorkflowTests#testBigWorkflowNoUI()Replace2 | - 2.9% [±7.7] | +2.2% [±1.7] | n/a | n/a |
WorkflowTests#testBigWorkflowNoUI()Replace3 | - 2.0% [±8.7] | - 1.0% [±1.8] | n/a | n/a |
WorkflowTests#testBigWorkflowNoUI()Share | +9.6% [±2.3] | +7.0% [±1.4] | n/a | n/a |
WorkflowTests#testBigWorkflowNoUI()Tag1 | +4.9% [±0.7] | +4.4% [±0.5] | n/a | n/a |
WorkflowTests#testBigWorkflowNoUI()Update1 | +14.0% [±2.2] | +8.8% [±2.7] | n/a | n/a |
WorkflowTests#testBigWorkflowNoUI()Update2 | +0.0% [±2.3] | - 4.7% [±1.6] | n/a | n/a |
WorkflowTests#testBigWorkflowNoUI()Update3 | +2.7% [±3.2] | +5.9% [±3.2] | n/a | n/a |
WorkflowTests#testBigWorkflowNoUI()Update4 | +12.4% [±2.3] | +3.7% [±1.4] | n/a | n/a |