Performance of org.eclipse.team: M20090211-1700 relative to 3.3 (200806171530)

Back to global results

The following fingerprints show results for the most representative tests of the org.eclipse.team component.
Select which kind of scale you want to use:

Scenario Status

The following table gives a complete but compact view of performance results for the component.
Each line of the table shows the results for one scenario on all machines.

The name of the scenario is in bold when its results are also displayed in the fingerprints
and starts with an '*' when the scenario has no results in the last baseline run.

Here are information displayed for each test (ie. in each cell): Hints:

All 17 scenarios

RHEL 3.0 Sun 1.4.2_10 (2 GHz 512 MB)
RHEL 3.0 Sun 1.4.2_10 (3 GHz 2 GB)
RHEL 4.0 Sun 1.4.2_10 (3 GHz 2.5 GB)
Win XP Sun 1.4.2_10 (2 GHz 512 MB)
Win XP Sun 1.4.2_10 (3 GHz 2 GB)
SyncTests#testSync100NoUI()AddedFiles +8.9% [±4.5] +5.1% [±5.2] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 2.9s is not within [0%, 110'%] of 2.6s - 10.9% [±5.7] n/a +4.6% [±4.9]
SyncTests#testSync100NoUI()ModifiedFiles - 9.9% [±10.1] - 9.5% [±8.9] +5.5% [±4.4] n/a Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 4.63s is not within [0%, 120%] of 3.11s - 48.9% [±11.1]
SyncTests#testSync100NoUI()RemovedFiles +2.4% [±6.2] - 1.5% [±7.2] +0.0% [±3.0] n/a Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 3.68s is not within [0%, 120%] of 2.86s - 28.6% [±7.7]
WorkflowTests#testBigWorkflowNoUI()Checkout Performance criteria not met when compared to '{config=eclipseperflnx1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 8.73s is not within [0%, 120%] of 6.73s - 29.8% [±8.6] Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 8.87s is not within [0%, 120%] of 4.27s - 107.9% [±14.9] Performance criteria not met when compared to '{config=eclipseperflnx3, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 5.68s is not within [0%, 120%] of 2.92s - 94.9% [±20.4] n/a Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 8.28s is not within [0%, 120%] of 5.19s - 59.5% [±21.8]
WorkflowTests#testBigWorkflowNoUI()Commit1 +16.4% [±8.8] - 8.2% [±12.1] - 9.5% [±13.0] n/a Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 4.44s is not within [0%, 120%] of 2.81s - 58.1% [±9.9]
WorkflowTests#testBigWorkflowNoUI()Commit2 - 1.8% [±2.8] - 9.1% [±4.3] - 3.3% [±4.9] n/a Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 3.7s is not within [0%, 110'%] of 3.1s - 18.3% [±2.1]
WorkflowTests#testBigWorkflowNoUI()Commit3 Performance criteria not met when compared to '{config=eclipseperflnx1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 2.61s is not within [0%, 120%] of 2.13s - 22.3% [±11.7] Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 2.49s is not within [0%, 120%] of 1.29s - 92.3% [±11.6] Performance criteria not met when compared to '{config=eclipseperflnx3, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 1.74s is not within [0%, 120%] of 1.2s - 45.9% [±13.0] n/a Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 3.28s is not within [0%, 120%] of 1.7s - 93.1% [±9.2]
WorkflowTests#testBigWorkflowNoUI()Commit4 +3.7% [±7.1] Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 3.61s is not within [0%, 120%] of 2.94s - 23.0% [±5.8] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 3.4s is not within [0%, 110'%] of 3s - 10.8% [±3.4] n/a Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 3.5s is not within [0%, 110'%] of 3s - 17.8% [±4.8]
WorkflowTests#testBigWorkflowNoUI()Replace1 - 7.4% [±21.2] +26.3% [±14.6] Performance criteria not met when compared to '{config=eclipseperflnx3, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 2.58s is not within [0%, 120%] of 1.82s - 41.5% [±29.1] n/a Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 3.88s is not within [0%, 120%] of 2.22s - 74.5% [±25.9]
WorkflowTests#testBigWorkflowNoUI()Replace2 Performance criteria not met when compared to '{config=eclipseperflnx1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 5.81s is not within [0%, 120%] of 2.15s - 170.7% [±19.8] Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 6.03s is not within [0%, 120%] of 2.12s - 184.2% [±18.3] Performance criteria not met when compared to '{config=eclipseperflnx3, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 4.96s is not within [0%, 120%] of 1.45s - 242.3% [±40.6] n/a Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 5.47s is not within [0%, 120%] of 2.03s - 169.8% [±18.8]
WorkflowTests#testBigWorkflowNoUI()Replace3 Performance criteria not met when compared to '{config=eclipseperflnx1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 2.9s is not within [0%, 120%] of 1.71s - 69.8% [±15.4] Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 2.26s is not within [0%, 120%] of 1.85s - 22.0% [±18.9] Performance criteria not met when compared to '{config=eclipseperflnx3, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 2.03s is not within [0%, 120%] of 1.3s - 56.0% [±19.0] n/a Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 3.36s is not within [0%, 120%] of 1.66s - 102.0% [±14.6]
WorkflowTests#testBigWorkflowNoUI()Share Performance criteria not met when compared to '{config=eclipseperflnx1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 16.11s is not within [0%, 120%] of 13.12s - 22.8% [±6.7] Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 17.09s is not within [0%, 120%] of 12.66s - 35.0% [±7.8] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 11.9s is not within [0%, 110'%] of 10s - 19.2% [±9.0] n/a Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 23.23s is not within [0%, 120%] of 12.68s - 83.2% [±16.9]
WorkflowTests#testBigWorkflowNoUI()Tag1 - 9.3% [±11.7] +10.7% [±11.6] Performance criteria not met when compared to '{config=eclipseperflnx3, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 1.36s is not within [0%, 120%] of 1.11s - 22.7% [±19.8] n/a Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 1.88s is not within [0%, 120%] of 1.49s - 25.8% [±7.4]
WorkflowTests#testBigWorkflowNoUI()Update1 +0.8% [±3.4] +4.4% [±9.1] - 4.6% [±7.8] n/a - 0.5% [±4.1]
WorkflowTests#testBigWorkflowNoUI()Update2 +3.3% [±3.3] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 2.3s is not within [0%, 110'%] of 2s - 10.4% [±7.0] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 1.9s is not within [0%, 110'%] of 1.7s - 11.1% [±8.2] n/a - 9.5% [±4.0]
WorkflowTests#testBigWorkflowNoUI()Update3 - 1.3% [±5.2] - 6.1% [±5.3] - 9.3% [±6.7] n/a - 7.8% [±4.2]
WorkflowTests#testBigWorkflowNoUI()Update4 - 2.2% [±4.6] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 2.9s is not within [0%, 110'%] of 2.6s - 11.2% [±5.7] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 2.4s is not within [0%, 110'%] of 2.1s - 13.4% [±4.6] n/a Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 4.29s is not within [0%, 120%] of 2.89s - 48.6% [±4.9]