Performance of org.eclipse.team: I20070625-1500 relative to 3.2

RHEL 4.0 Sun 1.4.2_10 (3 GHz 2.5 GB)

Win XP Sun 1.4.2_10 (3 GHz 2 GB)

RHEL 3.0 Sun 1.4.2_10 (3 GHz 2 GB)

Win XP Sun 1.4.2_10 (2 GHz 512 MB)

RHEL 3.0 Sun 1.4.2_10 (2 GHz 512 MB)


Scenario Status

The following table gives a complete but compact view of performance results for the component.
Each line of the table shows the results for one scenario on all machines.

The name of the scenario is in bold when its results are also displayed in the fingerprints
and starts with an '*' when the scenario has no results in the last baseline run.

Here are information displayed for each test (ie. in each cell): Hints:

All 17 scenarios

RHEL 3.0 Sun 1.4.2_10 (2 GHz 512 MB)
RHEL 3.0 Sun 1.4.2_10 (3 GHz 2 GB)
RHEL 4.0 Sun 1.4.2_10 (3 GHz 2.5 GB)
Win XP Sun 1.4.2_10 (2 GHz 512 MB)
Win XP Sun 1.4.2_10 (3 GHz 2 GB)
SyncTests#testSync100NoUI()AddedFiles - 3.9% [±2.7] - 15.9% [±8.4] +17.2% [±5.5] +4.6% [±3.4] Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200706111606, jvm=sun}': Elapsed Process: 5.29s is not within [0%, 120%] of 4.06s - 30.3% [±11.6]
SyncTests#testSync100NoUI()ModifiedFiles - 0.4% [±8.2] +8.2% [±9.6] +13.1% [±4.6] +4.5% [±5.3] +16.0% [±6.8]
SyncTests#testSync100NoUI()RemovedFiles Performance criteria not met when compared to '{config=eclipseperflnx1_R3.3, build=3.2_200606291905_200706111606, jvm=sun}': Elapsed Process: 3.73s is not within [0%, 120%] of 2.62s - 42.1% [±7.1] - 1.9% [±12.8] +25.9% [±13.6] +1.7% [±5.7] - 3.2% [±8.1]
WorkflowTests#testBigWorkflowNoUI()Checkout +22.6% [±5.4] +21.5% [±4.9] +53.9% [±6.2] +28.0% [±4.4] +37.8% [±6.6]
WorkflowTests#testBigWorkflowNoUI()Commit1 - 13.1% [±12.5] Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200706111606, jvm=sun}': Elapsed Process: 3.9s is not within [0%, 120%] of 3.04s - 28.3% [±14.9] +41.9% [±15.4] +14.8% [±6.2] +28.6% [±8.7]
WorkflowTests#testBigWorkflowNoUI()Commit2 Performance criteria not met when compared to '{config=eclipseperflnx1_R3.3, build=3.2_200606291905_200706111606, jvm=sun}': Elapsed Process: 3.55s is not within [0%, 120%] of 2.74s - 29.6% [±14.0] Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200706111606, jvm=sun}': Elapsed Process: 3.8s is not within [0%, 120%] of 2.77s - 37.5% [±9.9] +19.1% [±6.3] - 3.2% [±5.8] +19.9% [±12.2]
WorkflowTests#testBigWorkflowNoUI()Commit3 Performance criteria not met when compared to '{config=eclipseperflnx1_R3.3, build=3.2_200606291905_200706111606, jvm=sun}': Elapsed Process: 3.14s is not within [0%, 120%] of 2.1s - 49.3% [±25.2] - 14.7% [±18.9] +41.5% [±14.7] +1.1% [±5.9] +14.7% [±8.9]
WorkflowTests#testBigWorkflowNoUI()Commit4 Performance criteria not met when compared to '{config=eclipseperflnx1_R3.3, build=3.2_200606291905_200706111606, jvm=sun}': Elapsed Process: 4.48s is not within [0%, 120%] of 3.11s - 44.2% [±17.8] - 11.3% [±10.2] +20.4% [±8.2] Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200706111606, jvm=sun}': Elapsed Process: 4.42s is not within [0%, 120%] of 3.09s - 43.2% [±7.8] +23.8% [±8.2]
WorkflowTests#testBigWorkflowNoUI()Replace1 +1.7% [±13.1] - 6.6% [±6.3] +39.4% [±10.2] +14.1% [±7.9] +18.1% [±10.1]
WorkflowTests#testBigWorkflowNoUI()Replace2 Performance criteria not met when compared to '{config=eclipseperflnx1_R3.3, build=3.2_200606291905_200706111606, jvm=sun}': Elapsed Process: 4.78s is not within [0%, 120%] of 3.2s - 49.4% [±21.4] - 14.3% [±10.6] +25.3% [±16.8] - 13.2% [±5.3] +6.0% [±15.7]
WorkflowTests#testBigWorkflowNoUI()Replace3 Performance criteria not met when compared to '{config=eclipseperflnx1_R3.3, build=3.2_200606291905_200706111606, jvm=sun}': Elapsed Process: 4.08s is not within [0%, 120%] of 2.6s - 56.6% [±17.8] Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200706111606, jvm=sun}': Elapsed Process: 3.48s is not within [0%, 120%] of 2.81s - 23.8% [±13.1] +10.5% [±12.7] - 19.6% [±9.0] +34.7% [±13.6]
WorkflowTests#testBigWorkflowNoUI()Share Performance criteria not met when compared to '{config=eclipseperflnx1_R3.3, build=3.2_200606291905_200706111606, jvm=sun}': Elapsed Process: 23.92s is not within [0%, 120%] of 14.42s - 65.9% [±11.6] Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200706111606, jvm=sun}': Elapsed Process: 22.65s is not within [0%, 120%] of 12.88s - 75.8% [±9.9] +5.1% [±6.8] +0.6% [±4.3] +27.2% [±5.9]
WorkflowTests#testBigWorkflowNoUI()Tag1 Performance criteria not met when compared to '{config=eclipseperflnx1_R3.3, build=3.2_200606291905_200706111606, jvm=sun}': Elapsed Process: 3.6s is not within [0%, 120%] of 1.84s - 95.4% [±22.8] Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200706111606, jvm=sun}': Elapsed Process: 3.63s is not within [0%, 120%] of 1.49s - 144.0% [±44.6] +0.0% [±18.8] Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200706111606, jvm=sun}': Elapsed Process: 3.18s is not within [0%, 120%] of 2.06s - 54.5% [±25.9] +56.8% [±11.5]
WorkflowTests#testBigWorkflowNoUI()Update1 Performance criteria not met when compared to '{config=eclipseperflnx1_R3.3, build=3.2_200606291905_200706111606, jvm=sun}': Elapsed Process: 4.49s is not within [0%, 120%] of 2.43s - 84.6% [±23.2] Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200706111606, jvm=sun}': Elapsed Process: 4.43s is not within [0%, 120%] of 2.48s - 78.7% [±23.7] +44.4% [±11.7] Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200706111606, jvm=sun}': Elapsed Process: 3.64s is not within [0%, 120%] of 2.82s - 28.9% [±5.3] +43.0% [±11.2]
WorkflowTests#testBigWorkflowNoUI()Update2 Performance criteria not met when compared to '{config=eclipseperflnx1_R3.3, build=3.2_200606291905_200706111606, jvm=sun}': Elapsed Process: 4.62s is not within [0%, 120%] of 2.3s - 101.1% [±24.8] Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200706111606, jvm=sun}': Elapsed Process: 3.53s is not within [0%, 120%] of 2.17s - 62.7% [±15.5] +33.2% [±14.6] - 16.6% [±4.1] +39.9% [±12.9]
WorkflowTests#testBigWorkflowNoUI()Update3 Performance criteria not met when compared to '{config=eclipseperflnx1_R3.3, build=3.2_200606291905_200706111606, jvm=sun}': Elapsed Process: 4.21s is not within [0%, 120%] of 2.27s - 85.5% [±21.7] Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200706111606, jvm=sun}': Elapsed Process: 4.05s is not within [0%, 120%] of 2.29s - 76.9% [±18.4] +37.7% [±12.8] Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200706111606, jvm=sun}': Elapsed Process: 3.34s is not within [0%, 120%] of 2.77s - 20.4% [±3.9] +45.5% [±13.6]
WorkflowTests#testBigWorkflowNoUI()Update4 Performance criteria not met when compared to '{config=eclipseperflnx1_R3.3, build=3.2_200606291905_200706111606, jvm=sun}': Elapsed Process: 5.18s is not within [0%, 120%] of 2.93s - 76.5% [±20.5] Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200706111606, jvm=sun}': Elapsed Process: 4.58s is not within [0%, 120%] of 2.96s - 54.5% [±14.6] +44.2% [±11.4] - 10.7% [±4.8] +39.4% [±13.6]