Performance of org.eclipse.team: M20070921-1145 relative to 3.2

RHEL 4.0 Sun 1.4.2_10 (3 GHz 2.5 GB)

Win XP Sun 1.4.2_10 (3 GHz 2 GB)

RHEL 3.0 Sun 1.4.2_10 (3 GHz 2 GB)

Win XP Sun 1.4.2_10 (2 GHz 512 MB)

RHEL 3.0 Sun 1.4.2_10 (2 GHz 512 MB)

Scenario Status

• an icon showing whether the test fails or passes and whether it's reliable or not.
  The legend for this icon is:
  • Green (): mark a successful result, which means this test has neither significant performance regression nor significant standard error
  • Red (): mark a failing result, which means this test shows a significant performance regression (more than 10%)
  • Gray (): mark a failing result (see above) with a comment explaining this degradation.
  • Yellow ( or ): mark a failing or successful result with a significant standard error (more than 3%)
  • Black (): mark an undefined result, which means that deviation on this test is not a number (NaN) or is infinite (happens when the reference value is equals to 0!)
  • "n/a": mark a test for with no performance results
• the value of the deviation from the baseline as a percentage (ie. formula is: (build_test_time - baseline_test_time) / baseline_test_time)
• the value of the standard error of this deviation as a percentage (ie. formula is: sqrt(build_test_stddev^2 / N + baseline_test_stddev^2 / N) / baseline_test_time)
  When test only has one measure, the standard error cannot be computed and is replaced with a '[n/a]'.

• fly over image of failing tests to see the complete error message
• to look at the complete and detailed test results, click on its image

All 17 scenarios	RHEL 3.0 Sun 1.4.2_10 (2 GHz 512 MB)	RHEL 3.0 Sun 1.4.2_10 (3 GHz 2 GB)	RHEL 4.0 Sun 1.4.2_10 (3 GHz 2.5 GB)	Win XP Sun 1.4.2_10 (2 GHz 512 MB)	Win XP Sun 1.4.2_10 (3 GHz 2 GB)
SyncTests#testSync100NoUI()AddedFiles	- 9.3% [±5.4]	+11.9% [±3.7]	+11.6% [±4.2]	+9.0% [±3.3]	+38.3% [±7.0]
SyncTests#testSync100NoUI()ModifiedFiles	- 14.8% [±9.5]	+30.7% [±4.7]	+11.8% [±2.9]	+8.6% [±5.8]	+53.2% [±10.1]
SyncTests#testSync100NoUI()RemovedFiles	- 18.6% [±7.3]	+33.1% [±4.3]	+15.9% [±3.9]	+6.1% [±8.2]	+49.0% [±8.1]
WorkflowTests#testBigWorkflowNoUI()Checkout	+54.7% [±4.2]	+64.8% [±3.3]	+67.3% [±4.2]	+48.7% [±2.9]	+60.6% [±7.3]
WorkflowTests#testBigWorkflowNoUI()Commit1	- 2.2% [±6.7]	+12.9% [±7.5]	+33.1% [±16.5]	+16.7% [±7.2]	+23.9% [±7.7]
WorkflowTests#testBigWorkflowNoUI()Commit2	+14.6% [±6.5]	+8.1% [±5.1]	+27.7% [±12.2]	+0.4% [±5.5]	+23.5% [±7.1]
WorkflowTests#testBigWorkflowNoUI()Commit3	- 8.3% [±11.0]	+34.5% [±14.4]	+45.6% [±16.9]	+25.3% [±6.1]	+45.4% [±11.9]
WorkflowTests#testBigWorkflowNoUI()Commit4	+0.4% [±8.9]	+15.6% [±6.1]	+23.0% [±10.1]	Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 4.05s is not within [0%, 120%] of 3.13s - 29.2% [±7.6]	+28.3% [±11.6]
WorkflowTests#testBigWorkflowNoUI()Replace1	+56.6% [±12.6]	+61.6% [±11.5]	+72.7% [±5.6]	+71.6% [±3.0]	+71.0% [±7.1]
WorkflowTests#testBigWorkflowNoUI()Replace2	+27.6% [±12.1]	+28.6% [±9.9]	+40.6% [±13.4]	- 9.9% [±2.7]	+39.8% [±13.3]
WorkflowTests#testBigWorkflowNoUI()Replace3	- 12.6% [±9.2]	- 4.4% [±12.2]	+51.5% [±15.5]	- 1.4% [±4.7]	+58.5% [±16.2]
WorkflowTests#testBigWorkflowNoUI()Share	+38.9% [±4.1]	+20.9% [±4.8]	+38.3% [±6.9]	+42.4% [±2.6]	+50.6% [±7.1]
WorkflowTests#testBigWorkflowNoUI()Tag1	+64.0% [±11.3]	+67.4% [±9.0]	+59.1% [±13.6]	+44.8% [±5.0]	+67.4% [±9.8]
WorkflowTests#testBigWorkflowNoUI()Update1	+12.8% [±5.5]	+19.7% [±6.4]	+49.0% [±11.6]	+9.0% [±6.2]	+46.1% [±14.1]
WorkflowTests#testBigWorkflowNoUI()Update2	+20.4% [±7.0]	+27.7% [±6.4]	+53.1% [±11.4]	+7.8% [±3.9]	+50.1% [±13.3]
WorkflowTests#testBigWorkflowNoUI()Update3	+24.6% [±4.1]	+35.9% [±4.4]	+47.2% [±8.9]	+10.1% [±3.5]	+42.6% [±12.7]
WorkflowTests#testBigWorkflowNoUI()Update4	+31.1% [±5.1]	+29.4% [±6.6]	+44.2% [±14.0]	+17.1% [±11.9]	+37.9% [±10.8]