All 51 scenarios |
RHEL 3.0 Sun 1.4.2_10 (2 GHz 512 MB)
| RHEL 3.0 Sun 1.4.2_10 (3 GHz 2 GB)
| RHEL 4.0 Sun 1.4.2_10 (3 GHz 2.5 GB)
| Win XP Sun 1.4.2_10 (2 GHz 512 MB)
| Win XP Sun 1.4.2_10 (3 GHz 2 GB)
|
| BenchFileStore#testStoreExists()
|
+8.7% [±2.5]
|
- 3.0% [±2.9]
|
- 1.1% [±2.2]
|
+2.8% [±1.3]
|
+0.0% [±1.1]
|
| BenchFileStore#testStoreIsReadOnly()
|
+9.6% [±0.9]
|
- 5.1% [±2.0]
|
- 1.1% [±0.6]
|
+3.1% [±1.2]
|
+0.6% [±1.0]
|
| BenchFileStore#testStoreLastModified()
|
+10.2% [±1.0]
|
- 4.0% [±2.1]
|
- 1.1% [±0.5]
|
+3.4% [±1.0]
|
+0.2% [±0.9]
|
| *BenchMiscWorkspace#testGetProject() (vs. I20060801-0900)
|
+1.3% [±0.7]
|
- 1.9% [±0.7]
|
+1.3% [±0.4]
|
- 8.4% [±1.6]
|
+3.2% [±1.0]
|
| BenchMiscWorkspace#testNoOp()
|
+5.1% [±1.1]
|
+63.9% [±0.3]
|
+67.5% [±0.3]
|
+56.8% [±2.6]
|
+69.4% [±0.4]
|
| BenchWorkspace#testCountResources()
|
- 0.4% [±1.0]
|
+2.6% [±3.8]
|
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.3, build=3.2_200606291905_200801281721, jvm=sun}':
Elapsed Process: 119ms is not within [0%, 110%] of 56ms
- 112.5% [±19.1]
|
+5.0% [±4.0]
|
- 10.0% [±2.9]
|
| BenchWorkspace#testCountResourcesDuringOperation()
|
- 1.7% [±1.1]
|
- 0.9% [±1.1]
|
- 0.5% [±0.7]
|
- 0.8% [±1.3]
|
- 1.0% [±0.8]
|
| *BenchWorkspace#testFindMaxProblemSeverity() (vs. N20070315-0010)
|
+1.8% [±0.6]
|
- 1.2% [±0.2]
|
+1.0% [±0.3]
|
- 2.0% [±1.3]
|
- 2.0% [±0.2]
|
| LocalHistoryPerformanceTest#testAddState()
|
+57.6% [±74.5]
|
+64.4% [±30.0]
|
+70.6% [±30.7]
|
+41.6% [±27.1]
|
+46.6% [±21.0]
|
| LocalHistoryPerformanceTest#testBug28603()
|
+7.1% [±7.0]
|
+0.0% [±8.4]
|
+4.0% [±5.2]
|
- 6.1% [±9.9]
|
+10.5% [±7.2]
|
| LocalHistoryPerformanceTest#testClearHistory100x4()
|
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.3, build=3.2_200606291905_200801281721, jvm=sun}':
Elapsed Process: 82ms is not within [0%, 110%] of 37ms
- 121.6% [±91.2]
|
+92.6% [±93.5]
|
+18.2% [±31.2]
|
+25.8% [±24.7]
|
+17.4% [±25.9]
|
| LocalHistoryPerformanceTest#testClearHistory20x20()
|
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.3, build=3.2_200606291905_200801281721, jvm=sun}':
Elapsed Process: 17ms is not within [0%, 110%] of 10ms
- 70.0% [±62.8]
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200801281721, jvm=sun}':
Elapsed Process: 9ms is not within [0%, 110%] of 8ms
- 12.5% [±6.0]
|
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.3, build=3.2_200606291905_200801281721, jvm=sun}':
Elapsed Process: 9ms is not within [0%, 110%] of 8ms
- 12.5% [±18.8]
|
+30.4% [±34.1]
|
+0.0% [±2.4]
|
| LocalHistoryPerformanceTest#testClearHistory4x100()
|
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.3, build=3.2_200606291905_200801281721, jvm=sun}':
Elapsed Process: 13ms is not within [0%, 110%] of 9ms
- 44.4% [±42.8]
|
+0.0% [±6.0]
|
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.3, build=3.2_200606291905_200801281721, jvm=sun}':
Elapsed Process: 7ms is not within [0%, 110%] of 6ms
- 16.7% [±9.6]
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200801281721, jvm=sun}':
Elapsed Process: 15ms is not within [0%, 110%] of 11ms
- 36.4% [±35.7]
|
+53.3% [±29.9]
|
| LocalHistoryPerformanceTest#testCopyHistory100x4()
|
+22.7% [±30.8]
|
+51.2% [±46.2]
|
+4.3% [±6.5]
|
+0.6% [±2.5]
|
+9.6% [±10.4]
|
| LocalHistoryPerformanceTest#testCopyHistory20x20()
|
+26.1% [±14.3]
|
+25.9% [±15.3]
|
+17.0% [±18.9]
|
- 8.5% [±13.7]
|
+6.6% [±7.8]
|
| LocalHistoryPerformanceTest#testCopyHistory4x100()
|
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.3, build=3.2_200606291905_200801281721, jvm=sun}':
Elapsed Process: 66ms is not within [0%, 110%] of 55ms
- 20.0% [±15.4]
|
+37.2% [±33.0]
|
+38.8% [±38.1]
|
+9.8% [±17.2]
|
+13.6% [±20.5]
|
| LocalHistoryPerformanceTest#testGetDeletedMembers100x4()
|
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.3, build=3.2_200606291905_200801281721, jvm=sun}':
Elapsed Process: 59ms is not within [0%, 110%] of 51ms
- 15.7% [±44.2]
|
+14.0% [±8.1]
|
+10.0% [±8.4]
|
+22.9% [±35.7]
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200801281721, jvm=sun}':
Elapsed Process: 55ms is not within [0%, 110%] of 47ms
- 17.0% [±17.0]
|
| LocalHistoryPerformanceTest#testGetDeletedMembers20x20()
|
+5.6% [±2.8]
|
+0.0% [±4.4]
|
+0.0% [±8.0]
|
+0.0% [±46.1]
|
+0.0% [±71.9]
|
| LocalHistoryPerformanceTest#testGetDeletedMembers4x100()
|
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.3, build=3.2_200606291905_200801281721, jvm=sun}':
Elapsed Process: 35ms is not within [0%, 110%] of 26ms
- 34.6% [±98.1]
|
+40.0% [±30.0]
|
+41.2% [±9.3]
|
+0.0% [±46.1]
|
+6.2% [±3.1]
|
| LocalHistoryPerformanceTest#testGetHistory()
|
- 5.3% [n/a]
|
+6.2% [n/a]
|
+13.3% [n/a]
|
+0.0% [n/a]
|
[n/a]
|
| LocalHistoryPerformanceTest#testHistoryCleanUp100x4()
|
- 2.0% [±7.4]
|
+11.6% [±76.6]
|
- 4.0% [±7.2]
|
- 4.6% [±83.4]
|
+53.8% [±69.3]
|
| LocalHistoryPerformanceTest#testHistoryCleanUp20x20()
|
+18.1% [±13.7]
|
- 7.4% [±3.1]
|
- 6.4% [±1.8]
|
+55.1% [±56.5]
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200801281721, jvm=sun}':
Elapsed Process: 1.13s is not within [0%, 110%] of 656ms
- 72.4% [±57.9]
|
| MarkerPerformanceTest#testSetAttributes1()
|
+3.4% [n/a]
|
+5.9% [n/a]
|
+3.5% [n/a]
|
- 3.7% [n/a]
|
+3.4% [n/a]
|
| MarkerPerformanceTest#testSetAttributes2()
|
- 5.0% [n/a]
|
+5.6% [n/a]
|
+3.3% [n/a]
|
- 4.8% [n/a]
|
+4.9% [n/a]
|
| PropertyManagerPerformanceTest#testGetProperty100x4()
|
+1.1% [±1.1]
|
+0.2% [±1.1]
|
+0.6% [±0.7]
|
- 0.3% [±2.7]
|
- 0.2% [±1.0]
|
| PropertyManagerPerformanceTest#testGetProperty20x20()
|
+0.5% [±0.6]
|
- 8.2% [±5.8]
|
+0.0% [±0.1]
|
- 2.6% [±1.0]
|
- 4.9% [±0.1]
|
| PropertyManagerPerformanceTest#testGetProperty4x100()
|
+1.0% [±0.1]
|
- 0.2% [±0.1]
|
+0.1% [±0.1]
|
- 3.8% [±0.1]
|
- 5.0% [±0.1]
|
| PropertyManagerPerformanceTest#testSetProperty100x4()
|
+0.9% [±0.8]
|
+5.8% [±1.9]
|
- 2.3% [±1.6]
|
+2.7% [±3.4]
|
- 0.5% [±2.0]
|
| PropertyManagerPerformanceTest#testSetProperty20x20()
|
+2.6% [±1.1]
|
+7.5% [±3.0]
|
+1.8% [±0.9]
|
- 2.6% [±6.7]
|
+2.4% [±2.2]
|
| PropertyManagerPerformanceTest#testSetProperty4x100()
|
+4.4% [±2.5]
|
+1.1% [±3.3]
|
+4.8% [±1.6]
|
- 3.8% [±9.3]
|
- 6.4% [±5.8]
|
| WorkspacePerformanceTest#testCreateResources()
|
+11.1% [±27.0]
|
+6.9% [±22.4]
|
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.3, build=3.2_200606291905_200801281721, jvm=sun}':
Elapsed Process: 5.81s is not within [0%, 110%] of 4.79s
- 21.4% [±25.7]
|
- 0.3% [±7.0]
|
+5.5% [±8.4]
|
| WorkspacePerformanceTest#testDeleteProject()
|
+20.5% [±19.9]
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200801281721, jvm=sun}':
Elapsed Process: 15.49s is not within [0%, 110%] of 11.5s
- 34.6% [±33.3]
|
- 6.2% [±25.0]
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200801281721, jvm=sun}':
Elapsed Process: 12.25s is not within [0%, 110%] of 9.88s
- 24.0% [±18.6]
|
+0.0% [±2.0]
|
| WorkspacePerformanceTest#testFolderCopy()
|
+14.2% [±15.3]
|
+19.4% [±12.5]
|
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.3, build=3.2_200606291905_200801281721, jvm=sun}':
Elapsed Process: 12.02s is not within [0%, 110%] of 10.4s
- 15.6% [±21.0]
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200801281721, jvm=sun}':
Elapsed Process: 1.72m is not within [0%, 110%] of 1.52m
- 13.2% [±4.4]
|
+2.3% [±1.9]
|
| WorkspacePerformanceTest#testFolderMove()
|
- 2.6% [±65.3]
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200801281721, jvm=sun}':
Elapsed Process: 1.41s is not within [0%, 110%] of 1.23s
- 15.0% [±12.9]
|
+2.1% [±0.8]
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200801281721, jvm=sun}':
Elapsed Process: 2.86s is not within [0%, 110%] of 2.58s
- 10.6% [±10.4]
|
- 1.0% [±1.4]
|
| *WorkspacePerformanceTest#testRefreshProject() (vs. N20070215-0010)
|
- 54.8% [±59.7]
|
- 4.0% [±2.0]
|
+8.4% [±9.1]
|
- 14.4% [±3.5]
|
+1.3% [±1.1]
|
| BenchPath#testHash()
|
- 2.4% [±0.1]
|
- 0.5% [±0.4]
|
- 1.4% [±0.3]
|
+2.8% [±0.9]
|
+1.4% [±0.7]
|
| BenchPath#testPathCreation()
|
+1.7% [±0.6]
|
+7.5% [±0.5]
|
- 4.8% [±0.5]
|
+1.6% [±0.9]
|
+1.0% [±0.7]
|
| BenchPath#testToOSString()
|
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.3, build=3.2_200606291905_200801281721, jvm=sun}':
Elapsed Process: 1.22s is not within [0%, 110%] of 992ms
- 22.6% [±0.3]
|
+0.9% [±0.6]
|
- 0.9% [±0.3]
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200801281721, jvm=sun}':
Elapsed Process: 1.25s is not within [0%, 110%] of 892ms
- 40.6% [±1.7]
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200801281721, jvm=sun}':
Elapsed Process: 871ms is not within [0%, 110%] of 721ms
- 20.8% [±1.2]
|
| BenchPath#testToString()
|
+0.5% [±0.3]
|
- 1.1% [±0.5]
|
- 2.1% [±0.2]
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200801281721, jvm=sun}':
Elapsed Process: 1.25s is not within [0%, 110%] of 884ms
- 41.4% [±1.8]
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200801281721, jvm=sun}':
Elapsed Process: 890ms is not within [0%, 110%] of 725ms
- 22.8% [±1.0]
|
| ContentTypePerformanceTest#testContentMatching()
|
- 6.9% [±2.1]
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200801281721, jvm=sun}':
Elapsed Process: 896ms is not within [0%, 110%] of 796ms
- 12.6% [±2.1]
|
- 1.6% [±1.4]
|
- 8.1% [±3.0]
|
- 8.6% [±2.3]
|
| ContentTypePerformanceTest#testIsKindOf()
|
+0.3% [±0.8]
|
+1.5% [±0.8]
|
+0.5% [±0.7]
|
- 4.8% [±3.6]
|
- 0.9% [±1.4]
|
| ContentTypePerformanceTest#testLoadCatalog()
|
+12.1% [±0.7]
|
+7.6% [±3.3]
|
+9.8% [±0.3]
|
+12.2% [±2.3]
|
- 0.1% [±5.5]
|
| ContentTypePerformanceTest#testNameMatching()
|
+0.0% [±0.6]
|
+0.8% [±0.6]
|
- 4.1% [±0.6]
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200801281721, jvm=sun}':
Elapsed Process: 1.67s is not within [0%, 110%] of 1.51s
- 10.2% [±2.6]
|
- 3.5% [±1.1]
|
| PreferencePerformanceTest#testGetStringCommonPrefixKeys()
|
- 1.8% [±0.8]
|
+2.3% [±4.7]
|
- 1.2% [±0.9]
|
+0.0% [±1.6]
|
- 2.5% [±1.8]
|
| PreferencePerformanceTest#testGetStringMisses()
|
+13.5% [±1.3]
|
+18.9% [±0.6]
|
- 0.6% [±0.3]
|
- 7.8% [±2.7]
|
- 4.0% [±1.3]
|
| PreferencePerformanceTest#testGetStringSequentialKeys()
|
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.3, build=3.2_200606291905_200801281721, jvm=sun}':
Elapsed Process: 1.57s is not within [0%, 110%] of 1.41s
- 11.6% [±0.4]
|
- 7.3% [±0.8]
|
+1.0% [±0.8]
|
+11.5% [±0.9]
|
+11.8% [±0.8]
|
| PreferencePerformanceTest#testGetStringUniqueKeys()
|
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.3, build=3.2_200606291905_200801281721, jvm=sun}':
Elapsed Process: 1.43s is not within [0%, 110%] of 1.25s
- 14.7% [±1.6]
|
- 6.5% [±0.5]
|
+0.2% [±1.2]
|
+13.7% [±2.1]
|
+16.3% [±1.5]
|
| PreferencePerformanceTest#testPutStringKeys()
|
- 0.9% [±1.0]
|
- 1.5% [±0.8]
|
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.3, build=3.2_200606291905_200801281721, jvm=sun}':
Elapsed Process: 701ms is not within [0%, 110%] of 636ms
- 10.2% [±1.7]
|
- 3.6% [±1.1]
|
- 6.6% [±0.7]
|
| PreferencePerformanceTest#testRemoveStringKeys()
|
- 2.0% [±0.5]
|
+1.7% [±0.8]
|
+1.8% [±0.4]
|
- 8.7% [±2.0]
|
- 4.8% [±1.9]
|
| StartupTest.testApplicationStartup
|
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.3, build=3.2_200606291905_200801281721, jvm=sun}':
Elapsed Process: 4.72s is not within [0%, 105%] of 2.47s
- 91.4% [±12.4]
|
+7.4% [±0.5]
|
+6.9% [±0.1]
|
- 0.5% [±2.3]
|
+0.4% [±1.4]
|
| UIStartupTest.testUIApplicationStartup
|
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.3, build=3.2_200606291905_200801281721, jvm=sun}':
Elapsed Process: 18.22s is not within [50%, 105%] of 16.12s
- 13.0% [±6.2]
|
- 3.7% [±9.4]
|
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.3, build=3.2_200606291905_200801281721, jvm=sun}':
Elapsed Process: 9.22s is not within [50%, 105%] of 8.56s
- 7.7% [±3.0]
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200801281721, jvm=sun}':
Elapsed Process: 12.6s is not within [50%, 105%] of 10.75s
- 17.2% [±12.3]
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200801281721, jvm=sun}':
Elapsed Process: 7.76s is not within [50%, 105%] of 6.83s
- 13.6% [±4.5]
|
