All 49 scenarios |
RHEL 3.0 Sun 1.4.2_08 (2 GHz 512 MB) | RHEL 3.0 Sun 1.4.2_08 (3 GHz 2 GB) | RHEL 4.0 Sun 1.4.2_08 (3 GHz 2.5 GB) | Win XP Sun 1.4.2_08 (2 GHz 512 MB) | Win XP Sun 1.4.2_08 (3 GHz 2 GB) |
| resources.perf.BenchFileStore#testStoreExists() |
 |
|
|
|
|
| resources.perf.BenchFileStore#testStoreIsReadOnly() |
|
|
|
|
|
| resources.perf.BenchFileStore#testStoreLastModified() |
|
|
|
|
|
| resources.perf.BenchMiscWorkspace#testNoOp() |
|
|
|
|
|
| resources.perf.BenchWorkspace#testCountResources() | 
This result is statistically insignificant at the 10% level (Student's t-test). |
This result is statistically insignificant at the 10% level (Student's t-test). |
This result is statistically insignificant at the 10% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 118ms is not within [0%, 110%] of 104ms |
This result is statistically insignificant at the 10% level (Student's t-test). |
This result is statistically insignificant at the 10% level (Student's t-test). |
| resources.perf.BenchWorkspace#testCountResourcesDuringOperation() |
|
|
|
|
|
| resources.perf.LocalHistoryPerformanceTest#testAddState() |
This result is statistically insignificant at the 10% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 189ms is not within [0%, 110%] of 106ms |
This result is statistically insignificant at the 10% level (Student's t-test). |
This result is statistically insignificant at the 10% level (Student's t-test). |
This result is statistically insignificant at the 10% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 259ms is not within [0%, 110%] of 201ms |
This result is statistically insignificant at the 10% level (Student's t-test). |
| resources.perf.LocalHistoryPerformanceTest#testBug28603() |
This result is statistically insignificant at the 10% level (Student's t-test). |
This result is statistically insignificant at the 10% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 31ms is not within [0%, 110%] of 27ms |
This result is statistically insignificant at the 10% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 51ms is not within [0%, 110%] of 23ms |
This result is statistically insignificant at the 10% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 123ms is not within [0%, 110%] of 111ms |
This result is statistically insignificant at the 10% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 60ms is not within [0%, 110%] of 48ms |
| resources.perf.LocalHistoryPerformanceTest#testClearHistory100x4() |
This result is statistically insignificant at the 10% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 33ms is not within [0%, 110%] of 25ms |
This result is statistically insignificant at the 10% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 22ms is not within [0%, 110%] of 17ms |
This result is statistically insignificant at the 10% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 21ms is not within [0%, 110%] of 18ms |
This result is statistically insignificant at the 10% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 35ms is not within [0%, 110%] of 23ms |
This result is statistically insignificant at the 10% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 27ms is not within [0%, 110%] of 19ms |
| resources.perf.LocalHistoryPerformanceTest#testClearHistory20x20() |
| 
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 9ms is not within [0%, 110%] of 7ms |
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 19ms is not within [0%, 110%] of 7ms |
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 15ms is not within [0%, 110%] of 12ms |
| resources.perf.LocalHistoryPerformanceTest#testClearHistory4x100() |
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 8ms is not within [0%, 110%] of 6ms |
|
|
|
| resources.perf.LocalHistoryPerformanceTest#testCopyHistory100x4() |
|
|
|
|
|
| resources.perf.LocalHistoryPerformanceTest#testCopyHistory20x20() |
|
|
|
|
|
| resources.perf.LocalHistoryPerformanceTest#testCopyHistory4x100() |
This result is statistically insignificant at the 10% level (Student's t-test). |
This result is statistically insignificant at the 10% level (Student's t-test). |
This result is statistically insignificant at the 10% level (Student's t-test). |
This result is statistically insignificant at the 10% level (Student's t-test). |
This result is statistically insignificant at the 10% level (Student's t-test). |
| resources.perf.LocalHistoryPerformanceTest#testGetDeletedMembers100x4() |
This result is statistically insignificant at the 10% level (Student's t-test). |
This result is statistically insignificant at the 10% level (Student's t-test). |
This result is statistically insignificant at the 10% level (Student's t-test). |
This result is statistically insignificant at the 10% level (Student's t-test). |
This result is statistically insignificant at the 10% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 54ms is not within [0%, 110%] of 46ms |
| resources.perf.LocalHistoryPerformanceTest#testGetDeletedMembers20x20() |
|
|
|
|
|
| resources.perf.LocalHistoryPerformanceTest#testGetDeletedMembers4x100() |
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 18ms is not within [0%, 110%] of 14ms |
|
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 23ms is not within [0%, 110%] of 16ms |
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 23ms is not within [0%, 110%] of 15ms |
| resources.perf.LocalHistoryPerformanceTest#testGetHistory() |
|
|
|
|
|
| resources.perf.LocalHistoryPerformanceTest#testHistoryCleanUp100x4() |
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 601ms is not within [0%, 110%] of 249ms |
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 386ms is not within [0%, 110%] of 245ms |
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 254ms is not within [0%, 110%] of 216ms |
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 1.76s is not within [0%, 110%] of 1.31s |
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 1.46s is not within [0%, 110%] of 1.2s |
| resources.perf.LocalHistoryPerformanceTest#testHistoryCleanUp20x20() |
This result is statistically insignificant at the 10% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 1.09s is not within [0%, 110%] of 512ms |
This result is statistically insignificant at the 10% level (Student's t-test). |
This result is statistically insignificant at the 10% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 251ms is not within [0%, 110%] of 222ms |
This result is statistically insignificant at the 10% level (Student's t-test). |
This result is statistically insignificant at the 10% level (Student's t-test). |
| resources.perf.LocalHistoryPerformanceTest#testHistoryCleanUp4x100() |
This result is statistically insignificant at the 10% level (Student's t-test). |
This result is statistically insignificant at the 10% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 468ms is not within [0%, 110%] of 251ms |
This result is statistically insignificant at the 10% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 260ms is not within [0%, 110%] of 222ms |
This result is statistically insignificant at the 10% level (Student's t-test). |
This result is statistically insignificant at the 10% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 1.68s is not within [0%, 110%] of 1.4s |
| resources.perf.MarkerPerformanceTest#testSetAttributes1() |
|
|
|
|
|
| resources.perf.MarkerPerformanceTest#testSetAttributes2() |
|
|
|
|
|
| resources.perf.PropertyManagerPerformanceTest#testGetProperty100x4() |
|
|
|
|
|
| resources.perf.PropertyManagerPerformanceTest#testGetProperty20x20() |
This result is statistically insignificant at the 10% level (Student's t-test). |
This result is statistically insignificant at the 10% level (Student's t-test). |
This result is statistically insignificant at the 10% level (Student's t-test). |
This result is statistically insignificant at the 10% level (Student's t-test). |
This result is statistically insignificant at the 10% level (Student's t-test). |
| resources.perf.PropertyManagerPerformanceTest#testGetProperty4x100() |
|
|
|
|
|
| resources.perf.PropertyManagerPerformanceTest#testSetProperty100x4() |
|
|
|
|
|
| resources.perf.PropertyManagerPerformanceTest#testSetProperty20x20() |
This result is statistically insignificant at the 10% level (Student's t-test). |
This result is statistically insignificant at the 10% level (Student's t-test). |
This result is statistically insignificant at the 10% level (Student's t-test). |
This result is statistically insignificant at the 10% level (Student's t-test). |
This result is statistically insignificant at the 10% level (Student's t-test). |
| resources.perf.PropertyManagerPerformanceTest#testSetProperty4x100() |
|
|
|
|
|
| resources.perf.WorkspacePerformanceTest#testCreateResources() |
This result is statistically insignificant at the 10% level (Student's t-test). |
This result is statistically insignificant at the 10% level (Student's t-test). |
This result is statistically insignificant at the 10% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 7.02s is not within [0%, 110%] of 4.77s |
This result is statistically insignificant at the 10% level (Student's t-test). |
This result is statistically insignificant at the 10% level (Student's t-test). |
| resources.perf.WorkspacePerformanceTest#testDeleteProject() |
This result is statistically insignificant at the 10% level (Student's t-test). |
This result is statistically insignificant at the 10% level (Student's t-test). |
This result is statistically insignificant at the 10% level (Student's t-test). |
This result is statistically insignificant at the 10% level (Student's t-test). |
This result is statistically insignificant at the 10% level (Student's t-test). |
| resources.perf.WorkspacePerformanceTest#testFolderCopy() |
This result is statistically insignificant at the 10% level (Student's t-test). |
This result is statistically insignificant at the 10% level (Student's t-test). |
This result is statistically insignificant at the 10% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 10.69s is not within [0%, 110%] of 7.65s |
This result is statistically insignificant at the 10% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 1.58m is not within [0%, 110%] of 1.27m |
This result is statistically insignificant at the 10% level (Student's t-test). |
| resources.perf.WorkspacePerformanceTest#testFolderMove() |
This result is statistically insignificant at the 10% level (Student's t-test). |
This result is statistically insignificant at the 10% level (Student's t-test). |
This result is statistically insignificant at the 10% level (Student's t-test). |
This result is statistically insignificant at the 10% level (Student's t-test). |
This result is statistically insignificant at the 10% level (Student's t-test). |
| runtime.perf.BenchPath#testHash() |
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 2.95s is not within [0%, 110%] of 2.12s |
|
|
|
|
| runtime.perf.BenchPath#testPathCreation() |
|
|
|
|
|
| runtime.perf.BenchPath#testToOSString() |
|
|
|
|
|
| runtime.perf.BenchPath#testToString() |
|
|
|
|
|
| runtime.perf.ContentTypePerformanceTest#testContentMatching() |
|
|
|
|
|
| runtime.perf.ContentTypePerformanceTest#testIsKindOf() |
This result is statistically insignificant at the 10% level (Student's t-test). |
This result is statistically insignificant at the 10% level (Student's t-test). |
This result is statistically insignificant at the 10% level (Student's t-test). |
This result is statistically insignificant at the 10% level (Student's t-test). |
This result is statistically insignificant at the 10% level (Student's t-test). |
| runtime.perf.ContentTypePerformanceTest#testLoadCatalog() |
|
|
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 201ms is not within [0%, 110%] of 155ms |
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 157ms is not within [0%, 110%] of 113ms |
| runtime.perf.ContentTypePerformanceTest#testNameMatching() |
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 1.96s is not within [0%, 110%] of 1.7s |
|
|
|
|
| runtime.perf.PreferencePerformanceTest#testGetStringCommonPrefixKeys() |
|
|
|
|
|
| runtime.perf.PreferencePerformanceTest#testGetStringMisses() |
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 1.3s is not within [0%, 110%] of 1.06s |
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 846ms is not within [0%, 110%] of 671ms |
|
|
|
| runtime.perf.PreferencePerformanceTest#testGetStringSequentialKeys() |
|
|
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 1.64s is not within [0%, 110%] of 1.37s |
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 1.07s is not within [0%, 110%] of 935ms |
| runtime.perf.PreferencePerformanceTest#testGetStringUniqueKeys() |
|
|
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 1.48s is not within [0%, 110%] of 1.25s |
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 1.04s is not within [0%, 110%] of 850ms |
| runtime.perf.PreferencePerformanceTest#testPutStringKeys() |
|
|
|
|
|
| runtime.perf.PreferencePerformanceTest#testRemoveStringKeys() |
|
|
|
|
|
| runtime.perf.StartupTest.testApplicationStartup |
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 2.19s is not within [0%, 105%] of 1.86s |
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 1.5s is not within [0%, 105%] of 1.23s |
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 1.29s is not within [0%, 105%] of 1.07s |
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 2s is not within [0%, 105%] of 1.69s |
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 1.38s is not within [0%, 105%] of 1.16s |
| runtime.perf.UIStartupTest.testUIApplicationStartup |
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 15.47s is not within [50%, 105%] of 12.32s |
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 10.69s is not within [50%, 105%] of 8.1s |
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 8.51s is not within [50%, 105%] of 6.95s |
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 10.18s is not within [50%, 105%] of 7.73s |
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 6.88s is not within [50%, 105%] of 5.28s |
