All 49 scenarios |
RHEL 3.0 Sun 1.4.2_08 (2 GHz 512 MB) | RHEL 3.0 Sun 1.4.2_08 (3 GHz 2 GB) | RHEL 4.0 Sun 1.4.2_08 (3 GHz 2.5 GB) | Win XP Sun 1.4.2_08 (2 GHz 512 MB) | Win XP Sun 1.4.2_08 (3 Hz 2 GB) |
| resources.perf.BenchFileStore#testStoreExists() |
 |
|
|
|
|
| resources.perf.BenchFileStore#testStoreIsReadOnly() |
|
|
|
|
|
| resources.perf.BenchFileStore#testStoreLastModified() |
|
|
|
|
|
| resources.perf.BenchMiscWorkspace#testNoOp() |
| 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
|
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
| resources.perf.BenchWorkspace#testCountResources() |
|
|
| 
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 246ms is not within [0%, 110%] of 204ms |
|
| resources.perf.BenchWorkspace#testCountResourcesDuringOperation() |
|
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
|
|
| resources.perf.LocalHistoryPerformanceTest#testAddState() | 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 190ms is not within [0%, 110%] of 98ms |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
| resources.perf.LocalHistoryPerformanceTest#testBug28603() |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 42ms is not within [0%, 110%] of 38ms |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 32ms is not within [0%, 110%] of 28ms |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 51ms is not within [0%, 110%] of 23ms |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 98ms is not within [0%, 110%] of 65ms |
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 62ms is not within [0%, 110%] of 48ms |
| resources.perf.LocalHistoryPerformanceTest#testClearHistory100x4() |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 21ms is not within [0%, 110%] of 17ms |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 22ms is not within [0%, 110%] of 18ms |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 35ms is not within [0%, 110%] of 27ms |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 27ms is not within [0%, 110%] of 19ms |
| resources.perf.LocalHistoryPerformanceTest#testClearHistory20x20() |
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 10ms is not within [0%, 110%] of 9ms |
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 8ms is not within [0%, 110%] of 7ms |
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 15ms is not within [0%, 110%] of 11ms |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
| resources.perf.LocalHistoryPerformanceTest#testClearHistory4x100() |
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 158ms is not within [0%, 110%] of 8ms |
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 51ms is not within [0%, 110%] of 6ms |
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 27ms is not within [0%, 110%] of 15ms |
|
| resources.perf.LocalHistoryPerformanceTest#testCopyHistory100x4() |
|
|
|
|
|
| resources.perf.LocalHistoryPerformanceTest#testCopyHistory20x20() |
|
|
|
|
|
| resources.perf.LocalHistoryPerformanceTest#testCopyHistory4x100() |
|
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
| resources.perf.LocalHistoryPerformanceTest#testGetDeletedMembers100x4() |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 62ms is not within [0%, 110%] of 47ms |
| resources.perf.LocalHistoryPerformanceTest#testGetDeletedMembers20x20() |
|
|
|
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
|
| resources.perf.LocalHistoryPerformanceTest#testGetDeletedMembers4x100() |
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 15ms is not within [0%, 110%] of 13ms |
|
|
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
|
| resources.perf.LocalHistoryPerformanceTest#testGetHistory() |
|
|
|
|
|
| resources.perf.LocalHistoryPerformanceTest#testHistoryCleanUp100x4() |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 699ms is not within [0%, 110%] of 249ms |
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 254ms is not within [0%, 110%] of 215ms |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 2.62s is not within [0%, 110%] of 1.32s |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 2.39s is not within [0%, 110%] of 1.34s |
| resources.perf.LocalHistoryPerformanceTest#testHistoryCleanUp20x20() |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 1.01s is not within [0%, 110%] of 258ms |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 252ms is not within [0%, 110%] of 221ms |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
| resources.perf.LocalHistoryPerformanceTest#testHistoryCleanUp4x100() |
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 853ms is not within [0%, 110%] of 305ms |
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 412ms is not within [0%, 110%] of 255ms |
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 259ms is not within [0%, 110%] of 222ms |
|
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 1.74s is not within [0%, 110%] of 1.46s |
| resources.perf.MarkerPerformanceTest#testSetAttributes1() |
|
|
|
|
|
| resources.perf.MarkerPerformanceTest#testSetAttributes2() |
|
|
|
|
|
| resources.perf.PropertyManagerPerformanceTest#testGetProperty100x4() |
|
|
|
|
|
| resources.perf.PropertyManagerPerformanceTest#testGetProperty20x20() |
|
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
|
|
|
| resources.perf.PropertyManagerPerformanceTest#testGetProperty4x100() |
|
|
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
|
|
| resources.perf.PropertyManagerPerformanceTest#testSetProperty100x4() |
|
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
| resources.perf.PropertyManagerPerformanceTest#testSetProperty20x20() |
|
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
|
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
|
| resources.perf.PropertyManagerPerformanceTest#testSetProperty4x100() |
|
|
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
| resources.perf.WorkspacePerformanceTest#testCreateResources() |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
| resources.perf.WorkspacePerformanceTest#testDeleteProject() |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 10.16s is not within [0%, 110%] of 8.12s |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
|
|
| resources.perf.WorkspacePerformanceTest#testFolderCopy() |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 10.36s is not within [0%, 110%] of 7.25s |
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 1.5m is not within [0%, 110%] of 1.11m |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
| resources.perf.WorkspacePerformanceTest#testFolderMove() |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 4.89s is not within [0%, 110%] of 1.41s |
|
|
|
| runtime.perf.BenchPath#testHash() |
|
|
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
|
|
| runtime.perf.BenchPath#testPathCreation() |
|
|
|
|
|
| runtime.perf.BenchPath#testToOSString() |
|
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
|
|
|
| runtime.perf.BenchPath#testToString() |
|
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
|
| runtime.perf.ContentTypePerformanceTest#testContentMatching() |
|
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
|
|
| runtime.perf.ContentTypePerformanceTest#testIsKindOf() |
|
|
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
| runtime.perf.ContentTypePerformanceTest#testLoadCatalog() |
|
|
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 212ms is not within [0%, 110%] of 155ms |
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 168ms is not within [0%, 110%] of 112ms |
| runtime.perf.ContentTypePerformanceTest#testNameMatching() |
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 1.92s is not within [0%, 110%] of 1.66s |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
|
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
|
| runtime.perf.PreferencePerformanceTest#testGetStringCommonPrefixKeys() |
|
|
|
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
|
| runtime.perf.PreferencePerformanceTest#testGetStringMisses() |
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 1.24s is not within [0%, 110%] of 1.05s |
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 842ms is not within [0%, 110%] of 655ms |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
|
|
| runtime.perf.PreferencePerformanceTest#testGetStringSequentialKeys() |
|
|
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 1.62s is not within [0%, 110%] of 1.37s |
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 1.06s is not within [0%, 110%] of 923ms |
| runtime.perf.PreferencePerformanceTest#testGetStringUniqueKeys() |
|
|
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 1.5s is not within [0%, 110%] of 1.26s |
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 981ms is not within [0%, 110%] of 843ms |
| runtime.perf.PreferencePerformanceTest#testPutStringKeys() |
|
|
|
|
|
| runtime.perf.PreferencePerformanceTest#testRemoveStringKeys() |
|
|
|
|
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
| runtime.perf.StartupTest.testApplicationStartup |
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 2.17s is not within [0%, 105%] of 1.86s |
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 1.5s is not within [0%, 105%] of 1.24s |
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 1.28s is not within [0%, 105%] of 1.07s |
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 1.97s is not within [0%, 105%] of 1.69s |
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 1.36s is not within [0%, 105%] of 1.16s |
| runtime.perf.UIStartupTest.testUIApplicationStartup |
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 15.18s is not within [50%, 105%] of 12.13s |
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 10.11s is not within [50%, 105%] of 8.9s |
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 8.48s is not within [50%, 105%] of 6.87s |
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 10.37s is not within [50%, 105%] of 7.69s |
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 6.67s is not within [50%, 105%] of 5.29s |
