Performance of org.eclipse.core: 3.2 relative to 3.1

RHEL 4.0 Sun 1.4.2_08 (3 GHz 2.5 GB)

Win XP Sun 1.4.2_08 (3 Hz 2 GB)

RHEL 3.0 Sun 1.4.2_08 (3 GHz 2 GB)

Win XP Sun 1.4.2_08 (2 GHz 512 MB)

RHEL 3.0 Sun 1.4.2_08 (2 GHz 512 MB)


Scenario Status

The green/red indication is based on the assert condition in the test. Hover over for error message.
Click on or for detailed results.
Grayed images mark explainable degradations.
Yellow images mark results where there is not enough evidence to reject the null hypothesis at the 90%level (Student's t-test).
"n/a" - results not available.

All 49 scenarios

RHEL 3.0 Sun 1.4.2_08 (2 GHz 512 MB)
RHEL 3.0 Sun 1.4.2_08 (3 GHz 2 GB)
RHEL 4.0 Sun 1.4.2_08 (3 GHz 2.5 GB)
Win XP Sun 1.4.2_08 (2 GHz 512 MB)
Win XP Sun 1.4.2_08 (3 Hz 2 GB)
resources.perf.BenchFileStore#testStoreExists()
resources.perf.BenchFileStore#testStoreIsReadOnly()
resources.perf.BenchFileStore#testStoreLastModified()
resources.perf.BenchMiscWorkspace#testNoOp() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
resources.perf.BenchWorkspace#testCountResources() Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 246ms is not within [0%, 110%] of 204ms
resources.perf.BenchWorkspace#testCountResourcesDuringOperation() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
resources.perf.LocalHistoryPerformanceTest#testAddState() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 190ms is not within [0%, 110%] of 98ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
resources.perf.LocalHistoryPerformanceTest#testBug28603() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 42ms is not within [0%, 110%] of 38ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 32ms is not within [0%, 110%] of 28ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 51ms is not within [0%, 110%] of 23ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 98ms is not within [0%, 110%] of 65ms Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 62ms is not within [0%, 110%] of 48ms
resources.perf.LocalHistoryPerformanceTest#testClearHistory100x4() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 21ms is not within [0%, 110%] of 17ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 22ms is not within [0%, 110%] of 18ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 35ms is not within [0%, 110%] of 27ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 27ms is not within [0%, 110%] of 19ms
resources.perf.LocalHistoryPerformanceTest#testClearHistory20x20() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 10ms is not within [0%, 110%] of 9ms Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 8ms is not within [0%, 110%] of 7ms Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 15ms is not within [0%, 110%] of 11ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
resources.perf.LocalHistoryPerformanceTest#testClearHistory4x100() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 158ms is not within [0%, 110%] of 8ms Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 51ms is not within [0%, 110%] of 6ms Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 27ms is not within [0%, 110%] of 15ms
resources.perf.LocalHistoryPerformanceTest#testCopyHistory100x4()
resources.perf.LocalHistoryPerformanceTest#testCopyHistory20x20()
resources.perf.LocalHistoryPerformanceTest#testCopyHistory4x100() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
resources.perf.LocalHistoryPerformanceTest#testGetDeletedMembers100x4() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 62ms is not within [0%, 110%] of 47ms
resources.perf.LocalHistoryPerformanceTest#testGetDeletedMembers20x20() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
resources.perf.LocalHistoryPerformanceTest#testGetDeletedMembers4x100() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 15ms is not within [0%, 110%] of 13ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
resources.perf.LocalHistoryPerformanceTest#testGetHistory()
resources.perf.LocalHistoryPerformanceTest#testHistoryCleanUp100x4() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 699ms is not within [0%, 110%] of 249ms Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 254ms is not within [0%, 110%] of 215ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 2.62s is not within [0%, 110%] of 1.32s There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 2.39s is not within [0%, 110%] of 1.34s
resources.perf.LocalHistoryPerformanceTest#testHistoryCleanUp20x20() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 1.01s is not within [0%, 110%] of 258ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 252ms is not within [0%, 110%] of 221ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
resources.perf.LocalHistoryPerformanceTest#testHistoryCleanUp4x100() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 853ms is not within [0%, 110%] of 305ms Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 412ms is not within [0%, 110%] of 255ms Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 259ms is not within [0%, 110%] of 222ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 1.74s is not within [0%, 110%] of 1.46s
resources.perf.MarkerPerformanceTest#testSetAttributes1()
resources.perf.MarkerPerformanceTest#testSetAttributes2()
resources.perf.PropertyManagerPerformanceTest#testGetProperty100x4()
resources.perf.PropertyManagerPerformanceTest#testGetProperty20x20() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
resources.perf.PropertyManagerPerformanceTest#testGetProperty4x100() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
resources.perf.PropertyManagerPerformanceTest#testSetProperty100x4() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
resources.perf.PropertyManagerPerformanceTest#testSetProperty20x20() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
resources.perf.PropertyManagerPerformanceTest#testSetProperty4x100() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
resources.perf.WorkspacePerformanceTest#testCreateResources() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
resources.perf.WorkspacePerformanceTest#testDeleteProject() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 10.16s is not within [0%, 110%] of 8.12s There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
resources.perf.WorkspacePerformanceTest#testFolderCopy() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 10.36s is not within [0%, 110%] of 7.25s Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 1.5m is not within [0%, 110%] of 1.11m There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
resources.perf.WorkspacePerformanceTest#testFolderMove() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 4.89s is not within [0%, 110%] of 1.41s
runtime.perf.BenchPath#testHash() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
runtime.perf.BenchPath#testPathCreation()
runtime.perf.BenchPath#testToOSString() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
runtime.perf.BenchPath#testToString() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
runtime.perf.ContentTypePerformanceTest#testContentMatching() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
runtime.perf.ContentTypePerformanceTest#testIsKindOf() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
runtime.perf.ContentTypePerformanceTest#testLoadCatalog() Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 212ms is not within [0%, 110%] of 155ms Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 168ms is not within [0%, 110%] of 112ms
runtime.perf.ContentTypePerformanceTest#testNameMatching() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 1.92s is not within [0%, 110%] of 1.66s There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
runtime.perf.PreferencePerformanceTest#testGetStringCommonPrefixKeys() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
runtime.perf.PreferencePerformanceTest#testGetStringMisses() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 1.24s is not within [0%, 110%] of 1.05s Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 842ms is not within [0%, 110%] of 655ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
runtime.perf.PreferencePerformanceTest#testGetStringSequentialKeys() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 1.62s is not within [0%, 110%] of 1.37s Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 1.06s is not within [0%, 110%] of 923ms
runtime.perf.PreferencePerformanceTest#testGetStringUniqueKeys() Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 1.5s is not within [0%, 110%] of 1.26s Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 981ms is not within [0%, 110%] of 843ms
runtime.perf.PreferencePerformanceTest#testPutStringKeys()
runtime.perf.PreferencePerformanceTest#testRemoveStringKeys() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
runtime.perf.StartupTest.testApplicationStartup Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 2.17s is not within [0%, 105%] of 1.86s Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 1.5s is not within [0%, 105%] of 1.24s Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 1.28s is not within [0%, 105%] of 1.07s Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 1.97s is not within [0%, 105%] of 1.69s Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 1.36s is not within [0%, 105%] of 1.16s
runtime.perf.UIStartupTest.testUIApplicationStartup Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 15.18s is not within [50%, 105%] of 12.13s Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 10.11s is not within [50%, 105%] of 8.9s Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 8.48s is not within [50%, 105%] of 6.87s Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 10.37s is not within [50%, 105%] of 7.69s Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 6.67s is not within [50%, 105%] of 5.29s