Performance of org.eclipse.core: 3.2.1 relative to 3.1

RHEL 4.0 Sun 1.4.2_08 (3 GHz 2.5 GB)

Win XP Sun 1.4.2_08 (3 GHz 2 GB)

RHEL 3.0 Sun 1.4.2_08 (3 GHz 2 B)

Win XP Sun 1.4.2_08 (2 GHz 512 MB)

RHEL 3.0 Sun 1.4.2_08 (2 GHz 512 MB)


Scenario Status

The green/red indication is based on the assert condition in the test. Hover over for error message.
Click on or for detailed results.
Grayed images mark explainable degradations.
Yellow images mark results where there is not enough evidence to reject the null hypothesis at the 90%level (Student's t-test).
"n/a" - results not available.

All 49 scenarios

RHEL 3.0 Sun 1.4.2_08 (2 GHz 512 MB)
RHEL 3.0 Sun 1.4.2_08 (3 GHz 2 B)
RHEL 4.0 Sun 1.4.2_08 (3 GHz 2.5 GB)
Win XP Sun 1.4.2_08 (2 GHz 512 MB)
Win XP Sun 1.4.2_08 (3 GHz 2 GB)
resources.perf.BenchFileStore#testStoreExists()
resources.perf.BenchFileStore#testStoreIsReadOnly()
resources.perf.BenchFileStore#testStoreLastModified()
resources.perf.BenchMiscWorkspace#testNoOp() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
resources.perf.BenchWorkspace#testCountResources() Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 237ms is not within [0%, 110%] of 212ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
resources.perf.BenchWorkspace#testCountResourcesDuringOperation() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
resources.perf.LocalHistoryPerformanceTest#testAddState() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 187ms is not within [0%, 110%] of 106ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 259ms is not within [0%, 110%] of 201ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
resources.perf.LocalHistoryPerformanceTest#testBug28603() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 30ms is not within [0%, 110%] of 27ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 51ms is not within [0%, 110%] of 23ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 150ms is not within [0%, 110%] of 111ms Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 60ms is not within [0%, 110%] of 48ms
resources.perf.LocalHistoryPerformanceTest#testClearHistory100x4() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 41ms is not within [0%, 110%] of 25ms Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 217ms is not within [0%, 110%] of 17ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 35ms is not within [0%, 110%] of 23ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 23ms is not within [0%, 110%] of 19ms
resources.perf.LocalHistoryPerformanceTest#testClearHistory20x20() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 13ms is not within [0%, 110%] of 10ms Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 8ms is not within [0%, 110%] of 7ms Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 16ms is not within [0%, 110%] of 7ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
resources.perf.LocalHistoryPerformanceTest#testClearHistory4x100() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 10ms is not within [0%, 110%] of 9ms Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 7ms is not within [0%, 110%] of 6ms Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 19ms is not within [0%, 110%] of 15ms
resources.perf.LocalHistoryPerformanceTest#testCopyHistory100x4()
resources.perf.LocalHistoryPerformanceTest#testCopyHistory20x20()
resources.perf.LocalHistoryPerformanceTest#testCopyHistory4x100() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 189ms is not within [0%, 110%] of 168ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
resources.perf.LocalHistoryPerformanceTest#testGetDeletedMembers100x4() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 62ms is not within [0%, 110%] of 46ms
resources.perf.LocalHistoryPerformanceTest#testGetDeletedMembers20x20() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 18ms is not within [0%, 110%] of 16ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 31ms is not within [0%, 110%] of 23ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
resources.perf.LocalHistoryPerformanceTest#testGetDeletedMembers4x100() Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 23ms is not within [0%, 110%] of 16ms
resources.perf.LocalHistoryPerformanceTest#testGetHistory()
resources.perf.LocalHistoryPerformanceTest#testHistoryCleanUp100x4() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 1.32s is not within [0%, 110%] of 249ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 1.36s is not within [0%, 110%] of 245ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 312ms is not within [0%, 110%] of 216ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 2.78s is not within [0%, 110%] of 1.31s There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 2.04s is not within [0%, 110%] of 1.2s
resources.perf.LocalHistoryPerformanceTest#testHistoryCleanUp20x20() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 704ms is not within [0%, 110%] of 512ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 256ms is not within [0%, 110%] of 222ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
resources.perf.LocalHistoryPerformanceTest#testHistoryCleanUp4x100() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 1.18s is not within [0%, 110%] of 251ms Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 262ms is not within [0%, 110%] of 222ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
resources.perf.MarkerPerformanceTest#testSetAttributes1()
resources.perf.MarkerPerformanceTest#testSetAttributes2()
resources.perf.PropertyManagerPerformanceTest#testGetProperty100x4()
resources.perf.PropertyManagerPerformanceTest#testGetProperty20x20() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
resources.perf.PropertyManagerPerformanceTest#testGetProperty4x100() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
resources.perf.PropertyManagerPerformanceTest#testSetProperty100x4() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
resources.perf.PropertyManagerPerformanceTest#testSetProperty20x20() Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 246ms is not within [0%, 110%] of 223ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
resources.perf.PropertyManagerPerformanceTest#testSetProperty4x100() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
resources.perf.WorkspacePerformanceTest#testCreateResources() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 17.26s is not within [0%, 110%] of 15.48s There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 6.94s is not within [0%, 110%] of 4.77s There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
resources.perf.WorkspacePerformanceTest#testDeleteProject() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 14.72s is not within [0%, 110%] of 13.07s There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 6.42s is not within [0%, 110%] of 5.65s
resources.perf.WorkspacePerformanceTest#testFolderCopy() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 43s is not within [0%, 110%] of 35.58s There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 12s is not within [0%, 110%] of 7.65s Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 1.56m is not within [0%, 110%] of 1.27m There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 36.03s is not within [0%, 110%] of 31.9s
resources.perf.WorkspacePerformanceTest#testFolderMove() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
runtime.perf.BenchPath#testHash()
runtime.perf.BenchPath#testPathCreation() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
runtime.perf.BenchPath#testToOSString() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
runtime.perf.BenchPath#testToString() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
runtime.perf.ContentTypePerformanceTest#testContentMatching() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
runtime.perf.ContentTypePerformanceTest#testIsKindOf() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
runtime.perf.ContentTypePerformanceTest#testLoadCatalog() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 248ms is not within [0%, 110%] of 184ms Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 178ms is not within [0%, 110%] of 129ms Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 198ms is not within [0%, 110%] of 155ms Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 141ms is not within [0%, 110%] of 113ms
runtime.perf.ContentTypePerformanceTest#testNameMatching() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 1.98s is not within [0%, 110%] of 1.7s There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
runtime.perf.PreferencePerformanceTest#testGetStringCommonPrefixKeys() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
runtime.perf.PreferencePerformanceTest#testGetStringMisses() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 1.24s is not within [0%, 110%] of 1.06s Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 869ms is not within [0%, 110%] of 671ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
runtime.perf.PreferencePerformanceTest#testGetStringSequentialKeys() Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 1.63s is not within [0%, 110%] of 1.37s Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 1.05s is not within [0%, 110%] of 935ms
runtime.perf.PreferencePerformanceTest#testGetStringUniqueKeys() Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 1.46s is not within [0%, 110%] of 1.25s Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 985ms is not within [0%, 110%] of 850ms
runtime.perf.PreferencePerformanceTest#testPutStringKeys()
runtime.perf.PreferencePerformanceTest#testRemoveStringKeys() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
runtime.perf.StartupTest.testApplicationStartup Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 2.2s is not within [0%, 105%] of 1.86s Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 1.51s is not within [0%, 105%] of 1.23s Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 1.34s is not within [0%, 105%] of 1.07s Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 2s is not within [0%, 105%] of 1.69s Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 1.38s is not within [0%, 105%] of 1.16s
runtime.perf.UIStartupTest.testUIApplicationStartup Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 15.31s is not within [50%, 105%] of 12.32s Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 10.18s is not within [50%, 105%] of 8.1s Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 8.4s is not within [50%, 105%] of 6.95s Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 10.22s is not within [50%, 105%] of 7.73s Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 6.6s is not within [50%, 105%] of 5.28s