Performance of org.eclipse.osgi: 3.2 relative to 3.1

RHEL 4.0 Sun 1.4.2_08 (3 GHz 2.5 GB)

Win XP Sun 1.4.2_08 (3 Hz 2 GB)

RHEL 3.0 Sun 1.4.2_08 (3 GHz 2 GB)

Win XP Sun 1.4.2_08 (2 GHz 512 MB)

RHEL 3.0 Sun 1.4.2_08 (2 GHz 512 MB)


Scenario Status

The green/red indication is based on the assert condition in the test. Hover over for error message.
Click on or for detailed results.
Grayed images mark explainable degradations.
Yellow images mark results where there is not enough evidence to reject the null hypothesis at the 90%level (Student's t-test).
"n/a" - results not available.

All 6 scenarios
RHEL 3.0 Sun 1.4.2_08 (2 GHz 512 MB)
RHEL 3.0 Sun 1.4.2_08 (3 GHz 2 GB)
RHEL 4.0 Sun 1.4.2_08 (3 GHz 2.5 GB)
Win XP Sun 1.4.2_08 (2 GHz 512 MB)
Win XP Sun 1.4.2_08 (3 Hz 2 GB)
perf.StatePerformanceTest#testCreation() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
perf.StatePerformanceTest#testResolution100() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 1.03s is not within [0%, 110%] of 850ms Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 906ms is not within [0%, 110%] of 682ms Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 746ms is not within [0%, 110%] of 533ms Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 917ms is not within [0%, 110%] of 789ms Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 836ms is not within [0%, 110%] of 650ms
perf.StatePerformanceTest#testResolution1000()
perf.StatePerformanceTest#testResolution500() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
perf.StatePerformanceTest#testResolution5000()
perf.StatePerformanceTest#testStoreAndRetrieve() Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 6.1s is not within [0%, 110%] of 5.52s