Performance of org.eclipse.osgi: M20070212-1330 relative to 3.1

RHEL 4.0 Sun 1.4.2_08 (3 GHz 2.5 GB)

Win XP Sun 1.4.2_08 (3 GHz 2 GB)

RHEL 3.0 Sun 1.4.2_08 (3 GHz 2 GB)

Win XP Sun 1.4.2_08 (2 GHz 512 MB)

RHEL 3.0 Sun 1.4.2_08 (2 GHz 512 MB)


Scenario Status

The green/red indication is based on the assert condition in the test. Hover over for error message.
Click on or for detailed results.
Grayed images mark explainable degradations.
Yellow images mark differences that are statistically insignificant at the 10% level.
"n/a" - results not available.

All 6 scenarios
RHEL 3.0 Sun 1.4.2_08 (2 GHz 512 MB)
RHEL 3.0 Sun 1.4.2_08 (3 GHz 2 GB)
RHEL 4.0 Sun 1.4.2_08 (3 GHz 2.5 GB)
Win XP Sun 1.4.2_08 (2 GHz 512 MB)
Win XP Sun 1.4.2_08 (3 GHz 2 GB)
perf.StatePerformanceTest#testCreation() This result is statistically insignificant at the 10% level (Student's t-test). This result is statistically insignificant at the 10% level (Student's t-test). This result is statistically insignificant at the 10% level (Student's t-test). This result is statistically insignificant at the 10% level (Student's t-test). This result is statistically insignificant at the 10% level (Student's t-test).
perf.StatePerformanceTest#testResolution100() This result is statistically insignificant at the 10% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 1.07s is not within [0%, 110%] of 918ms This result is statistically insignificant at the 10% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 965ms is not within [0%, 110%] of 693ms This result is statistically insignificant at the 10% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 727ms is not within [0%, 110%] of 521ms This result is statistically insignificant at the 10% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 979ms is not within [0%, 110%] of 785ms This result is statistically insignificant at the 10% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 889ms is not within [0%, 110%] of 650ms
perf.StatePerformanceTest#testResolution1000()
perf.StatePerformanceTest#testResolution500() Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 411ms is not within [0%, 110%] of 367ms
perf.StatePerformanceTest#testResolution5000()
perf.StatePerformanceTest#testStoreAndRetrieve() Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 8.46s is not within [0%, 110%] of 7.67s Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 6.1s is not within [0%, 110%] of 5.54s Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 6.15s is not within [0%, 110%] of 5.55s