Performance of org.eclipse.pde.ui: M20070212-1330 relative to 3.1

RHEL 4.0 Sun 1.4.2_08 (3 GHz 2.5 GB)

Win XP Sun 1.4.2_08 (3 GHz 2 GB)

RHEL 3.0 Sun 1.4.2_08 (3 GHz 2 GB)

Win XP Sun 1.4.2_08 (2 GHz 512 MB)

RHEL 3.0 Sun 1.4.2_08 (2 GHz 512 MB)


Scenario Status

The green/red indication is based on the assert condition in the test. Hover over for error message.
Click on or for detailed results.
Grayed images mark explainable degradations.
Yellow images mark differences that are statistically insignificant at the 10% level.
"n/a" - results not available.

All 3 scenarios
RHEL 3.0 Sun 1.4.2_08 (2 GHz 512 MB)
RHEL 3.0 Sun 1.4.2_08 (3 GHz 2 GB)
RHEL 4.0 Sun 1.4.2_08 (3 GHz 2.5 GB)
Win XP Sun 1.4.2_08 (2 GHz 512 MB)
Win XP Sun 1.4.2_08 (3 GHz 2 GB)
performance.parts.InitializeModelsPerfTest#testCachedModels()
performance.parts.InitializeModelsPerfTest#testModels()
performance.parts.OpenManifestEditorPerfTest#testOpen() This result is statistically insignificant at the 10% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 684ms is not within [0%, 110%] of 574ms; There is not enough evidence to reject the null hypothesis at the 90%level This result is statistically insignificant at the 10% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 484ms is not within [0%, 110%] of 340ms; There is not enough evidence to reject the null hypothesis at the 90%level This result is statistically insignificant at the 10% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 394ms is not within [0%, 110%] of 281ms; There is not enough evidence to reject the null hypothesis at the 90%level This result is statistically insignificant at the 10% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 424ms is not within [0%, 110%] of 332ms; There is not enough evidence to reject the null hypothesis at the 90%level This result is statistically insignificant at the 10% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 299ms is not within [0%, 110%] of 245ms; There is not enough evidence to reject the null hypothesis at the 90%level