Performance of org.eclipse.ant: M20070212-1330 relative to 3.1

RHEL 4.0 Sun 1.4.2_08 (3 GHz 2.5 GB)

Win XP Sun 1.4.2_08 (3 GHz 2 GB)

RHEL 3.0 Sun 1.4.2_08 (3 GHz 2 GB)

Win XP Sun 1.4.2_08 (2 GHz 512 MB)

RHEL 3.0 Sun 1.4.2_08 (2 GHz 512 MB)


Scenario Status

The green/red indication is based on the assert condition in the test. Hover over for error message.
Click on or for detailed results.
Grayed images mark explainable degradations.
Yellow images mark differences that are statistically insignificant at the 10% level.
"n/a" - results not available.

All 9 scenarios

RHEL 3.0 Sun 1.4.2_08 (2 GHz 512 MB)
RHEL 3.0 Sun 1.4.2_08 (3 GHz 2 GB)
RHEL 4.0 Sun 1.4.2_08 (3 GHz 2.5 GB)
Win XP Sun 1.4.2_08 (2 GHz 512 MB)
Win XP Sun 1.4.2_08 (3 GHz 2 GB)
ui.editor.performance.OpenAntEditorTest#testOpenAntEditor1() This result is statistically insignificant at the 10% level (Student's t-test). This result is statistically insignificant at the 10% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 1.24s is not within [0%, 110%] of 1.1s This result is statistically insignificant at the 10% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 917ms is not within [0%, 110%] of 832ms This result is statistically insignificant at the 10% level (Student's t-test). This result is statistically insignificant at the 10% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 1.22s is not within [0%, 110%] of 839ms
ui.editor.performance.OpenAntEditorTest#testOpenAntEditor2() This result is statistically insignificant at the 10% level (Student's t-test). This result is statistically insignificant at the 10% level (Student's t-test). This result is statistically insignificant at the 10% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 695ms is not within [0%, 110%] of 622ms; In 3.0, by default, no folding in the Ant editor. In 3.1, by default folding is on in the Ant editor. See the No folding test. This result is statistically insignificant at the 10% level (Student's t-test). This result is statistically insignificant at the 10% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 997ms is not within [0%, 110%] of 628ms; In 3.0, by default, no folding in the Ant editor. In 3.1, by default folding is on in the Ant editor. See the No folding test.
ui.editor.performance.OpenAntEditorTest#testOpenAntEditorNoFolding() This result is statistically insignificant at the 10% level (Student's t-test). This result is statistically insignificant at the 10% level (Student's t-test). This result is statistically insignificant at the 10% level (Student's t-test). This result is statistically insignificant at the 10% level (Student's t-test). This result is statistically insignificant at the 10% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 878ms is not within [0%, 110%] of 521ms; There is not enough evidence to reject the null hypothesis at the 90%level
ui.performance.OpenLaunchConfigurationDialogTests#testOpenAntLaunchConfigurationDialog1() Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 15.96s is not within [0%, 110%] of 14.15s Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 11.32s is not within [0%, 110%] of 9.94s Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 9.34s is not within [0%, 110%] of 8.12s
ui.performance.OpenLaunchConfigurationDialogTests#testOpenAntLaunchConfigurationDialog2() Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 15.81s is not within [0%, 110%] of 14.02s Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 14.68s is not within [0%, 110%] of 9.54s Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 9.04s is not within [0%, 110%] of 7.84s
ui.performance.SeparateVMTests#testBuild() Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 8.15s is not within [0%, 110%] of 7.31s
ui.performance.SeparateVMTests#testBuildMinusDebug() Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 7.83s is not within [0%, 110%] of 6.72s
ui.performance.SeparateVMTests#testBuildNoConsole() Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 6.66s is not within [0%, 110%] of 5.84s
ui.performance.SeparateVMTests#testBuildWithLotsOfLinks() Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 8.19s is not within [0%, 110%] of 7.32s