Performance of org.eclipse.ant: 3.2 relative to 3.1

RHEL 4.0 Sun 1.4.2_08 (3 GHz 2.5 GB)

Win XP Sun 1.4.2_08 (3 Hz 2 GB)

RHEL 3.0 Sun 1.4.2_08 (3 GHz 2 GB)

Win XP Sun 1.4.2_08 (2 GHz 512 MB)

RHEL 3.0 Sun 1.4.2_08 (2 GHz 512 MB)


Scenario Status

The green/red indication is based on the assert condition in the test. Hover over for error message.
Click on or for detailed results.
Grayed images mark explainable degradations.
Yellow images mark results where there is not enough evidence to reject the null hypothesis at the 90%level (Student's t-test).
"n/a" - results not available.

All 9 scenarios

RHEL 3.0 Sun 1.4.2_08 (2 GHz 512 MB)
RHEL 3.0 Sun 1.4.2_08 (3 GHz 2 GB)
RHEL 4.0 Sun 1.4.2_08 (3 GHz 2.5 GB)
Win XP Sun 1.4.2_08 (2 GHz 512 MB)
Win XP Sun 1.4.2_08 (3 Hz 2 GB)
ui.editor.performance.OpenAntEditorTest#testOpenAntEditor1() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 936ms is not within [0%, 110%] of 827ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 1.25s is not within [0%, 110%] of 1.12s Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 1.24s is not within [0%, 110%] of 830ms
ui.editor.performance.OpenAntEditorTest#testOpenAntEditor2() Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 702ms is not within [0%, 110%] of 614ms; In 3.0, by default, no folding in the Ant editor. In 3.1, by default folding is on in the Ant editor. See the No folding test. Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 1.01s is not within [0%, 110%] of 631ms; In 3.0, by default, no folding in the Ant editor. In 3.1, by default folding is on in the Ant editor. See the No folding test.
ui.editor.performance.OpenAntEditorTest#testOpenAntEditorNoFolding() Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 873ms is not within [0%, 110%] of 531ms
ui.performance.OpenLaunchConfigurationDialogTests#testOpenAntLaunchConfigurationDialog1() Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 15.76s is not within [0%, 110%] of 14.29s Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 13.71s is not within [0%, 110%] of 9.84s Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 9.34s is not within [0%, 110%] of 8.11s
ui.performance.OpenLaunchConfigurationDialogTests#testOpenAntLaunchConfigurationDialog2() Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 15.56s is not within [0%, 110%] of 14.14s Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 12.1s is not within [0%, 110%] of 9.5s Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 9.25s is not within [0%, 110%] of 7.85s
ui.performance.SeparateVMTests#testBuild() Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 7.86s is not within [0%, 110%] of 7.08s Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 8.14s is not within [0%, 110%] of 7.32s
ui.performance.SeparateVMTests#testBuildMinusDebug() Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 8.24s is not within [0%, 110%] of 6.67s
ui.performance.SeparateVMTests#testBuildNoConsole() Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 7s is not within [0%, 110%] of 5.74s
ui.performance.SeparateVMTests#testBuildWithLotsOfLinks() Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 8.56s is not within [0%, 110%] of 7.27s