All 9 scenarios |
RHEL 3.0 Sun 1.4.2_08 (2 GHz 512 MB) | RHEL 3.0 Sun 1.4.2_08 (3 GHz 2 B) | RHEL 4.0 Sun 1.4.2_08 (3 GHz 2.5 GB) | Win XP Sun 1.4.2_08 (3 GHz 2 GB) |
| ui.editor.performance.OpenAntEditorTest#testOpenAntEditor1() | 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). | 
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 1.22s is not within [0%, 110%] of 839ms |
| ui.editor.performance.OpenAntEditorTest#testOpenAntEditor2() | 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
|
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 694ms is not within [0%, 110%] of 622ms; In 3.0, by default, no folding in the Ant editor. In 3.1, by default folding is on in the Ant editor. See the No folding test. |
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 983ms is not within [0%, 110%] of 628ms; In 3.0, by default, no folding in the Ant editor. In 3.1, by default folding is on in the Ant editor. See the No folding test. |
| ui.editor.performance.OpenAntEditorTest#testOpenAntEditorNoFolding() |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
 |
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 869ms is not within [0%, 110%] of 521ms |
| ui.performance.OpenLaunchConfigurationDialogTests#testOpenAntLaunchConfigurationDialog1() |
|
|
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 16.09s is not within [0%, 110%] of 14.15s |
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 9.16s is not within [0%, 110%] of 8.12s |
| ui.performance.OpenLaunchConfigurationDialogTests#testOpenAntLaunchConfigurationDialog2() |
|
|
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 15.98s is not within [0%, 110%] of 14.02s |
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 8.98s is not within [0%, 110%] of 7.84s |
| ui.performance.SeparateVMTests#testBuild() |
|
|
|
|
| ui.performance.SeparateVMTests#testBuildMinusDebug() |
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 7.77s is not within [0%, 110%] of 6.72s |
|
|
| ui.performance.SeparateVMTests#testBuildNoConsole() |
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 6.59s is not within [0%, 110%] of 5.84s |
|
|
| ui.performance.SeparateVMTests#testBuildWithLotsOfLinks() |
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 8.09s is not within [0%, 110%] of 7.32s |
|
|
