All 9 scenarios |
RHEL 3.0 Sun 1.4.2_08 (2 GHz 512 MB) | RHEL 3.0 Sun 1.4.2_08 (3 GHz 2 GB) | RHEL 4.0 Sun 1.4.2_08 (3 GHz 2.5 GB) | Win XP Sun 1.4.2_08 (2 GHz 512 MB) | Win XP Sun 1.4.2_08 (3 Hz 2 GB) |
| ui.editor.performance.OpenAntEditorTest#testOpenAntEditor1() | 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). | 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 936ms is not within [0%, 110%] of 827ms |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 1.25s is not within [0%, 110%] of 1.12s | 
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 1.24s is not within [0%, 110%] of 830ms |
| ui.editor.performance.OpenAntEditorTest#testOpenAntEditor2() |
 |
|
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 702ms is not within [0%, 110%] of 614ms; In 3.0, by default, no folding in the Ant editor. In 3.1, by default folding is on in the Ant editor. See the No folding test. |
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 1.01s is not within [0%, 110%] of 631ms; In 3.0, by default, no folding in the Ant editor. In 3.1, by default folding is on in the Ant editor. See the No folding test. |
| ui.editor.performance.OpenAntEditorTest#testOpenAntEditorNoFolding() |
 |
|
|
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 873ms is not within [0%, 110%] of 531ms |
| ui.performance.OpenLaunchConfigurationDialogTests#testOpenAntLaunchConfigurationDialog1() |
|
|
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 15.76s is not within [0%, 110%] of 14.29s |
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 13.71s is not within [0%, 110%] of 9.84s |
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 9.34s is not within [0%, 110%] of 8.11s |
| ui.performance.OpenLaunchConfigurationDialogTests#testOpenAntLaunchConfigurationDialog2() |
|
|
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 15.56s is not within [0%, 110%] of 14.14s |
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 12.1s is not within [0%, 110%] of 9.5s |
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 9.25s is not within [0%, 110%] of 7.85s |
| ui.performance.SeparateVMTests#testBuild() |
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 7.86s is not within [0%, 110%] of 7.08s |
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 8.14s is not within [0%, 110%] of 7.32s |
|
| ui.performance.SeparateVMTests#testBuildMinusDebug() |
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 8.24s is not within [0%, 110%] of 6.67s |
|
|
|
| ui.performance.SeparateVMTests#testBuildNoConsole() |
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 7s is not within [0%, 110%] of 5.74s |
|
|
|
| ui.performance.SeparateVMTests#testBuildWithLotsOfLinks() |
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 8.56s is not within [0%, 110%] of 7.27s |
|
|
|
