All 9 scenarios |
RHEL 3.0 Sun 1.4.2_08 (2 GHz 512 MB) | RHEL 3.0 Sun 1.4.2_08 (3 GHz 2 GB) | RHEL 4.0 Sun 1.4.2_08 (3 GHz 2.5 GB) | Win XP Sun 1.4.2_08 (2 GHz 512 MB) | Win XP Sun 1.4.2_08 (3 GHz 2 GB) |
| ui.editor.performance.OpenAntEditorTest#testOpenAntEditor1() | 
This result is statistically insignificant at the 10% level (Student's t-test). |
This result is statistically insignificant at the 10% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 1.24s is not within [0%, 110%] of 1.1s |
This result is statistically insignificant at the 10% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 917ms is not within [0%, 110%] of 832ms |
This result is statistically insignificant at the 10% level (Student's t-test). |
This result is statistically insignificant at the 10% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 1.22s is not within [0%, 110%] of 839ms |
| ui.editor.performance.OpenAntEditorTest#testOpenAntEditor2() | 
This result is statistically insignificant at the 10% level (Student's t-test). |
This result is statistically insignificant at the 10% level (Student's t-test). |
This result is statistically insignificant at the 10% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 695ms is not within [0%, 110%] of 622ms; In 3.0, by default, no folding in the Ant editor. In 3.1, by default folding is on in the Ant editor. See the No folding test. |
This result is statistically insignificant at the 10% level (Student's t-test). |
This result is statistically insignificant at the 10% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 997ms is not within [0%, 110%] of 628ms; In 3.0, by default, no folding in the Ant editor. In 3.1, by default folding is on in the Ant editor. See the No folding test. |
| ui.editor.performance.OpenAntEditorTest#testOpenAntEditorNoFolding() |
This result is statistically insignificant at the 10% level (Student's t-test). |
This result is statistically insignificant at the 10% level (Student's t-test). |
This result is statistically insignificant at the 10% level (Student's t-test). |
This result is statistically insignificant at the 10% level (Student's t-test). |
This result is statistically insignificant at the 10% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 878ms is not within [0%, 110%] of 521ms; There is not enough evidence to reject the null hypothesis at the 90%level |
| ui.performance.OpenLaunchConfigurationDialogTests#testOpenAntLaunchConfigurationDialog1() |
 |
| 
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 15.96s is not within [0%, 110%] of 14.15s |
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 11.32s is not within [0%, 110%] of 9.94s |
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 9.34s is not within [0%, 110%] of 8.12s |
| ui.performance.OpenLaunchConfigurationDialogTests#testOpenAntLaunchConfigurationDialog2() |
|
|
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 15.81s is not within [0%, 110%] of 14.02s |
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 14.68s is not within [0%, 110%] of 9.54s |
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 9.04s is not within [0%, 110%] of 7.84s |
| ui.performance.SeparateVMTests#testBuild() |
|
|
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 8.15s is not within [0%, 110%] of 7.31s |
|
| ui.performance.SeparateVMTests#testBuildMinusDebug() |
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 7.83s is not within [0%, 110%] of 6.72s |
|
|
|
| ui.performance.SeparateVMTests#testBuildNoConsole() |
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 6.66s is not within [0%, 110%] of 5.84s |
|
|
|
| ui.performance.SeparateVMTests#testBuildWithLotsOfLinks() |
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 8.19s is not within [0%, 110%] of 7.32s |
|
|
|
