All 102 scenarios |
RHEL 3.0 Sun 1.4.2_08 (2 GHz 512 MB) | RHEL 3.0 Sun 1.4.2_08 (3 GHz 2 B) | RHEL 4.0 Sun 1.4.2_08 (3 GHz 2.5 GB) | Win XP Sun 1.4.2_08 (2 GHz 512 MB) | Win XP Sun 1.4.2_08 (3 GHz 2 GB) |
| performance.ActivateJavaEditorTest#testActivateEditor() | 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
 |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
| performance.ActivateTextEditorTest#testActivateEditor() | n/a |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). | 
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 1.67s is not within [0%, 110%] of 1.16s |
|
|
| performance.CodeCompletionPerformanceTest#testApplicationNoParamters() | n/a |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 1.12s is not within [0%, 110%] of 779ms |
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 1.37s is not within [0%, 110%] of 1.25s |
|
| performance.CodeCompletionPerformanceTest#testApplicationWithParamterGuesses() | n/a |
|
|
|
|
| performance.CodeCompletionPerformanceTest#testApplicationWithParamterGuesses2() | n/a |
|
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
|
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
| performance.CodeCompletionPerformanceTest#testApplicationWithParamterNames() | n/a |
|
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 1.84s is not within [0%, 110%] of 1.64s |
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 1.33s is not within [0%, 110%] of 1.21s |
| performance.CodeCompletionPerformanceTest#testCompletionNoParamters() | n/a |
|
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 434ms is not within [0%, 110%] of 379ms |
|
|
| performance.CodeCompletionPerformanceTest#testCompletionWithParamterGuesses() | n/a |
|
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
|
|
| performance.CodeCompletionPerformanceTest#testCompletionWithParamterGuesses2() | n/a |
|
|
|
|
| performance.CodeCompletionPerformanceTest#testCompletionWithParamterNames() | n/a |
|
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 480ms is not within [0%, 110%] of 381ms |
|
|
| performance.ContentTypeTest#testJavaDirty() | n/a |
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 107ms is not within [0%, 110%] of 92ms |
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 124ms is not within [0%, 110%] of 87ms |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 100ms is not within [0%, 110%] of 90ms |
| performance.ContentTypeTest#testPluginPropertiesDirty() | n/a |
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 156ms is not within [0%, 110%] of 141ms |
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 172ms is not within [0%, 110%] of 129ms |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
|
| performance.ContentTypeTest#testPluginXMLDirty() | n/a |
|
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 1.2s is not within [0%, 110%] of 822ms |
|
|
| performance.ContentTypeTest#testPropertiesDirty() | n/a |
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 116ms is not within [0%, 110%] of 99ms |
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 131ms is not within [0%, 110%] of 95ms |
|
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
| performance.ContentTypeTest#testTextDirty() | n/a |
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 102ms is not within [0%, 110%] of 83ms |
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 119ms is not within [0%, 110%] of 80ms |
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 81ms is not within [0%, 110%] of 72ms |
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 100ms is not within [0%, 110%] of 81ms |
| performance.ConvertLineDelimitersProjectTest#test() | n/a |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). | 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 2.04s is not within [0%, 110%] of 1.85s |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
| performance.DocumentLineDifferInitializationTest#testInitializationWithFewChanges() | n/a |
|
|
|
|
| performance.DocumentLineDifferInitializationTest#testInitializationWithManyChanges() | n/a |
|
|
|
|
| performance.DocumentLineDifferInitializationTest#testInitializationWithManyChangesButEqualSize() | n/a |
|
|
|
|
| performance.DocumentLineDifferInitializationTest#testInitializationWithNoChanges() | n/a |
|
|
|
|
| performance.DocumentLineDifferModificationTest#testEditingChanged() | n/a |
|
|
|
|
| performance.DocumentLineDifferModificationTest#testEditingUnchanged() | n/a |
|
|
|
|
| performance.JavaExpandSelectionTest#test() | n/a |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 549ms is not within [0%, 110%] of 435ms |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 331ms is not within [0%, 110%] of 297ms |
| performance.JavaFormatterProjectTest#test() | n/a |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 2.82s is not within [0%, 110%] of 2.16s |
|
|
| performance.JavaFormatterTest#test() | n/a |
|
|
|
|
| performance.JavaIndenterTest#testJavaIndenter2() |
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 37ms is not within [0%, 110%] of 27ms |
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 27ms is not within [0%, 110%] of 21ms |
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 17ms is not within [0%, 110%] of 13ms |
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 15ms is not within [0%, 110%] of 8ms |
|
| performance.JavaMoveLineTest#test() |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 5.98m is not within [0%, 110%] of 2.07m |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 3.31m is not within [0%, 110%] of 2.17m |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 23.97s is not within [0%, 110%] of 1.95s |
|
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
| performance.JavaReplaceAllTest#test() |
|
|
|
|
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
| performance.JavaReplaceAllWithQuickDiffTest#test() |
|
|
|
|
|
| performance.JavaTypingInvocationCountTest#test00() |
|
|
|
|
|
| performance.JavaTypingInvocationCountTest#test01() |
|
|
|
|
|
| performance.JavaTypingInvocationCountTest#test02() |
|
|
|
|
|
| performance.JavaTypingInvocationCountTest#test03() |
|
|
|
|
|
| performance.JavaTypingInvocationCountTest#test10() |
|
|
|
|
|
| performance.JavaTypingInvocationCountTest#test11() |
|
|
|
|
|
| performance.JavaTypingInvocationCountTest#test12() |
|
|
|
|
|
| performance.JavaTypingInvocationCountTest#test13() |
|
|
|
|
|
| performance.LineTrackerPerformanceTest#testLineByIndex() | n/a |
|
|
|
|
| performance.LineTrackerPerformanceTest#testLineByIndex2() | n/a |
|
|
|
|
| performance.LineTrackerPerformanceTest#testLineByOffset() | n/a |
|
|
|
|
| performance.LineTrackerPerformanceTest#testLineByOffset2() | n/a |
|
|
|
|
| performance.LineTrackerPerformanceTest#testRandomReplace() | n/a |
|
|
|
|
| performance.LineTrackerPerformanceTest#testReplace() | n/a |
|
|
|
|
| performance.LineTrackerPerformanceTest#testSet() | n/a |
|
|
|
|
| performance.NonInitialTypingTest#testTypeAMethod() |
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 4ms is not within [0%, 110%] of 3ms |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
| performance.OpenJavaContentAssistTest#test1()-cold | n/a |
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 549ms is not within [0%, 110%] of 359ms |
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 490ms is not within [0%, 110%] of 222ms |
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 444ms is not within [0%, 110%] of 310ms |
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 382ms is not within [0%, 110%] of 238ms |
| performance.OpenJavaContentAssistTest#test1()-warm | n/a |
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 546ms is not within [0%, 110%] of 319ms |
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 507ms is not within [0%, 110%] of 180ms |
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 426ms is not within [0%, 110%] of 306ms |
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 351ms is not within [0%, 110%] of 240ms |
| performance.OpenJavaEditorInvocationCountTest#test() |
|
|
|
|
|
| performance.OpenJavaEditorStartupTest#testJavaEditorStartup() |
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 29.58s is not within [0%, 110%] of 20.1s; The startup with open Java editor performance has been decreased due to general start-up time degradation. See the org.eclipse.core.tests.runtime.perf.UIStartupTest.testUIApplicationStartup performance test on the detailed org.eclipse.core performance results page. |
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 14.94s is not within [0%, 110%] of 12.35s; The startup with open Java editor performance has been decreased due to general start-up time degradation. See the org.eclipse.core.tests.runtime.perf.UIStartupTest.testUIApplicationStartup performance test on the detailed org.eclipse.core performance results page. |
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 21.08s is not within [0%, 110%] of 10.06s; The startup with open Java editor performance has been decreased due to general start-up time degradation. See the org.eclipse.core.tests.runtime.perf.UIStartupTest.testUIApplicationStartup performance test on the detailed org.eclipse.core performance results page. |
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 15.11s is not within [0%, 110%] of 12.25s; The startup with open Java editor performance has been decreased due to general start-up time degradation. See the org.eclipse.core.tests.runtime.perf.UIStartupTest.testUIApplicationStartup performance test on the detailed org.eclipse.core performance results page. |
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 11.55s is not within [0%, 110%] of 9.33s; The startup with open Java editor performance has been decreased due to general start-up time degradation. See the org.eclipse.core.tests.runtime.perf.UIStartupTest.testUIApplicationStartup performance test on the detailed org.eclipse.core performance results page. |
| performance.OpenJavaEditorTest#testOpenEditor3() |
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 2.63s is not within [0%, 110%] of 1.38s |
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 849ms is not within [0%, 110%] of 748ms |
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 1.06s is not within [0%, 110%] of 618ms |
|
|
| performance.OpenJavaEditorTest#testOpenEditor4() |
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 2.35s is not within [0%, 110%] of 1.15s |
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 709ms is not within [0%, 110%] of 618ms |
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 837ms is not within [0%, 110%] of 530ms |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
|
| performance.OpenJavaEditorTest#testOpenEditor5() |
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 1.25s is not within [0%, 110%] of 882ms |
|
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 654ms is not within [0%, 110%] of 422ms |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
|
| performance.OpenJavaEditorTest#testOpenEditor6() |
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 1.03s is not within [0%, 110%] of 682ms |
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 420ms is not within [0%, 110%] of 378ms |
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 460ms is not within [0%, 110%] of 325ms |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 364ms is not within [0%, 110%] of 329ms |
| performance.OpenJavaEditorTest#testOpenJavaEditor1() |
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 3.46s is not within [0%, 110%] of 596ms |
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 502ms is not within [0%, 110%] of 444ms |
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 640ms is not within [0%, 110%] of 403ms |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 442ms is not within [0%, 110%] of 369ms |
| performance.OpenJavaEditorTest#testOpenJavaEditor2() |
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 3.19s is not within [0%, 110%] of 583ms |
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 542ms is not within [0%, 110%] of 387ms |
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 613ms is not within [0%, 110%] of 388ms |
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 474ms is not within [0%, 110%] of 353ms |
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 443ms is not within [0%, 110%] of 333ms |
| performance.OpenPreferencePageTest#testOpenPreferencePage()-cold |
|
|
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 172ms is not within [0%, 110%] of 125ms |
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 110ms is not within [0%, 110%] of 94ms |
| performance.OpenQuickOutlineTest#testOpenQuickOutline1()-cold | n/a |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). | n/a |
|
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
| performance.OpenQuickOutlineTest#testOpenQuickOutline1()-warm | n/a |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). | n/a |
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 292ms is not within [0%, 110%] of 248ms |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
| performance.OpenTextEditorStartupTest#testTextEditorStartup() |
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 12.79s is not within [0%, 110%] of 11.12s; The startup with open Text editor performance has been decreased due to general start-up time degradation. See the org.eclipse.core.tests.runtime.perf.UIStartupTest.testUIApplicationStartup performance test on the detailed org.eclipse.core performance results page. |
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 8.47s is not within [0%, 110%] of 7.29s; The startup with open Text editor performance has been decreased due to general start-up time degradation. See the org.eclipse.core.tests.runtime.perf.UIStartupTest.testUIApplicationStartup performance test on the detailed org.eclipse.core performance results page. |
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 7.25s is not within [0%, 110%] of 6.41s; The startup with open Text editor performance has been decreased due to general start-up time degradation. See the org.eclipse.core.tests.runtime.perf.UIStartupTest.testUIApplicationStartup performance test on the detailed org.eclipse.core performance results page. |
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 9.92s is not within [0%, 110%] of 8.25s; The startup with open Text editor performance has been decreased due to general start-up time degradation. See the org.eclipse.core.tests.runtime.perf.UIStartupTest.testUIApplicationStartup performance test on the detailed org.eclipse.core performance results page. |
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 7s is not within [0%, 110%] of 5.73s; The startup with open Text editor performance has been decreased due to general start-up time degradation. See the org.eclipse.core.tests.runtime.perf.UIStartupTest.testUIApplicationStartup performance test on the detailed org.eclipse.core performance results page. |
| performance.OpenTextEditorTest#testOpenEditor3() |
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 289ms is not within [0%, 110%] of 216ms |
|
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 180ms is not within [0%, 110%] of 111ms |
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 129ms is not within [0%, 110%] of 115ms |
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 95ms is not within [0%, 110%] of 79ms |
| performance.OpenTextEditorTest#testOpenTextEditor1() |
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 379ms is not within [0%, 110%] of 196ms |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 167ms is not within [0%, 110%] of 88ms |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
|
| performance.OpenTextEditorTest#testOpenTextEditor2() |
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 414ms is not within [0%, 110%] of 187ms |
|
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 165ms is not within [0%, 110%] of 88ms |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
| performance.QuickDiffInvocationCountTest#test() |
|
|
|
|
|
| performance.RevertJavaEditorTest#test2() |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 326ms is not within [0%, 110%] of 273ms |
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 177ms is not within [0%, 110%] of 160ms |
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 250ms is not within [0%, 110%] of 126ms |
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 212ms is not within [0%, 110%] of 172ms |
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 153ms is not within [0%, 110%] of 131ms |
| performance.RevertJavaEditorTest#testRevertJavaEditor() |
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 1.41s is not within [0%, 110%] of 429ms |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 282ms is not within [0%, 110%] of 208ms |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 334ms is not within [0%, 110%] of 291ms |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
| performance.RevertTextEditorTest#testRevertTextEditor() |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 87ms is not within [0%, 110%] of 67ms |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 55ms is not within [0%, 110%] of 26ms |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
|
| performance.SaveJavaEditorTest#test1() | n/a |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 7.16s is not within [0%, 110%] of 2.02s |
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 3.97s is not within [0%, 110%] of 362ms |
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 14.04s is not within [0%, 110%] of 7.31s |
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 1.58s is not within [0%, 110%] of 462ms |
| performance.SaveTextEditorTest#test1() | n/a |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 1.3s is not within [0%, 110%] of 617ms |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 1.13s is not within [0%, 110%] of 564ms |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 2.62s is not within [0%, 110%] of 931ms |
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 546ms is not within [0%, 110%] of 412ms |
| performance.ScrollAnnotatedJavaEditorInvocationCountTest#testLineWise() |
|
|
|
|
|
| performance.ScrollAnnotatedJavaEditorInvocationCountTest#testLineWiseNoCaretMove() |
|
|
|
|
|
| performance.ScrollAnnotatedJavaEditorInvocationCountTest#testLineWiseSelect() |
|
|
|
|
|
| performance.ScrollAnnotatedJavaEditorInvocationCountTest#testPageWise() |
|
|
|
|
|
| performance.ScrollAnnotatedJavaEditorTest#testScrollJavaEditorLineWise1() |
|
|
|
|
|
| performance.ScrollAnnotatedJavaEditorTest#testScrollJavaEditorLineWiseMoveCaret1() |
|
|
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 16.05s is not within [0%, 110%] of 12.9s |
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 14.3s is not within [0%, 110%] of 11.02s |
| performance.ScrollAnnotatedJavaEditorTest#testScrollJavaEditorLineWiseSelect1() |
|
|
|
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 15.61s is not within [0%, 110%] of 12.21s |
| performance.ScrollAnnotatedJavaEditorTest#testScrollJavaEditorPageWise() |
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 11.22s is not within [0%, 110%] of 10.13s |
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 9.95s is not within [0%, 110%] of 8.25s |
|
|
| performance.ScrollJavaEditorTest#testScrollJavaEditorLineWise2() |
|
|
|
|
|
| performance.ScrollJavaEditorTest#testScrollJavaEditorLineWiseMoveCaret2() |
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 22.86s is not within [0%, 110%] of 19.79s |
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 14.69s is not within [0%, 110%] of 11.37s |
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 13.42s is not within [0%, 110%] of 9.7s |
| performance.ScrollJavaEditorTest#testScrollJavaEditorLineWiseSelect2() |
|
|
|
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 14.69s is not within [0%, 110%] of 10.91s |
| performance.ScrollJavaEditorTest#testScrollJavaEditorPageWise() |
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 20.6s is not within [0%, 110%] of 18.58s |
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 10.77s is not within [0%, 110%] of 9.5s |
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 9.76s is not within [0%, 110%] of 8.04s |
|
|
| performance.ScrollTextEditorTest#testScrollTextEditorLineWise2() |
|
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
|
|
|
| performance.ScrollTextEditorTest#testScrollTextEditorLineWiseMoveCaret2() |
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 36.08s is not within [0%, 110%] of 32.8s |
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 19.25s is not within [0%, 110%] of 16.71s |
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 16.76s is not within [0%, 110%] of 15.15s |
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 13.84s is not within [0%, 110%] of 11.66s |
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 8.59s is not within [0%, 110%] of 7.22s |
| performance.ScrollTextEditorTest#testScrollTextEditorLineWiseSelect2() |
|
|
|
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 9.97s is not within [0%, 110%] of 8.47s |
| performance.ScrollTextEditorTest#testScrollTextEditorPageWise() |
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 15.69s is not within [0%, 110%] of 13.98s |
|
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 6.91s is not within [0%, 110%] of 5.61s |
|
|
| performance.SynchronizedLineDifferInitializationTest#testInitializationWithFewChanges() | n/a |
|
|
|
|
| performance.SynchronizedLineDifferInitializationTest#testInitializationWithManyChanges() | n/a |
|
|
|
|
| performance.SynchronizedLineDifferInitializationTest#testInitializationWithManyChangesButEqualSize() | n/a |
|
|
|
|
| performance.SynchronizedLineDifferInitializationTest#testInitializationWithNoChanges() | n/a |
|
|
|
|
| performance.TextMoveLineTest#test() |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 1s is not within [0%, 110%] of 557ms |
|
|
| performance.TextNonInitialTypingTest#testTypeAMethod() |
|
|
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
|
| performance.TextTypingInvocationCountTest#test00() |
|
|
|
|
|
| performance.TextTypingInvocationCountTest#test01() |
|
|
|
|
|
| performance.TextTypingInvocationCountTest#test02() |
|
|
|
|
|
| performance.TextTypingInvocationCountTest#test03() |
|
|
|
|
|
| performance.TextTypingInvocationCountTest#test10() |
|
|
|
|
|
| performance.TextTypingInvocationCountTest#test11() |
|
|
|
|
|
| performance.TextTypingInvocationCountTest#test12() |
|
|
|
|
|
| performance.TextTypingInvocationCountTest#test13() |
|
|
|
|
|
| performance.ToggleCommentTest#testToggleComment2()-comment |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 361ms is not within [0%, 110%] of 267ms |
|
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 1.53s is not within [0%, 110%] of 364ms |
|
| performance.ToggleCommentTest#testToggleComment2()-uncomment |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 658ms is not within [0%, 110%] of 247ms |
|
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 1.62s is not within [0%, 110%] of 494ms |
|
| performance.UndoJavaEditorTest#testUndoJavaEditor2() |
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 53.19s is not within [0%, 110%] of 34.99s |
|
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 16.27s is not within [0%, 110%] of 13.24s |
|
|
| performance.UndoTextEditorTest#testUndoTextEditor2() |
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 40.53s is not within [0%, 110%] of 26.28s |
|
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 12.48s is not within [0%, 110%] of 9.01s |
|
|
