All 102 scenarios |
RHEL 3.0 Sun 1.4.2_08 (2 GHz 512 MB) | RHEL 3.0 Sun 1.4.2_08 (3 GHz 2 GB) | RHEL 4.0 Sun 1.4.2_08 (3 GHz 2.5 GB) | Win XP Sun 1.4.2_08 (2 GHz 512 MB) | Win XP Sun 1.4.2_08 (3 Hz 2 GB) |
| performance.ActivateJavaEditorTest#testActivateEditor() |
 |
|
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). | 
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 2.9s is not within [0%, 110%] of 2.29s; Java editor activation was not working correctly in 3.1 (see bug 119326 and bug 120572). The fixes result this expected performance degradation. |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
| performance.ActivateTextEditorTest#testActivateEditor() |
 |
|
|
|
|
| performance.CodeCompletionPerformanceTest#testApplicationNoParamters() | 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
|
|
| performance.CodeCompletionPerformanceTest#testApplicationWithParamterGuesses() |
|
|
|
|
|
| performance.CodeCompletionPerformanceTest#testApplicationWithParamterGuesses2() |
|
|
|
|
|
| performance.CodeCompletionPerformanceTest#testApplicationWithParamterNames() |
|
|
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 1.83s is not within [0%, 110%] of 1.64s |
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 1.32s is not within [0%, 110%] of 1.2s |
| performance.CodeCompletionPerformanceTest#testCompletionNoParamters() |
|
|
|
|
|
| performance.CodeCompletionPerformanceTest#testCompletionWithParamterGuesses() |
|
|
|
|
|
| performance.CodeCompletionPerformanceTest#testCompletionWithParamterGuesses2() |
|
|
|
|
|
| performance.CodeCompletionPerformanceTest#testCompletionWithParamterNames() |
|
|
|
|
|
| performance.ContentTypeTest#testJavaDirty() |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 108ms is not within [0%, 110%] of 96ms |
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 106ms is not within [0%, 110%] of 85ms |
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 100ms is not within [0%, 110%] of 78ms |
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 103ms is not within [0%, 110%] of 87ms |
| performance.ContentTypeTest#testPluginPropertiesDirty() |
|
|
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 143ms is not within [0%, 110%] of 129ms |
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 146ms is not within [0%, 110%] of 131ms |
|
| performance.ContentTypeTest#testPluginXMLDirty() |
|
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
|
|
|
| performance.ContentTypeTest#testPropertiesDirty() |
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 117ms is not within [0%, 110%] of 103ms |
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 110ms is not within [0%, 110%] of 91ms |
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 109ms is not within [0%, 110%] of 90ms |
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 109ms is not within [0%, 110%] of 96ms |
| performance.ContentTypeTest#testTextDirty() |
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 102ms is not within [0%, 110%] of 85ms |
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 101ms is not within [0%, 110%] of 81ms |
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 97ms is not within [0%, 110%] of 72ms |
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 100ms is not within [0%, 110%] of 78ms |
| performance.ConvertLineDelimitersProjectTest#test() |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
| performance.DocumentLineDifferInitializationTest#testInitializationWithFewChanges() |
|
|
|
| n/a |
| performance.DocumentLineDifferInitializationTest#testInitializationWithManyChanges() |
|
|
|
| n/a |
| performance.DocumentLineDifferInitializationTest#testInitializationWithManyChangesButEqualSize() |
|
|
|
|
|
| performance.DocumentLineDifferInitializationTest#testInitializationWithNoChanges() |
|
|
|
|
|
| performance.DocumentLineDifferModificationTest#testEditingChanged() |
|
|
|
|
|
| performance.DocumentLineDifferModificationTest#testEditingUnchanged() |
|
|
|
|
|
| performance.JavaExpandSelectionTest#test() |
|
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
|
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 349ms is not within [0%, 110%] of 303ms |
| performance.JavaFormatterProjectTest#test() |
|
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
|
|
| performance.JavaFormatterTest#test() |
|
|
|
|
|
| performance.JavaIndenterTest#testJavaIndenter2() |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
|
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 16ms is not within [0%, 110%] of 13ms |
|
|
| performance.JavaMoveLineTest#test() |
| 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 9.17m is not within [0%, 110%] of 3.26m |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
|
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
| performance.JavaReplaceAllTest#test() |
|
|
|
|
|
| performance.JavaReplaceAllWithQuickDiffTest#test() |
|
|
|
|
|
| performance.JavaTypingInvocationCountTest#test00() |
|
|
|
|
|
| performance.JavaTypingInvocationCountTest#test01() |
|
|
|
|
|
| performance.JavaTypingInvocationCountTest#test02() |
|
|
|
|
|
| performance.JavaTypingInvocationCountTest#test03() |
|
|
|
|
|
| performance.JavaTypingInvocationCountTest#test10() |
|
|
|
|
|
| performance.JavaTypingInvocationCountTest#test11() |
|
|
|
|
|
| performance.JavaTypingInvocationCountTest#test12() |
|
|
|
|
|
| performance.JavaTypingInvocationCountTest#test13() |
|
|
|
|
|
| performance.LineTrackerPerformanceTest#testLineByIndex() |
|
|
|
|
|
| performance.LineTrackerPerformanceTest#testLineByIndex2() |
|
|
|
|
|
| performance.LineTrackerPerformanceTest#testLineByOffset() |
|
|
|
|
|
| performance.LineTrackerPerformanceTest#testLineByOffset2() |
|
|
|
|
|
| performance.LineTrackerPerformanceTest#testRandomReplace() |
|
|
|
|
|
| performance.LineTrackerPerformanceTest#testReplace() |
|
|
|
|
|
| performance.LineTrackerPerformanceTest#testSet() |
|
|
|
|
|
| performance.NonInitialTypingTest#testTypeAMethod() |
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 256ms is not within [0%, 110%] of 3ms |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 546ms is not within [0%, 110%] of 488ms |
|
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
| performance.OpenJavaContentAssistTest#test1()-cold |
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 655ms is not within [0%, 110%] of 488ms |
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 528ms is not within [0%, 110%] of 399ms |
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 305ms is not within [0%, 110%] of 221ms |
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 445ms is not within [0%, 110%] of 302ms |
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 408ms is not within [0%, 110%] of 205ms |
| performance.OpenJavaContentAssistTest#test1()-warm |
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 596ms is not within [0%, 110%] of 509ms |
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 562ms is not within [0%, 110%] of 391ms |
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 265ms is not within [0%, 110%] of 192ms |
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 449ms is not within [0%, 110%] of 306ms |
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 395ms is not within [0%, 110%] of 208ms |
| performance.OpenJavaEditorInvocationCountTest#test() |
|
|
|
|
|
| performance.OpenJavaEditorStartupTest#testJavaEditorStartup() |
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 23.78s is not within [0%, 110%] of 20.23s; The startup with open Java editor performance has been decreased due to general start-up time degradation. See the org.eclipse.core.tests.runtime.perf.UIStartupTest.testUIApplicationStartup performance test on the detailed org.eclipse.core performance results page. |
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 15.1s is not within [0%, 110%] of 12.3s; The startup with open Java editor performance has been decreased due to general start-up time degradation. See the org.eclipse.core.tests.runtime.perf.UIStartupTest.testUIApplicationStartup performance test on the detailed org.eclipse.core performance results page. |
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 12.3s is not within [0%, 110%] of 10.36s; The startup with open Java editor performance has been decreased due to general start-up time degradation. See the org.eclipse.core.tests.runtime.perf.UIStartupTest.testUIApplicationStartup performance test on the detailed org.eclipse.core performance results page. |
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 15.12s is not within [0%, 110%] of 12.3s; The startup with open Java editor performance has been decreased due to general start-up time degradation. See the org.eclipse.core.tests.runtime.perf.UIStartupTest.testUIApplicationStartup performance test on the detailed org.eclipse.core performance results page. |
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 11.48s is not within [0%, 110%] of 9.26s; The startup with open Java editor performance has been decreased due to general start-up time degradation. See the org.eclipse.core.tests.runtime.perf.UIStartupTest.testUIApplicationStartup performance test on the detailed org.eclipse.core performance results page. |
| performance.OpenJavaEditorTest#testOpenEditor3() |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
|
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 674ms is not within [0%, 110%] of 594ms |
|
|
| performance.OpenJavaEditorTest#testOpenEditor4() |
|
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 558ms is not within [0%, 110%] of 500ms |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
|
| performance.OpenJavaEditorTest#testOpenEditor5() |
|
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 475ms is not within [0%, 110%] of 410ms |
|
|
| performance.OpenJavaEditorTest#testOpenEditor6() |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
|
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
| performance.OpenJavaEditorTest#testOpenJavaEditor1() |
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 710ms is not within [0%, 110%] of 619ms |
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 515ms is not within [0%, 110%] of 446ms |
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 525ms is not within [0%, 110%] of 403ms |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 469ms is not within [0%, 110%] of 403ms |
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 466ms is not within [0%, 110%] of 334ms |
| performance.OpenJavaEditorTest#testOpenJavaEditor2() |
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 758ms is not within [0%, 110%] of 652ms |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 545ms is not within [0%, 110%] of 446ms |
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 498ms is not within [0%, 110%] of 371ms |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 424ms is not within [0%, 110%] of 337ms |
| performance.OpenPreferencePageTest#testOpenPreferencePage()-cold |
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 187ms is not within [0%, 110%] of 1ms |
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 172ms is not within [0%, 110%] of 156ms |
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 110ms is not within [0%, 110%] of 78ms |
| performance.OpenQuickOutlineTest#testOpenQuickOutline1()-cold |
|
|
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 290ms is not within [0%, 110%] of 238ms |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
| performance.OpenQuickOutlineTest#testOpenQuickOutline1()-warm |
|
|
|
|
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
| performance.OpenTextEditorStartupTest#testTextEditorStartup() |
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 12.71s is not within [0%, 110%] of 11.14s; The startup with open Text editor performance has been decreased due to general start-up time degradation. See the org.eclipse.core.tests.runtime.perf.UIStartupTest.testUIApplicationStartup performance test on the detailed org.eclipse.core performance results page. |
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 8.63s is not within [0%, 110%] of 7.31s; The startup with open Text editor performance has been decreased due to general start-up time degradation. See the org.eclipse.core.tests.runtime.perf.UIStartupTest.testUIApplicationStartup performance test on the detailed org.eclipse.core performance results page. |
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 7.3s is not within [0%, 110%] of 6.18s; The startup with open Text editor performance has been decreased due to general start-up time degradation. See the org.eclipse.core.tests.runtime.perf.UIStartupTest.testUIApplicationStartup performance test on the detailed org.eclipse.core performance results page. |
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 10.08s is not within [0%, 110%] of 8.39s; The startup with open Text editor performance has been decreased due to general start-up time degradation. See the org.eclipse.core.tests.runtime.perf.UIStartupTest.testUIApplicationStartup performance test on the detailed org.eclipse.core performance results page. |
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 7.02s is not within [0%, 110%] of 5.78s; The startup with open Text editor performance has been decreased due to general start-up time degradation. See the org.eclipse.core.tests.runtime.perf.UIStartupTest.testUIApplicationStartup performance test on the detailed org.eclipse.core performance results page. |
| performance.OpenTextEditorTest#testOpenEditor3() |
|
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 130ms is not within [0%, 110%] of 110ms |
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 123ms is not within [0%, 110%] of 111ms |
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 95ms is not within [0%, 110%] of 80ms |
| performance.OpenTextEditorTest#testOpenTextEditor1() |
|
|
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 104ms is not within [0%, 110%] of 92ms |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
|
| performance.OpenTextEditorTest#testOpenTextEditor2() |
|
|
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 98ms is not within [0%, 110%] of 87ms |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
| performance.QuickDiffInvocationCountTest#test() |
|
|
|
|
|
| performance.RevertJavaEditorTest#test2() |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 177ms is not within [0%, 110%] of 157ms |
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 152ms is not within [0%, 110%] of 126ms |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 150ms is not within [0%, 110%] of 125ms |
| performance.RevertJavaEditorTest#testRevertJavaEditor() |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 300ms is not within [0%, 110%] of 272ms |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
| performance.RevertTextEditorTest#testRevertTextEditor() |
|
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
|
| performance.SaveJavaEditorTest#test1() |
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 11.31s is not within [0%, 110%] of 5.36s |
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 6.12s is not within [0%, 110%] of 1.86s |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 3.9s is not within [0%, 110%] of 788ms |
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 11.74s is not within [0%, 110%] of 4.01s |
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 1.73s is not within [0%, 110%] of 453ms |
| performance.SaveTextEditorTest#test1() |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 3.12s is not within [0%, 110%] of 1.46s |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 8.34s is not within [0%, 110%] of 1.15s |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 606ms is not within [0%, 110%] of 447ms |
| performance.ScrollAnnotatedJavaEditorInvocationCountTest#testLineWise() |
|
|
|
|
|
| performance.ScrollAnnotatedJavaEditorInvocationCountTest#testLineWiseNoCaretMove() |
|
|
|
|
|
| performance.ScrollAnnotatedJavaEditorInvocationCountTest#testLineWiseSelect() |
|
|
|
|
|
| performance.ScrollAnnotatedJavaEditorInvocationCountTest#testPageWise() |
|
|
|
|
|
| performance.ScrollAnnotatedJavaEditorTest#testScrollJavaEditorLineWise1() |
|
|
|
|
|
| performance.ScrollAnnotatedJavaEditorTest#testScrollJavaEditorLineWiseMoveCaret1() |
|
|
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 15.61s is not within [0%, 110%] of 12.81s |
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 14.39s is not within [0%, 110%] of 10.96s |
| performance.ScrollAnnotatedJavaEditorTest#testScrollJavaEditorLineWiseSelect1() |
|
|
|
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 15.63s is not within [0%, 110%] of 12.18s |
| performance.ScrollAnnotatedJavaEditorTest#testScrollJavaEditorPageWise() |
|
|
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 9.96s is not within [0%, 110%] of 8.26s |
|
|
| performance.ScrollJavaEditorTest#testScrollJavaEditorLineWise2() |
|
|
|
|
|
| performance.ScrollJavaEditorTest#testScrollJavaEditorLineWiseMoveCaret2() |
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 23.27s is not within [0%, 110%] of 20.46s |
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 19.88s is not within [0%, 110%] of 18.04s |
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 14.48s is not within [0%, 110%] of 10.97s |
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 13.49s is not within [0%, 110%] of 9.6s |
| performance.ScrollJavaEditorTest#testScrollJavaEditorLineWiseSelect2() |
|
|
|
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 14.77s is not within [0%, 110%] of 10.81s |
| performance.ScrollJavaEditorTest#testScrollJavaEditorPageWise() |
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 10.82s is not within [0%, 110%] of 9.65s |
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 9.76s is not within [0%, 110%] of 7.99s |
|
|
| performance.ScrollTextEditorTest#testScrollTextEditorLineWise2() |
|
|
|
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 7.67s is not within [0%, 110%] of 6.97s |
| performance.ScrollTextEditorTest#testScrollTextEditorLineWiseMoveCaret2() |
|
|
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 12.16s is not within [0%, 110%] of 10.03s |
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 8.6s is not within [0%, 110%] of 7.19s |
| performance.ScrollTextEditorTest#testScrollTextEditorLineWiseSelect2() |
|
|
|
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 10s is not within [0%, 110%] of 8.45s |
| performance.ScrollTextEditorTest#testScrollTextEditorPageWise() |
|
|
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 6.83s is not within [0%, 110%] of 5.62s |
|
|
| performance.SynchronizedLineDifferInitializationTest#testInitializationWithFewChanges() |
|
|
|
|
|
| performance.SynchronizedLineDifferInitializationTest#testInitializationWithManyChanges() |
|
|
|
|
|
| performance.SynchronizedLineDifferInitializationTest#testInitializationWithManyChangesButEqualSize() |
|
|
|
|
|
| performance.SynchronizedLineDifferInitializationTest#testInitializationWithNoChanges() |
|
|
|
|
|
| performance.TextMoveLineTest#test() |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 4.63s is not within [0%, 110%] of 4.14s |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
|
|
| performance.TextNonInitialTypingTest#testTypeAMethod() |
|
|
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 288ms is not within [0%, 110%] of 209ms |
|
|
| performance.TextTypingInvocationCountTest#test00() |
|
|
|
|
|
| performance.TextTypingInvocationCountTest#test01() |
|
|
|
|
|
| performance.TextTypingInvocationCountTest#test02() |
|
|
|
|
|
| performance.TextTypingInvocationCountTest#test03() |
|
|
|
|
|
| performance.TextTypingInvocationCountTest#test10() |
|
|
|
|
|
| performance.TextTypingInvocationCountTest#test11() |
|
|
|
|
|
| performance.TextTypingInvocationCountTest#test12() |
|
|
|
|
|
| performance.TextTypingInvocationCountTest#test13() |
|
|
|
|
|
| performance.ToggleCommentTest#testToggleComment2()-comment |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). |
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 880ms is not within [0%, 110%] of 432ms |
|
| performance.ToggleCommentTest#testToggleComment2()-uncomment |
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 230ms is not within [0%, 110%] of 207ms |
|
There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}':
Elapsed Process: 1.03s is not within [0%, 110%] of 833ms |
|
| performance.UndoJavaEditorTest#testUndoJavaEditor2() |
|
|
|
|
|
| performance.UndoTextEditorTest#testUndoTextEditor2() |
|
|
|
|
|
