Performance of org.eclipse.jdt.text: 3.2 relative to 3.1

RHEL 4.0 Sun 1.4.2_08 (3 GHz 2.5 GB)

Win XP Sun 1.4.2_08 (3 Hz 2 GB)

RHEL 3.0 Sun 1.4.2_08 (3 GHz 2 GB)

Win XP Sun 1.4.2_08 (2 GHz 512 MB)

RHEL 3.0 Sun 1.4.2_08 (2 GHz 512 MB)


Scenario Status

The green/red indication is based on the assert condition in the test. Hover over for error message.
Click on or for detailed results.
Grayed images mark explainable degradations.
Yellow images mark results where there is not enough evidence to reject the null hypothesis at the 90%level (Student's t-test).
"n/a" - results not available.

All 102 scenarios

RHEL 3.0 Sun 1.4.2_08 (2 GHz 512 MB)
RHEL 3.0 Sun 1.4.2_08 (3 GHz 2 GB)
RHEL 4.0 Sun 1.4.2_08 (3 GHz 2.5 GB)
Win XP Sun 1.4.2_08 (2 GHz 512 MB)
Win XP Sun 1.4.2_08 (3 Hz 2 GB)
performance.ActivateJavaEditorTest#testActivateEditor() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 2.9s is not within [0%, 110%] of 2.29s; Java editor activation was not working correctly in 3.1 (see bug 119326 and bug 120572). The fixes result this expected performance degradation. There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
performance.ActivateTextEditorTest#testActivateEditor()
performance.CodeCompletionPerformanceTest#testApplicationNoParamters() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
performance.CodeCompletionPerformanceTest#testApplicationWithParamterGuesses()
performance.CodeCompletionPerformanceTest#testApplicationWithParamterGuesses2()
performance.CodeCompletionPerformanceTest#testApplicationWithParamterNames() Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 1.83s is not within [0%, 110%] of 1.64s Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 1.32s is not within [0%, 110%] of 1.2s
performance.CodeCompletionPerformanceTest#testCompletionNoParamters()
performance.CodeCompletionPerformanceTest#testCompletionWithParamterGuesses()
performance.CodeCompletionPerformanceTest#testCompletionWithParamterGuesses2()
performance.CodeCompletionPerformanceTest#testCompletionWithParamterNames()
performance.ContentTypeTest#testJavaDirty() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 108ms is not within [0%, 110%] of 96ms Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 106ms is not within [0%, 110%] of 85ms Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 100ms is not within [0%, 110%] of 78ms Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 103ms is not within [0%, 110%] of 87ms
performance.ContentTypeTest#testPluginPropertiesDirty() Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 143ms is not within [0%, 110%] of 129ms Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 146ms is not within [0%, 110%] of 131ms
performance.ContentTypeTest#testPluginXMLDirty() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
performance.ContentTypeTest#testPropertiesDirty() Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 117ms is not within [0%, 110%] of 103ms Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 110ms is not within [0%, 110%] of 91ms Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 109ms is not within [0%, 110%] of 90ms Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 109ms is not within [0%, 110%] of 96ms
performance.ContentTypeTest#testTextDirty() Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 102ms is not within [0%, 110%] of 85ms Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 101ms is not within [0%, 110%] of 81ms Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 97ms is not within [0%, 110%] of 72ms Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 100ms is not within [0%, 110%] of 78ms
performance.ConvertLineDelimitersProjectTest#test() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
performance.DocumentLineDifferInitializationTest#testInitializationWithFewChanges() n/a
performance.DocumentLineDifferInitializationTest#testInitializationWithManyChanges() n/a
performance.DocumentLineDifferInitializationTest#testInitializationWithManyChangesButEqualSize()
performance.DocumentLineDifferInitializationTest#testInitializationWithNoChanges()
performance.DocumentLineDifferModificationTest#testEditingChanged()
performance.DocumentLineDifferModificationTest#testEditingUnchanged()
performance.JavaExpandSelectionTest#test() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 349ms is not within [0%, 110%] of 303ms
performance.JavaFormatterProjectTest#test() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
performance.JavaFormatterTest#test()
performance.JavaIndenterTest#testJavaIndenter2() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 16ms is not within [0%, 110%] of 13ms
performance.JavaMoveLineTest#test() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 9.17m is not within [0%, 110%] of 3.26m There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
performance.JavaReplaceAllTest#test()
performance.JavaReplaceAllWithQuickDiffTest#test()
performance.JavaTypingInvocationCountTest#test00()
performance.JavaTypingInvocationCountTest#test01()
performance.JavaTypingInvocationCountTest#test02()
performance.JavaTypingInvocationCountTest#test03()
performance.JavaTypingInvocationCountTest#test10()
performance.JavaTypingInvocationCountTest#test11()
performance.JavaTypingInvocationCountTest#test12()
performance.JavaTypingInvocationCountTest#test13()
performance.LineTrackerPerformanceTest#testLineByIndex()
performance.LineTrackerPerformanceTest#testLineByIndex2()
performance.LineTrackerPerformanceTest#testLineByOffset()
performance.LineTrackerPerformanceTest#testLineByOffset2()
performance.LineTrackerPerformanceTest#testRandomReplace()
performance.LineTrackerPerformanceTest#testReplace()
performance.LineTrackerPerformanceTest#testSet()
performance.NonInitialTypingTest#testTypeAMethod() Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 256ms is not within [0%, 110%] of 3ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 546ms is not within [0%, 110%] of 488ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
performance.OpenJavaContentAssistTest#test1()-cold Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 655ms is not within [0%, 110%] of 488ms Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 528ms is not within [0%, 110%] of 399ms Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 305ms is not within [0%, 110%] of 221ms Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 445ms is not within [0%, 110%] of 302ms Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 408ms is not within [0%, 110%] of 205ms
performance.OpenJavaContentAssistTest#test1()-warm Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 596ms is not within [0%, 110%] of 509ms Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 562ms is not within [0%, 110%] of 391ms Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 265ms is not within [0%, 110%] of 192ms Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 449ms is not within [0%, 110%] of 306ms Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 395ms is not within [0%, 110%] of 208ms
performance.OpenJavaEditorInvocationCountTest#test()
performance.OpenJavaEditorStartupTest#testJavaEditorStartup() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 23.78s is not within [0%, 110%] of 20.23s; The startup with open Java editor performance has been decreased due to general start-up time degradation. See the org.eclipse.core.tests.runtime.perf.UIStartupTest.testUIApplicationStartup performance test on the detailed org.eclipse.core performance results page. Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 15.1s is not within [0%, 110%] of 12.3s; The startup with open Java editor performance has been decreased due to general start-up time degradation. See the org.eclipse.core.tests.runtime.perf.UIStartupTest.testUIApplicationStartup performance test on the detailed org.eclipse.core performance results page. Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 12.3s is not within [0%, 110%] of 10.36s; The startup with open Java editor performance has been decreased due to general start-up time degradation. See the org.eclipse.core.tests.runtime.perf.UIStartupTest.testUIApplicationStartup performance test on the detailed org.eclipse.core performance results page. Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 15.12s is not within [0%, 110%] of 12.3s; The startup with open Java editor performance has been decreased due to general start-up time degradation. See the org.eclipse.core.tests.runtime.perf.UIStartupTest.testUIApplicationStartup performance test on the detailed org.eclipse.core performance results page. Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 11.48s is not within [0%, 110%] of 9.26s; The startup with open Java editor performance has been decreased due to general start-up time degradation. See the org.eclipse.core.tests.runtime.perf.UIStartupTest.testUIApplicationStartup performance test on the detailed org.eclipse.core performance results page.
performance.OpenJavaEditorTest#testOpenEditor3() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 674ms is not within [0%, 110%] of 594ms
performance.OpenJavaEditorTest#testOpenEditor4() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 558ms is not within [0%, 110%] of 500ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
performance.OpenJavaEditorTest#testOpenEditor5() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 475ms is not within [0%, 110%] of 410ms
performance.OpenJavaEditorTest#testOpenEditor6() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
performance.OpenJavaEditorTest#testOpenJavaEditor1() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 710ms is not within [0%, 110%] of 619ms Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 515ms is not within [0%, 110%] of 446ms Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 525ms is not within [0%, 110%] of 403ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 469ms is not within [0%, 110%] of 403ms Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 466ms is not within [0%, 110%] of 334ms
performance.OpenJavaEditorTest#testOpenJavaEditor2() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 758ms is not within [0%, 110%] of 652ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 545ms is not within [0%, 110%] of 446ms Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 498ms is not within [0%, 110%] of 371ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 424ms is not within [0%, 110%] of 337ms
performance.OpenPreferencePageTest#testOpenPreferencePage()-cold Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 187ms is not within [0%, 110%] of 1ms Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 172ms is not within [0%, 110%] of 156ms Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 110ms is not within [0%, 110%] of 78ms
performance.OpenQuickOutlineTest#testOpenQuickOutline1()-cold Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 290ms is not within [0%, 110%] of 238ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
performance.OpenQuickOutlineTest#testOpenQuickOutline1()-warm There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
performance.OpenTextEditorStartupTest#testTextEditorStartup() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 12.71s is not within [0%, 110%] of 11.14s; The startup with open Text editor performance has been decreased due to general start-up time degradation. See the org.eclipse.core.tests.runtime.perf.UIStartupTest.testUIApplicationStartup performance test on the detailed org.eclipse.core performance results page. Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 8.63s is not within [0%, 110%] of 7.31s; The startup with open Text editor performance has been decreased due to general start-up time degradation. See the org.eclipse.core.tests.runtime.perf.UIStartupTest.testUIApplicationStartup performance test on the detailed org.eclipse.core performance results page. Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 7.3s is not within [0%, 110%] of 6.18s; The startup with open Text editor performance has been decreased due to general start-up time degradation. See the org.eclipse.core.tests.runtime.perf.UIStartupTest.testUIApplicationStartup performance test on the detailed org.eclipse.core performance results page. Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 10.08s is not within [0%, 110%] of 8.39s; The startup with open Text editor performance has been decreased due to general start-up time degradation. See the org.eclipse.core.tests.runtime.perf.UIStartupTest.testUIApplicationStartup performance test on the detailed org.eclipse.core performance results page. Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 7.02s is not within [0%, 110%] of 5.78s; The startup with open Text editor performance has been decreased due to general start-up time degradation. See the org.eclipse.core.tests.runtime.perf.UIStartupTest.testUIApplicationStartup performance test on the detailed org.eclipse.core performance results page.
performance.OpenTextEditorTest#testOpenEditor3() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 130ms is not within [0%, 110%] of 110ms Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 123ms is not within [0%, 110%] of 111ms Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 95ms is not within [0%, 110%] of 80ms
performance.OpenTextEditorTest#testOpenTextEditor1() Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 104ms is not within [0%, 110%] of 92ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
performance.OpenTextEditorTest#testOpenTextEditor2() Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 98ms is not within [0%, 110%] of 87ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
performance.QuickDiffInvocationCountTest#test()
performance.RevertJavaEditorTest#test2() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 177ms is not within [0%, 110%] of 157ms Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 152ms is not within [0%, 110%] of 126ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 150ms is not within [0%, 110%] of 125ms
performance.RevertJavaEditorTest#testRevertJavaEditor() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 300ms is not within [0%, 110%] of 272ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
performance.RevertTextEditorTest#testRevertTextEditor() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
performance.SaveJavaEditorTest#test1() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 11.31s is not within [0%, 110%] of 5.36s Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 6.12s is not within [0%, 110%] of 1.86s There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 3.9s is not within [0%, 110%] of 788ms Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 11.74s is not within [0%, 110%] of 4.01s Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 1.73s is not within [0%, 110%] of 453ms
performance.SaveTextEditorTest#test1() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 3.12s is not within [0%, 110%] of 1.46s There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 8.34s is not within [0%, 110%] of 1.15s There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 606ms is not within [0%, 110%] of 447ms
performance.ScrollAnnotatedJavaEditorInvocationCountTest#testLineWise()
performance.ScrollAnnotatedJavaEditorInvocationCountTest#testLineWiseNoCaretMove()
performance.ScrollAnnotatedJavaEditorInvocationCountTest#testLineWiseSelect()
performance.ScrollAnnotatedJavaEditorInvocationCountTest#testPageWise()
performance.ScrollAnnotatedJavaEditorTest#testScrollJavaEditorLineWise1()
performance.ScrollAnnotatedJavaEditorTest#testScrollJavaEditorLineWiseMoveCaret1() Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 15.61s is not within [0%, 110%] of 12.81s Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 14.39s is not within [0%, 110%] of 10.96s
performance.ScrollAnnotatedJavaEditorTest#testScrollJavaEditorLineWiseSelect1() Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 15.63s is not within [0%, 110%] of 12.18s
performance.ScrollAnnotatedJavaEditorTest#testScrollJavaEditorPageWise() Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 9.96s is not within [0%, 110%] of 8.26s
performance.ScrollJavaEditorTest#testScrollJavaEditorLineWise2()
performance.ScrollJavaEditorTest#testScrollJavaEditorLineWiseMoveCaret2() Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 23.27s is not within [0%, 110%] of 20.46s Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 19.88s is not within [0%, 110%] of 18.04s Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 14.48s is not within [0%, 110%] of 10.97s Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 13.49s is not within [0%, 110%] of 9.6s
performance.ScrollJavaEditorTest#testScrollJavaEditorLineWiseSelect2() Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 14.77s is not within [0%, 110%] of 10.81s
performance.ScrollJavaEditorTest#testScrollJavaEditorPageWise() Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 10.82s is not within [0%, 110%] of 9.65s Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 9.76s is not within [0%, 110%] of 7.99s
performance.ScrollTextEditorTest#testScrollTextEditorLineWise2() Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 7.67s is not within [0%, 110%] of 6.97s
performance.ScrollTextEditorTest#testScrollTextEditorLineWiseMoveCaret2() Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 12.16s is not within [0%, 110%] of 10.03s Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 8.6s is not within [0%, 110%] of 7.19s
performance.ScrollTextEditorTest#testScrollTextEditorLineWiseSelect2() Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 10s is not within [0%, 110%] of 8.45s
performance.ScrollTextEditorTest#testScrollTextEditorPageWise() Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 6.83s is not within [0%, 110%] of 5.62s
performance.SynchronizedLineDifferInitializationTest#testInitializationWithFewChanges()
performance.SynchronizedLineDifferInitializationTest#testInitializationWithManyChanges()
performance.SynchronizedLineDifferInitializationTest#testInitializationWithManyChangesButEqualSize()
performance.SynchronizedLineDifferInitializationTest#testInitializationWithNoChanges()
performance.TextMoveLineTest#test() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 4.63s is not within [0%, 110%] of 4.14s There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
performance.TextNonInitialTypingTest#testTypeAMethod() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 288ms is not within [0%, 110%] of 209ms
performance.TextTypingInvocationCountTest#test00()
performance.TextTypingInvocationCountTest#test01()
performance.TextTypingInvocationCountTest#test02()
performance.TextTypingInvocationCountTest#test03()
performance.TextTypingInvocationCountTest#test10()
performance.TextTypingInvocationCountTest#test11()
performance.TextTypingInvocationCountTest#test12()
performance.TextTypingInvocationCountTest#test13()
performance.ToggleCommentTest#testToggleComment2()-comment There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 880ms is not within [0%, 110%] of 432ms
performance.ToggleCommentTest#testToggleComment2()-uncomment Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 230ms is not within [0%, 110%] of 207ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 1.03s is not within [0%, 110%] of 833ms
performance.UndoJavaEditorTest#testUndoJavaEditor2()
performance.UndoTextEditorTest#testUndoTextEditor2()