Performance of org.eclipse.jdt.text: 3.2.1 relative to 3.1

RHEL 4.0 Sun 1.4.2_08 (3 GHz 2.5 GB)

Win XP Sun 1.4.2_08 (3 GHz 2 GB)

RHEL 3.0 Sun 1.4.2_08 (3 GHz 2 B)

Win XP Sun 1.4.2_08 (2 GHz 512 MB)

RHEL 3.0 Sun 1.4.2_08 (2 GHz 512 MB)


Scenario Status

The green/red indication is based on the assert condition in the test. Hover over for error message.
Click on or for detailed results.
Grayed images mark explainable degradations.
Yellow images mark results where there is not enough evidence to reject the null hypothesis at the 90%level (Student's t-test).
"n/a" - results not available.

All 102 scenarios

RHEL 3.0 Sun 1.4.2_08 (2 GHz 512 MB)
RHEL 3.0 Sun 1.4.2_08 (3 GHz 2 B)
RHEL 4.0 Sun 1.4.2_08 (3 GHz 2.5 GB)
Win XP Sun 1.4.2_08 (2 GHz 512 MB)
Win XP Sun 1.4.2_08 (3 GHz 2 GB)
performance.ActivateJavaEditorTest#testActivateEditor() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
performance.ActivateTextEditorTest#testActivateEditor()n/a There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 1.67s is not within [0%, 110%] of 1.16s
performance.CodeCompletionPerformanceTest#testApplicationNoParamters()n/a There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 1.12s is not within [0%, 110%] of 779ms Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 1.37s is not within [0%, 110%] of 1.25s
performance.CodeCompletionPerformanceTest#testApplicationWithParamterGuesses()n/a
performance.CodeCompletionPerformanceTest#testApplicationWithParamterGuesses2()n/a There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
performance.CodeCompletionPerformanceTest#testApplicationWithParamterNames()n/a There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 1.84s is not within [0%, 110%] of 1.64s Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 1.33s is not within [0%, 110%] of 1.21s
performance.CodeCompletionPerformanceTest#testCompletionNoParamters()n/a Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 434ms is not within [0%, 110%] of 379ms
performance.CodeCompletionPerformanceTest#testCompletionWithParamterGuesses()n/a There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
performance.CodeCompletionPerformanceTest#testCompletionWithParamterGuesses2()n/a
performance.CodeCompletionPerformanceTest#testCompletionWithParamterNames()n/a Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 480ms is not within [0%, 110%] of 381ms
performance.ContentTypeTest#testJavaDirty()n/a Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 107ms is not within [0%, 110%] of 92ms Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 124ms is not within [0%, 110%] of 87ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 100ms is not within [0%, 110%] of 90ms
performance.ContentTypeTest#testPluginPropertiesDirty()n/a Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 156ms is not within [0%, 110%] of 141ms Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 172ms is not within [0%, 110%] of 129ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
performance.ContentTypeTest#testPluginXMLDirty()n/a Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 1.2s is not within [0%, 110%] of 822ms
performance.ContentTypeTest#testPropertiesDirty()n/a Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 116ms is not within [0%, 110%] of 99ms Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 131ms is not within [0%, 110%] of 95ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
performance.ContentTypeTest#testTextDirty()n/a Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 102ms is not within [0%, 110%] of 83ms Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 119ms is not within [0%, 110%] of 80ms Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 81ms is not within [0%, 110%] of 72ms Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 100ms is not within [0%, 110%] of 81ms
performance.ConvertLineDelimitersProjectTest#test()n/a There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 2.04s is not within [0%, 110%] of 1.85s There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
performance.DocumentLineDifferInitializationTest#testInitializationWithFewChanges()n/a
performance.DocumentLineDifferInitializationTest#testInitializationWithManyChanges()n/a
performance.DocumentLineDifferInitializationTest#testInitializationWithManyChangesButEqualSize()n/a
performance.DocumentLineDifferInitializationTest#testInitializationWithNoChanges()n/a
performance.DocumentLineDifferModificationTest#testEditingChanged()n/a
performance.DocumentLineDifferModificationTest#testEditingUnchanged()n/a
performance.JavaExpandSelectionTest#test()n/a There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 549ms is not within [0%, 110%] of 435ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 331ms is not within [0%, 110%] of 297ms
performance.JavaFormatterProjectTest#test()n/a There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 2.82s is not within [0%, 110%] of 2.16s
performance.JavaFormatterTest#test()n/a
performance.JavaIndenterTest#testJavaIndenter2() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 37ms is not within [0%, 110%] of 27ms Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 27ms is not within [0%, 110%] of 21ms Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 17ms is not within [0%, 110%] of 13ms Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 15ms is not within [0%, 110%] of 8ms
performance.JavaMoveLineTest#test() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 5.98m is not within [0%, 110%] of 2.07m There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 3.31m is not within [0%, 110%] of 2.17m There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 23.97s is not within [0%, 110%] of 1.95s There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
performance.JavaReplaceAllTest#test() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
performance.JavaReplaceAllWithQuickDiffTest#test()
performance.JavaTypingInvocationCountTest#test00()
performance.JavaTypingInvocationCountTest#test01()
performance.JavaTypingInvocationCountTest#test02()
performance.JavaTypingInvocationCountTest#test03()
performance.JavaTypingInvocationCountTest#test10()
performance.JavaTypingInvocationCountTest#test11()
performance.JavaTypingInvocationCountTest#test12()
performance.JavaTypingInvocationCountTest#test13()
performance.LineTrackerPerformanceTest#testLineByIndex()n/a
performance.LineTrackerPerformanceTest#testLineByIndex2()n/a
performance.LineTrackerPerformanceTest#testLineByOffset()n/a
performance.LineTrackerPerformanceTest#testLineByOffset2()n/a
performance.LineTrackerPerformanceTest#testRandomReplace()n/a
performance.LineTrackerPerformanceTest#testReplace()n/a
performance.LineTrackerPerformanceTest#testSet()n/a
performance.NonInitialTypingTest#testTypeAMethod() Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 4ms is not within [0%, 110%] of 3ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
performance.OpenJavaContentAssistTest#test1()-coldn/a Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 549ms is not within [0%, 110%] of 359ms Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 490ms is not within [0%, 110%] of 222ms Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 444ms is not within [0%, 110%] of 310ms Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 382ms is not within [0%, 110%] of 238ms
performance.OpenJavaContentAssistTest#test1()-warmn/a Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 546ms is not within [0%, 110%] of 319ms Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 507ms is not within [0%, 110%] of 180ms Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 426ms is not within [0%, 110%] of 306ms Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 351ms is not within [0%, 110%] of 240ms
performance.OpenJavaEditorInvocationCountTest#test()
performance.OpenJavaEditorStartupTest#testJavaEditorStartup() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 29.58s is not within [0%, 110%] of 20.1s; The startup with open Java editor performance has been decreased due to general start-up time degradation. See the org.eclipse.core.tests.runtime.perf.UIStartupTest.testUIApplicationStartup performance test on the detailed org.eclipse.core performance results page. Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 14.94s is not within [0%, 110%] of 12.35s; The startup with open Java editor performance has been decreased due to general start-up time degradation. See the org.eclipse.core.tests.runtime.perf.UIStartupTest.testUIApplicationStartup performance test on the detailed org.eclipse.core performance results page. Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 21.08s is not within [0%, 110%] of 10.06s; The startup with open Java editor performance has been decreased due to general start-up time degradation. See the org.eclipse.core.tests.runtime.perf.UIStartupTest.testUIApplicationStartup performance test on the detailed org.eclipse.core performance results page. Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 15.11s is not within [0%, 110%] of 12.25s; The startup with open Java editor performance has been decreased due to general start-up time degradation. See the org.eclipse.core.tests.runtime.perf.UIStartupTest.testUIApplicationStartup performance test on the detailed org.eclipse.core performance results page. Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 11.55s is not within [0%, 110%] of 9.33s; The startup with open Java editor performance has been decreased due to general start-up time degradation. See the org.eclipse.core.tests.runtime.perf.UIStartupTest.testUIApplicationStartup performance test on the detailed org.eclipse.core performance results page.
performance.OpenJavaEditorTest#testOpenEditor3() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 2.63s is not within [0%, 110%] of 1.38s Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 849ms is not within [0%, 110%] of 748ms Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 1.06s is not within [0%, 110%] of 618ms
performance.OpenJavaEditorTest#testOpenEditor4() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 2.35s is not within [0%, 110%] of 1.15s Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 709ms is not within [0%, 110%] of 618ms Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 837ms is not within [0%, 110%] of 530ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
performance.OpenJavaEditorTest#testOpenEditor5() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 1.25s is not within [0%, 110%] of 882ms Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 654ms is not within [0%, 110%] of 422ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
performance.OpenJavaEditorTest#testOpenEditor6() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 1.03s is not within [0%, 110%] of 682ms Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 420ms is not within [0%, 110%] of 378ms Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 460ms is not within [0%, 110%] of 325ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 364ms is not within [0%, 110%] of 329ms
performance.OpenJavaEditorTest#testOpenJavaEditor1() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 3.46s is not within [0%, 110%] of 596ms Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 502ms is not within [0%, 110%] of 444ms Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 640ms is not within [0%, 110%] of 403ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 442ms is not within [0%, 110%] of 369ms
performance.OpenJavaEditorTest#testOpenJavaEditor2() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 3.19s is not within [0%, 110%] of 583ms Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 542ms is not within [0%, 110%] of 387ms Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 613ms is not within [0%, 110%] of 388ms Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 474ms is not within [0%, 110%] of 353ms Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 443ms is not within [0%, 110%] of 333ms
performance.OpenPreferencePageTest#testOpenPreferencePage()-cold Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 172ms is not within [0%, 110%] of 125ms Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 110ms is not within [0%, 110%] of 94ms
performance.OpenQuickOutlineTest#testOpenQuickOutline1()-coldn/a There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).n/a There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
performance.OpenQuickOutlineTest#testOpenQuickOutline1()-warmn/a There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).n/a Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 292ms is not within [0%, 110%] of 248ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
performance.OpenTextEditorStartupTest#testTextEditorStartup() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 12.79s is not within [0%, 110%] of 11.12s; The startup with open Text editor performance has been decreased due to general start-up time degradation. See the org.eclipse.core.tests.runtime.perf.UIStartupTest.testUIApplicationStartup performance test on the detailed org.eclipse.core performance results page. Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 8.47s is not within [0%, 110%] of 7.29s; The startup with open Text editor performance has been decreased due to general start-up time degradation. See the org.eclipse.core.tests.runtime.perf.UIStartupTest.testUIApplicationStartup performance test on the detailed org.eclipse.core performance results page. Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 7.25s is not within [0%, 110%] of 6.41s; The startup with open Text editor performance has been decreased due to general start-up time degradation. See the org.eclipse.core.tests.runtime.perf.UIStartupTest.testUIApplicationStartup performance test on the detailed org.eclipse.core performance results page. Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 9.92s is not within [0%, 110%] of 8.25s; The startup with open Text editor performance has been decreased due to general start-up time degradation. See the org.eclipse.core.tests.runtime.perf.UIStartupTest.testUIApplicationStartup performance test on the detailed org.eclipse.core performance results page. Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 7s is not within [0%, 110%] of 5.73s; The startup with open Text editor performance has been decreased due to general start-up time degradation. See the org.eclipse.core.tests.runtime.perf.UIStartupTest.testUIApplicationStartup performance test on the detailed org.eclipse.core performance results page.
performance.OpenTextEditorTest#testOpenEditor3() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 289ms is not within [0%, 110%] of 216ms Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 180ms is not within [0%, 110%] of 111ms Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 129ms is not within [0%, 110%] of 115ms Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 95ms is not within [0%, 110%] of 79ms
performance.OpenTextEditorTest#testOpenTextEditor1() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 379ms is not within [0%, 110%] of 196ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 167ms is not within [0%, 110%] of 88ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
performance.OpenTextEditorTest#testOpenTextEditor2() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 414ms is not within [0%, 110%] of 187ms Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 165ms is not within [0%, 110%] of 88ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
performance.QuickDiffInvocationCountTest#test()
performance.RevertJavaEditorTest#test2() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 326ms is not within [0%, 110%] of 273ms Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 177ms is not within [0%, 110%] of 160ms Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 250ms is not within [0%, 110%] of 126ms Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 212ms is not within [0%, 110%] of 172ms Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 153ms is not within [0%, 110%] of 131ms
performance.RevertJavaEditorTest#testRevertJavaEditor() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 1.41s is not within [0%, 110%] of 429ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 282ms is not within [0%, 110%] of 208ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 334ms is not within [0%, 110%] of 291ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
performance.RevertTextEditorTest#testRevertTextEditor() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 87ms is not within [0%, 110%] of 67ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 55ms is not within [0%, 110%] of 26ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
performance.SaveJavaEditorTest#test1()n/a There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 7.16s is not within [0%, 110%] of 2.02s Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 3.97s is not within [0%, 110%] of 362ms Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 14.04s is not within [0%, 110%] of 7.31s Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 1.58s is not within [0%, 110%] of 462ms
performance.SaveTextEditorTest#test1()n/a There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 1.3s is not within [0%, 110%] of 617ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 1.13s is not within [0%, 110%] of 564ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 2.62s is not within [0%, 110%] of 931ms Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 546ms is not within [0%, 110%] of 412ms
performance.ScrollAnnotatedJavaEditorInvocationCountTest#testLineWise()
performance.ScrollAnnotatedJavaEditorInvocationCountTest#testLineWiseNoCaretMove()
performance.ScrollAnnotatedJavaEditorInvocationCountTest#testLineWiseSelect()
performance.ScrollAnnotatedJavaEditorInvocationCountTest#testPageWise()
performance.ScrollAnnotatedJavaEditorTest#testScrollJavaEditorLineWise1()
performance.ScrollAnnotatedJavaEditorTest#testScrollJavaEditorLineWiseMoveCaret1() Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 16.05s is not within [0%, 110%] of 12.9s Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 14.3s is not within [0%, 110%] of 11.02s
performance.ScrollAnnotatedJavaEditorTest#testScrollJavaEditorLineWiseSelect1() Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 15.61s is not within [0%, 110%] of 12.21s
performance.ScrollAnnotatedJavaEditorTest#testScrollJavaEditorPageWise() Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 11.22s is not within [0%, 110%] of 10.13s Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 9.95s is not within [0%, 110%] of 8.25s
performance.ScrollJavaEditorTest#testScrollJavaEditorLineWise2()
performance.ScrollJavaEditorTest#testScrollJavaEditorLineWiseMoveCaret2() Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 22.86s is not within [0%, 110%] of 19.79s Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 14.69s is not within [0%, 110%] of 11.37s Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 13.42s is not within [0%, 110%] of 9.7s
performance.ScrollJavaEditorTest#testScrollJavaEditorLineWiseSelect2() Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 14.69s is not within [0%, 110%] of 10.91s
performance.ScrollJavaEditorTest#testScrollJavaEditorPageWise() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 20.6s is not within [0%, 110%] of 18.58s Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 10.77s is not within [0%, 110%] of 9.5s Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 9.76s is not within [0%, 110%] of 8.04s
performance.ScrollTextEditorTest#testScrollTextEditorLineWise2() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
performance.ScrollTextEditorTest#testScrollTextEditorLineWiseMoveCaret2() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 36.08s is not within [0%, 110%] of 32.8s Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 19.25s is not within [0%, 110%] of 16.71s Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 16.76s is not within [0%, 110%] of 15.15s Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 13.84s is not within [0%, 110%] of 11.66s Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 8.59s is not within [0%, 110%] of 7.22s
performance.ScrollTextEditorTest#testScrollTextEditorLineWiseSelect2() Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 9.97s is not within [0%, 110%] of 8.47s
performance.ScrollTextEditorTest#testScrollTextEditorPageWise() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 15.69s is not within [0%, 110%] of 13.98s Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 6.91s is not within [0%, 110%] of 5.61s
performance.SynchronizedLineDifferInitializationTest#testInitializationWithFewChanges()n/a
performance.SynchronizedLineDifferInitializationTest#testInitializationWithManyChanges()n/a
performance.SynchronizedLineDifferInitializationTest#testInitializationWithManyChangesButEqualSize()n/a
performance.SynchronizedLineDifferInitializationTest#testInitializationWithNoChanges()n/a
performance.TextMoveLineTest#test() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 1s is not within [0%, 110%] of 557ms
performance.TextNonInitialTypingTest#testTypeAMethod() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
performance.TextTypingInvocationCountTest#test00()
performance.TextTypingInvocationCountTest#test01()
performance.TextTypingInvocationCountTest#test02()
performance.TextTypingInvocationCountTest#test03()
performance.TextTypingInvocationCountTest#test10()
performance.TextTypingInvocationCountTest#test11()
performance.TextTypingInvocationCountTest#test12()
performance.TextTypingInvocationCountTest#test13()
performance.ToggleCommentTest#testToggleComment2()-comment There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 361ms is not within [0%, 110%] of 267ms Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 1.53s is not within [0%, 110%] of 364ms
performance.ToggleCommentTest#testToggleComment2()-uncomment There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 658ms is not within [0%, 110%] of 247ms There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 1.62s is not within [0%, 110%] of 494ms
performance.UndoJavaEditorTest#testUndoJavaEditor2() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 53.19s is not within [0%, 110%] of 34.99s Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 16.27s is not within [0%, 110%] of 13.24s
performance.UndoTextEditorTest#testUndoTextEditor2() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 40.53s is not within [0%, 110%] of 26.28s Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 12.48s is not within [0%, 110%] of 9.01s