All 88 scenarios |
RHEL 3.0 Sun 1.4.2_08 (2 GHz 512 MB) | RHEL 3.0 Sun 1.4.2_08 (3 GHz 2 GB) | Win XP Sun 1.4.2_08 (2 GHz 512 MB) | Win XP Sun 1.4.2_08 (3 GHz 2 GB) |
| performance.ActivateJavaEditorTest#testActivateEditor() |
 |
|
|
|
| performance.ActivateTextEditorTest#testActivateEditor() |
|
|
|
|
| performance.CodeCompletionPerformanceTest#testApplicationNoParamters() |
|
| 
Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 1.26 s is not within [0%, 110%] of 1.06 s |
Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 1.05 s is not within [0%, 110%] of 848 ms |
| performance.CodeCompletionPerformanceTest#testApplicationWithParamterGuesses() |
Performance criteria not met when compared to '{config=eclipseperflnx1, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 3.65 s is not within [0%, 110%] of 3.11 s |
Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 2.41 s is not within [0%, 110%] of 2.17 s |
Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 2.23 s is not within [0%, 110%] of 1.64 s |
Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 1.74 s is not within [0%, 110%] of 1.31 s |
| performance.CodeCompletionPerformanceTest#testApplicationWithParamterGuesses2() |
|
|
Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 2.63 s is not within [0%, 110%] of 1.84 s |
Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 2.05 s is not within [0%, 110%] of 1.58 s |
| performance.CodeCompletionPerformanceTest#testApplicationWithParamterNames() |
|
|
Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 1.71 s is not within [0%, 110%] of 1.35 s |
Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 1.3 s is not within [0%, 110%] of 1.1 s |
| performance.CodeCompletionPerformanceTest#testCompletionNoParamters() |
Performance criteria not met when compared to '{config=eclipseperflnx1, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 657 ms is not within [0%, 110%] of 471 ms |
Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 469 ms is not within [0%, 110%] of 314 ms |
Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 615 ms is not within [0%, 110%] of 468 ms |
Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 440 ms is not within [0%, 110%] of 293 ms |
| performance.CodeCompletionPerformanceTest#testCompletionWithParamterGuesses() |
Performance criteria not met when compared to '{config=eclipseperflnx1, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 653 ms is not within [0%, 110%] of 469 ms |
Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 474 ms is not within [0%, 110%] of 310 ms |
Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 606 ms is not within [0%, 110%] of 467 ms |
Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 442 ms is not within [0%, 110%] of 290 ms |
| performance.CodeCompletionPerformanceTest#testCompletionWithParamterGuesses2() |
Performance criteria not met when compared to '{config=eclipseperflnx1, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 1.99 s is not within [0%, 110%] of 772 ms |
Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 1.44 s is not within [0%, 110%] of 540 ms |
Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 1.71 s is not within [0%, 110%] of 728 ms |
Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 1.25 s is not within [0%, 110%] of 500 ms |
| performance.CodeCompletionPerformanceTest#testCompletionWithParamterNames() |
Performance criteria not met when compared to '{config=eclipseperflnx1, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 655 ms is not within [0%, 110%] of 468 ms |
Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 472 ms is not within [0%, 110%] of 310 ms |
Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 610 ms is not within [0%, 110%] of 465 ms |
Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 442 ms is not within [0%, 110%] of 292 ms |
| performance.ContentTypeTest#testJavaDirty() |
|
|
|
|
| performance.ContentTypeTest#testPluginPropertiesDirty() |
|
|
|
|
| performance.ContentTypeTest#testPluginXMLDirty() |
|
|
|
|
| performance.ContentTypeTest#testPropertiesDirty() |
|
|
|
|
| performance.ContentTypeTest#testTextDirty() |
|
|
|
|
| performance.ConvertLineDelimitersProjectTest#test() |
|
|
|
|
| performance.JavaExpandSelectionTest#test() |
|
|
|
|
| performance.JavaFormatterProjectTest#test() |
|
Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 3.29 s is not within [0%, 110%] of 2.96 s |
|
|
| performance.JavaFormatterTest#test() |
|
|
|
|
| performance.JavaIndenterTest#testJavaIndenter2() |
|
|
|
|
| performance.JavaMoveLineTest#test() |
Performance criteria not met when compared to '{config=eclipseperflnx1, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 3.75 m is not within [0%, 110%] of 6.06 s |
Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 3.26 m is not within [0%, 110%] of 6.42 s |
Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 4.88 s is not within [0%, 110%] of 3.99 s |
Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 3.22 s is not within [0%, 110%] of 2.36 s |
| performance.JavaReplaceAllTest#test() |
|
|
Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 1.74 s is not within [0%, 110%] of 1.57 s |
Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 1.56 s is not within [0%, 110%] of 1.39 s |
| performance.JavaReplaceAllWithQuickDiffTest#test() |
Performance criteria not met when compared to '{config=eclipseperflnx1, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 2.02 m is not within [0%, 110%] of 2.19 s |
Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 1.57 m is not within [0%, 110%] of 1.74 s |
Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 2.15 m is not within [0%, 110%] of 1.87 s |
Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 1.44 m is not within [0%, 110%] of 1.36 s |
| performance.JavaSmartPasteTest#testSmartPaste() |
|
|
|
|
| performance.JavaTypingInvocationCountTest#test00() |
|
|
|
|
| performance.JavaTypingInvocationCountTest#test01() |
| n/a |
|
|
| performance.JavaTypingInvocationCountTest#test02() |
|
|
|
|
| performance.JavaTypingInvocationCountTest#test03() |
|
|
|
|
| performance.JavaTypingInvocationCountTest#test10() |
|
|
|
|
| performance.JavaTypingInvocationCountTest#test11() |
|
|
|
|
| performance.JavaTypingInvocationCountTest#test12() |
|
|
|
|
| performance.JavaTypingInvocationCountTest#test13() |
|
|
|
|
| performance.NonInitialTypingTest#testTypeAMethod() |
|
|
|
|
| performance.OpenJavaContentAssistTest#test1()-cold |
|
|
|
|
| performance.OpenJavaContentAssistTest#test1()-warm |
|
|
|
|
| performance.OpenJavaEditorInvocationCountTest#test() |
|
|
|
|
| performance.OpenJavaEditorStartupTest#testJavaEditorStartup() | 
Performance criteria not met when compared to '{config=eclipseperflnx1, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 21.72 s is not within [0%, 110%] of 19.33 s; The startup with open Java editor performance has been decreased due to lazy plug-in and class loading |
Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 14.55 s is not within [0%, 110%] of 12.19 s; The startup with open Java editor performance has been decreased due to lazy plug-in and class loading |
Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 15.47 s is not within [0%, 110%] of 13.23 s; The startup with open Java editor performance has been decreased due to lazy plug-in and class loading |
Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 12.06 s is not within [0%, 110%] of 9.8 s; The startup with open Java editor performance has been decreased due to lazy plug-in and class loading |
| performance.OpenJavaEditorTest#testOpenEditor3() |
|
|
|
|
| performance.OpenJavaEditorTest#testOpenEditor4() |
|
|
|
|
| performance.OpenJavaEditorTest#testOpenEditor5() |
|
|
|
|
| performance.OpenJavaEditorTest#testOpenEditor6() |
|
|
|
|
| performance.OpenJavaEditorTest#testOpenFirstEditor() |
|
|
|
|
| performance.OpenJavaEditorTest#testOpenJavaEditor1() |
|
|
|
|
| performance.OpenJavaEditorTest#testOpenJavaEditor2() |
|
|
|
|
| performance.OpenPreferencePageTest#testOpenPreferencePage()-cold |
|
|
|
|
| performance.OpenQuickOutlineTest#testOpenQuickOutline1()-cold |
|
|
Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 247 ms is not within [0%, 110%] of 209 ms |
|
| performance.OpenQuickOutlineTest#testOpenQuickOutline1()-warm |
|
|
|
|
| performance.OpenTextEditorStartupTest#testTextEditorStartup() |
Performance criteria not met when compared to '{config=eclipseperflnx1, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 13.86 s is not within [0%, 110%] of 9.73 s; The startup with open Text editor performance has been decreased due to lazy plug-in and class loading |
Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 10.35 s is not within [0%, 110%] of 6.56 s; The startup with open Text editor performance has been decreased due to lazy plug-in and class loading |
Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 11.53 s is not within [0%, 110%] of 7.06 s; The startup with open Text editor performance has been decreased due to lazy plug-in and class loading |
Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 8.98 s is not within [0%, 110%] of 5.05 s; The startup with open Text editor performance has been decreased due to lazy plug-in and class loading |
| performance.OpenTextEditorTest#testOpenEditor3() |
|
|
|
|
| performance.OpenTextEditorTest#testOpenFirstEditor() |
|
|
|
|
| performance.OpenTextEditorTest#testOpenTextEditor1() |
|
|
Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 125 ms is not within [0%, 110%] of 112 ms |
|
| performance.OpenTextEditorTest#testOpenTextEditor2() |
|
|
|
|
| performance.QuickDiffInvocationCountTest#test() |
|
|
|
|
| performance.RevertJavaEditorTest#test2() |
|
|
|
|
| performance.RevertJavaEditorTest#testRevertJavaEditor() |
|
|
|
|
| performance.RevertTextEditorTest#testRevertTextEditor() |
|
|
|
|
| performance.SaveJavaEditorTest#test1() |
|
|
|
|
| performance.SaveTextEditorTest#test1() |
|
Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 843 ms is not within [0%, 110%] of 324 ms |
Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 1.07 s is not within [0%, 110%] of 859 ms |
|
| performance.ScrollAnnotatedJavaEditorInvocationCountTest#testLineWise() |
|
|
|
|
| performance.ScrollAnnotatedJavaEditorInvocationCountTest#testLineWiseNoCaretMove() |
|
|
|
|
| performance.ScrollAnnotatedJavaEditorInvocationCountTest#testLineWiseSelect() |
|
|
|
|
| performance.ScrollAnnotatedJavaEditorInvocationCountTest#testPageWise() |
|
|
|
|
| performance.ScrollAnnotatedJavaEditorTest#testScrollJavaEditorLineWise1() |
|
|
Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 13.18 s is not within [0%, 110%] of 10.45 s |
Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 11.98 s is not within [0%, 110%] of 9.26 s |
| performance.ScrollAnnotatedJavaEditorTest#testScrollJavaEditorLineWiseMoveCaret1() |
|
|
|
|
| performance.ScrollAnnotatedJavaEditorTest#testScrollJavaEditorLineWiseSelect1() |
|
|
Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 33.38 s is not within [0%, 110%] of 19.09 s |
|
| performance.ScrollAnnotatedJavaEditorTest#testScrollJavaEditorPageWise() |
|
|
Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 9.2 s is not within [0%, 110%] of 5.94 s |
Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 9.41 s is not within [0%, 110%] of 7.16 s |
| performance.ScrollJavaEditorTest#testScrollJavaEditorLineWise2() |
|
|
Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 11.43 s is not within [0%, 110%] of 9.17 s |
Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 10.67 s is not within [0%, 110%] of 7.98 s |
| performance.ScrollJavaEditorTest#testScrollJavaEditorLineWiseMoveCaret2() |
|
|
|
|
| performance.ScrollJavaEditorTest#testScrollJavaEditorLineWiseSelect2() |
|
|
Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 27.88 s is not within [0%, 110%] of 14.05 s |
|
| performance.ScrollJavaEditorTest#testScrollJavaEditorPageWise() |
|
|
Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 8.92 s is not within [0%, 110%] of 4.86 s |
Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 9.25 s is not within [0%, 110%] of 5.78 s |
| performance.ScrollTextEditorTest#testScrollTextEditorLineWise2() |
|
|
|
Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 7.14 s is not within [0%, 110%] of 6.02 s |
| performance.ScrollTextEditorTest#testScrollTextEditorLineWiseMoveCaret2() |
|
|
|
|
| performance.ScrollTextEditorTest#testScrollTextEditorLineWiseSelect2() |
|
|
|
|
| performance.ScrollTextEditorTest#testScrollTextEditorPageWise() |
|
|
Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 5.64 s is not within [0%, 110%] of 3.21 s |
Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 5.58 s is not within [0%, 110%] of 3.66 s |
| performance.TextMoveLineTest#test() |
|
|
|
|
| performance.TextNonInitialTypingTest#testTypeAMethod() |
|
|
|
|
| performance.TextTypingInvocationCountTest#test00() |
|
|
|
|
| performance.TextTypingInvocationCountTest#test01() |
|
|
|
|
| performance.TextTypingInvocationCountTest#test02() |
|
|
|
|
| performance.TextTypingInvocationCountTest#test03() |
|
|
|
|
| performance.TextTypingInvocationCountTest#test10() |
|
|
|
|
| performance.TextTypingInvocationCountTest#test11() |
|
|
|
|
| performance.TextTypingInvocationCountTest#test12() |
|
|
|
|
| performance.TextTypingInvocationCountTest#test13() |
|
|
|
|
| performance.ToggleCommentTest#testToggleComment2()-comment |
|
|
|
Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 8.8 s is not within [0%, 110%] of 1.97 s |
| performance.ToggleCommentTest#testToggleComment2()-uncomment |
|
|
|
Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 5.38 s is not within [0%, 110%] of 1.47 s |
| performance.UndoJavaEditorTest#testUndoJavaEditor2() |
Performance criteria not met when compared to '{config=eclipseperflnx1, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 35.47 s is not within [0%, 110%] of 32.12 s |
Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 15.77 s is not within [0%, 110%] of 13 s |
|
Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.0_200406251208_200509161301, jvm=sun1.4.2_08}':
Elapsed Process: 14.69 s is not within [0%, 110%] of 12.62 s |
| performance.UndoTextEditorTest#testUndoTextEditor2() |
|
|
|
|
