Performance of org.eclipse.jdt.text: I20080617-2000 relative to 3.3 (200806171530)

RHEL 4.0 Sun 1.4.2_10 (3 GHz 2.5 GB)

Win XP Sun 1.4.2_10 (3 GHz 2 GB)

RHEL 3.0 Sun 1.4.2_10 (3 GHz 2 GB)

Win XP Sun 1.4.2_10 (2 GHz 512 MB)


Scenario Status

The following table gives a complete but compact view of performance results for the component.
Each line of the table shows the results for one scenario on all machines.

The name of the scenario is in bold when its results are also displayed in the fingerprints
and starts with an '*' when the scenario has no results in the last baseline run.

Here are information displayed for each test (ie. in each cell): Hints:

All 113 scenarios
RHEL 3.0 Sun 1.4.2_10 (2 GHz 512 MB)
RHEL 3.0 Sun 1.4.2_10 (3 GHz 2 GB)
RHEL 4.0 Sun 1.4.2_10 (3 GHz 2.5 GB)
Win XP Sun 1.4.2_10 (2 GHz 512 MB)
Win XP Sun 1.4.2_10 (3 GHz 2 GB)
ActivateTextEditorTest#testActivateEditor() n/a Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 1.49s is not within [0%, 110%] of 1.3s - 14.3% [±1.1] Performance criteria not met when compared to '{config=eclipseperflnx3, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 1.37s is not within [0%, 110%] of 1.17s - 17.4% [±0.5] - 35.7% [±1.8] Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 724ms is not within [0%, 110%] of 637ms - 13.7% [±1.1]
CodeCompletionPerformanceTest#testApplicationNoParamters() n/a - 6.0% [±1.3] - 5.6% [±1.3] +18.4% [±10.2] - 6.8% [±2.4]
CodeCompletionPerformanceTest#testApplicationWithParamterGuesses() n/a +1.5% [±1.0] +0.7% [±0.6] +0.6% [±0.9] +3.4% [±2.3]
CodeCompletionPerformanceTest#testApplicationWithParamterGuesses2() n/a - 0.3% [±1.4] - 2.2% [±1.5] - 7.0% [±1.7] - 2.9% [±1.6]
CodeCompletionPerformanceTest#testApplicationWithParamterNames() n/a Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 1.88s is not within [0%, 110%] of 1.13s - 65.4% [±2.2] Performance criteria not met when compared to '{config=eclipseperflnx3, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 1.58s is not within [0%, 110%] of 1s - 57.8% [±1.9] - 23.9% [±2.0] Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 1.55s is not within [0%, 110%] of 1.09s - 43.0% [±2.2]
CodeCompletionPerformanceTest#testCompletionNoParamters() n/a +0.9% [±1.0] +4.6% [±1.8] +0.0% [±0.9] +4.1% [±2.1]
CodeCompletionPerformanceTest#testCompletionWithParamterGuesses() n/a +1.8% [±1.5] +1.4% [±0.4] +0.6% [±0.6] +3.5% [±1.1]
CodeCompletionPerformanceTest#testCompletionWithParamterGuesses2() n/a - 4.2% [±0.7] - 2.8% [±0.3] - 2.7% [±0.4] - 0.9% [±2.0]
CodeCompletionPerformanceTest#testCompletionWithParamterNames() n/a +2.6% [±0.8] +2.9% [±0.5] +0.6% [±0.9] +3.5% [±2.0]
ContentTypeTest#testJavaDirty() n/a +0.0% [±2.8] +0.0% [±1.9] +6.9% [±5.6] +9.4% [±6.4]
ContentTypeTest#testPluginPropertiesDirty() n/a +0.0% [±1.0] +0.7% [±0.9] +0.0% [±4.2] +0.0% [±3.7]
ContentTypeTest#testPluginXMLDirty() n/a Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 2.16s is not within [0%, 110%] of 1.75s - 23.7% [±0.6] Performance criteria not met when compared to '{config=eclipseperflnx3, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 1.69s is not within [0%, 110%] of 1.31s - 29.1% [±0.3] - 13.8% [±0.3] Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 2.19s is not within [0%, 110%] of 1.75s - 25.0% [±1.6]
ContentTypeTest#testPropertiesDirty() n/a - 0.9% [±1.5] +0.9% [±1.6] +11.0% [±2.8] +0.0% [±4.1]
ContentTypeTest#testTextDirty() n/a +0.0% [±1.6] +1.0% [±1.5] +0.0% [±5.5] +3.1% [±6.0]
ConvertLineDelimitersProjectTest#test() n/a +26.7% [±37.1] Performance criteria not met when compared to '{config=eclipseperflnx3, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 790ms is not within [0%, 110%] of 702ms - 12.5% [±26.7] +74.4% [±0.6] - 6.9% [±4.9]
DocumentLineDifferInitializationTest#testInitializationWithFewChanges() n/a - 0.4% [±2.5] +0.0% [±0.1] - 3.8% [±2.0] n/a
DocumentLineDifferInitializationTest#testInitializationWithManyChanges() n/a - 0.7% [±0.8] - 0.4% [±0.3] +0.0% [±0.8] +0.0% [±0.1]
DocumentLineDifferInitializationTest#testInitializationWithManyChangesButEqualSize() n/a - 0.3% [±0.4] - 0.1% [±0.1] +0.5% [±2.0] +0.0% [±1.2]
DocumentLineDifferInitializationTest#testInitializationWithNoChanges() n/a +0.0% [±0.3] +0.0% [±0.2] - 0.2% [±1.7] +0.0% [±0.0]
DocumentLineDifferModificationTest#testEditingChanged() n/a +10.3% [±5.2] Performance criteria not met when compared to '{config=eclipseperflnx3, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 21ms is not within [0%, 110%] of 19ms - 10.5% [±7.6] +0.0% [±7.1] +8.0% [±14.5]
DocumentLineDifferModificationTest#testEditingUnchanged() n/a Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 6ms is not within [0%, 110%] of 4ms - 50.0% [±25.6] +0.0% [±5.6] +0.0% [±389.4] +20.0% [±13.7]
DocumentPerformanceTest#measureDeleteInsert() n/a +0.0% [±1.6] +0.0% [±1.4] - 3.7% [±4.2] - 2.9% [±6.4]
DocumentPerformanceTest#measureGetChar() n/a +0.0% [±2.9] +0.0% [±0.3] +2.5% [±1.2] +1.3% [±1.7]
DocumentPerformanceTest#measureGetLength() n/a +0.5% [±2.9] +0.0% [±0.2] +1.4% [±1.1] +1.6% [±2.1]
DocumentPerformanceTest#measureGetLine() n/a +6.6% [±2.0] - 2.0% [±1.5] +0.0% [±2.7] +2.9% [±3.5]
DocumentPerformanceTest#measureGetNumberOfLines() n/a - 2.4% [±1.0] +48.6% [±0.1] +3.6% [±2.4] +7.4% [±2.4]
DocumentPerformanceTest#measureInsertAtEnd() n/a +0.0% [±2.4] +0.0% [±1.4] +0.0% [±1.9] +5.0% [±4.0]
DocumentPerformanceTest#measureInsertAtStart() n/a - 2.2% [±1.5] +0.0% [±1.0] - 0.6% [±0.7] +2.4% [±1.9]
DocumentPerformanceTest#measureLineByIndex() n/a - 0.7% [±1.4] - 1.3% [±0.2] +25.9% [±1.1] +13.1% [±1.9]
DocumentPerformanceTest#measureLineByOffset() n/a - 5.4% [±0.8] +0.0% [±0.3] - 1.0% [±1.3] - 0.5% [±1.4]
DocumentPerformanceTest#measureLineDelimiterByIndex() n/a Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 159ms is not within [0%, 110%] of 130ms - 22.3% [±1.7] - 1.3% [±0.2] +28.4% [±0.9] +17.9% [±1.9]
DocumentPerformanceTest#measureLineInfoByIndex() n/a - 7.1% [±0.7] +3.2% [±0.2] +3.3% [±1.1] +12.6% [±1.2]
DocumentPerformanceTest#measureLineInfoByOffset() n/a - 3.6% [±0.5] - 2.0% [±0.4] - 1.1% [±0.9] +0.0% [±1.1]
DocumentPerformanceTest#measureLineLengthByIndex() n/a - 3.1% [±1.0] +0.0% [±0.2] +16.0% [±2.3] +13.9% [±2.0]
DocumentPerformanceTest#measureRandomReplace() n/a +1.2% [±0.9] - 0.4% [±0.2] +0.0% [±2.2] +3.1% [±3.7]
DocumentPerformanceTest#measureRepeatedReplace() n/a - 3.4% [±1.0] +1.4% [±0.6] +6.7% [±1.4] +1.1% [±1.3]
DocumentPerformanceTest#measureSet() n/a - 5.5% [±2.8] +0.0% [±1.1] +1.3% [±2.8] +3.5% [±4.2]
DocumentPerformanceTest#measureTypingReplaceInLargeFile() n/a - 1.7% [±1.4] - 0.7% [±0.2] +5.9% [±2.4] - 5.3% [±2.2]
DocumentPerformanceTest#measureTypingReplaceInSmallFile() n/a - 0.6% [±1.0] +0.0% [±0.2] Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 233ms is not within [0%, 110%] of 199ms - 17.1% [±3.2] +0.9% [±2.9]
GapTextStorePerformanceTest#measureDeleteInsert() n/a +4.2% [±1.8] +0.0% [±2.2] +5.0% [±3.5] Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 26ms is not within [0%, 110%] of 22ms - 18.2% [±11.0]
GapTextStorePerformanceTest#measureGetAll() n/a - 1.6% [±0.8] - 1.1% [±0.1] - 0.3% [±0.4] - 2.5% [±1.5]
GapTextStorePerformanceTest#measureGetChar() n/a - 0.2% [±0.5] +0.5% [±0.1] - 0.4% [±0.6] +0.2% [±0.7]
GapTextStorePerformanceTest#measureGetLine() n/a - 6.0% [±0.7] +2.4% [±0.1] - 1.0% [±0.9] +2.5% [±1.4]
GapTextStorePerformanceTest#measureInsertAtEnd() n/a +0.0% [±0.9] +0.0% [±1.0] - 2.8% [±2.4] +9.3% [±5.9]
GapTextStorePerformanceTest#measureInsertAtStart() n/a +4.0% [±2.9] +0.0% [±2.9] +4.9% [±2.9] +0.0% [±11.8]
GapTextStorePerformanceTest#measureRandomReplace() n/a +3.8% [±2.4] - 0.4% [±0.1] +1.2% [±1.7] - 1.0% [±2.7]
GapTextStorePerformanceTest#measureRepeatedReplace() n/a +2.9% [±2.4] - 3.8% [±1.3] - 7.5% [±4.5] Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 38ms is not within [0%, 110%] of 32ms - 18.8% [±6.6]
GapTextStorePerformanceTest#measureSet() n/a Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 172ms is not within [0%, 110%] of 149ms - 15.4% [±1.8] Performance criteria not met when compared to '{config=eclipseperflnx3, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 67ms is not within [0%, 110%] of 59ms - 13.6% [±0.4] - 5.2% [±0.6] - 3.5% [±1.9]
GapTextStorePerformanceTest#measureTypingReplaceInLargeFile() n/a +0.0% [±2.9] +0.0% [±0.6] - 6.1% [±6.2] +5.3% [±11.0]
GapTextStorePerformanceTest#measureTypingReplaceInSmallFile() n/a +10.0% [±2.8] +0.0% [±0.6] - 3.1% [±7.1] +5.0% [±11.3]
JavaExpandSelectionTest#test() n/a Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 512ms is not within [0%, 110%] of 465ms - 10.1% [±2.0] - 7.2% [±0.7] - 5.1% [±1.4] - 2.1% [±4.2]
JavaFormatterProjectTest#test() n/a +32.2% [±9.4] +7.2% [±8.6] n/an/a
JavaFormatterTest#test() n/a +24.9% [±3.9] +28.8% [±0.3] +28.8% [±3.7] +30.3% [±2.8]
JavaIndenterTest#testJavaIndenter2() n/a +0.0% [±3.3] +0.0% [±3.6] +6.2% [±3.1] Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 16ms is not within [0%, 110%] of 8ms - 100.0% [±100.0]
JavaMoveLineTest#test() n/an/an/a +2.2% [±0.5] +4.2% [±1.6]
*JavaReplaceAllTest#test() (vs. N20070802-0010) n/a - 19.5% [±3.0] n/a Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 2.5s is not within [0%, 110%] of 1.76s - 41.6% [±2.3] Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 2.12s is not within [0%, 110%] of 1.65s - 28.3% [±1.9]
JavaReplaceAllWithQuickDiffTest#test() n/a Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 2.23s is not within [0%, 110%] of 1.76s - 27.0% [±2.5] Performance criteria not met when compared to '{config=eclipseperflnx3, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 1.68s is not within [0%, 110%] of 1.37s - 22.8% [±0.7] Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 2.47s is not within [0%, 110%] of 1.81s - 36.9% [±1.5] Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 2.12s is not within [0%, 110%] of 1.67s - 27.6% [±3.5]
LineTrackerPerformanceTest#testLineByIndex() n/a Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 804ms is not within [0%, 110%] of 726ms - 10.7% [±1.2] +0.7% [±0.2] +6.3% [±0.5] +3.7% [±1.2]
LineTrackerPerformanceTest#testLineByIndex2() n/a - 2.9% [±0.5] - 0.4% [±0.1] - 2.2% [±0.7] - 0.7% [±1.4]
LineTrackerPerformanceTest#testLineByOffset() n/a Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 593ms is not within [0%, 110%] of 404ms - 46.8% [±1.4] - 0.3% [±0.3] Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 812ms is not within [0%, 110%] of 615ms - 32.0% [±0.6] +19.7% [±1.0]
LineTrackerPerformanceTest#testLineByOffset2() n/a +0.8% [±0.1] - 0.2% [±0.1] - 5.2% [±0.2] +0.0% [±0.3]
LineTrackerPerformanceTest#testRandomReplace() n/a - 1.8% [±1.2] - 1.1% [±0.1] - 0.8% [±1.2] +8.2% [±2.4]
LineTrackerPerformanceTest#testReplace() n/a - 3.4% [±0.8] +0.6% [±0.4] - 3.5% [±1.7] - 2.9% [±1.6]
LineTrackerPerformanceTest#testSet() n/a - 2.8% [±1.2] - 0.6% [±0.2] - 0.4% [±1.7] +1.1% [±2.2]
NonInitialTypingTest#testTypeAMethod() n/a +47.6% [±41.4] Performance criteria not met when compared to '{config=eclipseperflnx3, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 511ms is not within [0%, 110%] of 391ms - 30.7% [±33.2] +4.0% [±3.5] +4.0% [±2.1]
OpenJavaContentAssistTest#test1()-cold n/a Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 505ms is not within [0%, 110%] of 279ms - 81.0% [±5.8] Performance criteria not met when compared to '{config=eclipseperflnx3, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 250ms is not within [0%, 110%] of 153ms - 63.4% [±7.5] - 24.0% [±9.9] Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 204ms is not within [0%, 110%] of 136ms - 50.0% [±7.3]
OpenJavaContentAssistTest#test1()-warm n/a Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 387ms is not within [0%, 110%] of 267ms - 44.9% [±3.6] - 3.4% [±6.0] - 39.8% [±11.0] Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 181ms is not within [0%, 110%] of 129ms - 40.3% [±7.5]
OpenJavaEditorStartupTest#testJavaEditorStartup() n/a - 6.3% [n/a] - 7.8% [n/a] Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 18.53s is not within [0%, 110%] of 16.62s - 11.5% [n/a] - 7.1% [n/a]
OpenJavaEditorTest#testOpenEditor3() n/a Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 962ms is not within [0%, 110%] of 832ms - 15.6% [±3.1] - 7.7% [±2.2] Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 1.2s is not within [0%, 110%] of 887ms - 34.8% [±4.1] Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 835ms is not within [0%, 110%] of 692ms - 20.7% [±1.5]
OpenJavaEditorTest#testOpenEditor4() n/a Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 811ms is not within [0%, 110%] of 710ms - 14.2% [±3.0] - 2.8% [±3.4] Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 1s is not within [0%, 110%] of 776ms - 28.9% [±4.8] Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 740ms is not within [0%, 110%] of 600ms - 23.3% [±2.8]
OpenJavaEditorTest#testOpenEditor5() n/a - 5.6% [±3.3] - 4.1% [±4.6] - 5.9% [±5.3] - 3.1% [±4.7]
OpenJavaEditorTest#testOpenEditor6() n/a - 1.7% [±4.0] - 1.1% [±4.3] - 2.8% [±5.2] - 5.4% [±5.5]
OpenJavaEditorTest#testOpenJavaEditor1() n/a Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 501ms is not within [0%, 110%] of 444ms - 12.8% [±8.1] Performance criteria not met when compared to '{config=eclipseperflnx3, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 523ms is not within [0%, 110%] of 449ms - 16.5% [±7.5] +0.2% [±18.3] Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 567ms is not within [0%, 110%] of 425ms - 33.4% [±8.0]
OpenJavaEditorTest#testOpenJavaEditor2() n/a - 9.8% [±5.0] Performance criteria not met when compared to '{config=eclipseperflnx3, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 490ms is not within [0%, 110%] of 439ms - 11.6% [±7.5] Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 556ms is not within [0%, 110%] of 413ms - 34.6% [±3.1] Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 515ms is not within [0%, 110%] of 432ms - 19.2% [±5.9]
OpenPreferencePageTest#testOpenPreferencePage()-cold n/a Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 262ms is not within [0%, 110%] of 1ms - 26,100.0% [n/a] - 5.2% [n/a] +5.4% [n/a] +16.6% [n/a]
OpenQuickOutlineTest#testOpenQuickOutline1()-cold n/a - 9.8% [±2.6] Performance criteria not met when compared to '{config=eclipseperflnx3, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 275ms is not within [0%, 110%] of 236ms - 16.5% [±2.5] Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 333ms is not within [0%, 110%] of 271ms - 22.9% [±3.7] Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 257ms is not within [0%, 110%] of 203ms - 26.6% [±2.2]
OpenQuickOutlineTest#testOpenQuickOutline1()-warm n/a - 7.7% [±1.4] Performance criteria not met when compared to '{config=eclipseperflnx3, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 268ms is not within [0%, 110%] of 231ms - 16.0% [±0.9] Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 332ms is not within [0%, 110%] of 283ms - 17.3% [±4.9] Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 261ms is not within [0%, 110%] of 205ms - 27.3% [±3.4]
OpenTextEditorStartupTest#testTextEditorStartup() n/a Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 11.46s is not within [0%, 110%] of 10.2s - 12.4% [n/a] Performance criteria not met when compared to '{config=eclipseperflnx3, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 9.66s is not within [0%, 110%] of 8.73s - 10.7% [n/a] Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 14.42s is not within [0%, 110%] of 12.73s - 13.2% [n/a] Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 9.52s is not within [0%, 110%] of 8.53s - 11.5% [n/a]
OpenTextEditorTest#testOpenEditor3() n/a Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 133ms is not within [0%, 110%] of 117ms - 13.7% [±0.6] - 2.3% [±0.5] Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 145ms is not within [0%, 110%] of 126ms - 15.1% [±0.5] - 7.4% [±0.8]
OpenTextEditorTest#testOpenTextEditor1() n/a Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 141ms is not within [0%, 110%] of 115ms - 22.6% [±2.6] Performance criteria not met when compared to '{config=eclipseperflnx3, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 139ms is not within [0%, 110%] of 124ms - 12.1% [±1.3] Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 173ms is not within [0%, 110%] of 152ms - 13.8% [±2.0] Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 108ms is not within [0%, 110%] of 90ms - 20.0% [±1.8]
OpenTextEditorTest#testOpenTextEditor2() n/a Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 133ms is not within [0%, 110%] of 106ms - 25.5% [±5.2] Performance criteria not met when compared to '{config=eclipseperflnx3, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 133ms is not within [0%, 110%] of 116ms - 14.7% [±3.2] Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 169ms is not within [0%, 110%] of 140ms - 20.7% [±6.0] Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 105ms is not within [0%, 110%] of 89ms - 18.0% [±5.1]
RevertJavaEditorTest#test2() n/a +3.5% [±8.1] Performance criteria not met when compared to '{config=eclipseperflnx3, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 137ms is not within [0%, 110%] of 124ms - 10.5% [±9.5] Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 221ms is not within [0%, 110%] of 184ms - 20.1% [±8.9] Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 165ms is not within [0%, 110%] of 131ms - 26.0% [±5.5]
RevertJavaEditorTest#testRevertJavaEditor() n/a - 6.6% [±6.3] - 4.0% [±6.6] Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 312ms is not within [0%, 110%] of 262ms - 19.1% [±5.8] Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 231ms is not within [0%, 110%] of 178ms - 29.8% [±4.8]
RevertTextEditorTest#testRevertTextEditor() n/a Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 49ms is not within [0%, 110%] of 35ms - 40.0% [±28.3] Performance criteria not met when compared to '{config=eclipseperflnx3, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 40ms is not within [0%, 110%] of 29ms - 37.9% [±16.3] Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 65ms is not within [0%, 110%] of 40ms - 62.5% [±24.6] Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 47ms is not within [0%, 110%] of 31ms - 51.6% [±15.9]
SaveJavaEditorTest#test1() n/a +32.5% [±39.7] Performance criteria not met when compared to '{config=eclipseperflnx3, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 2.39s is not within [0%, 110%] of 1.62s - 47.7% [±101.8] +53.7% [±4.6] +17.1% [±38.5]
SaveTextEditorTest#test1() n/a - 5.2% [±58.9] Performance criteria not met when compared to '{config=eclipseperflnx3, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 838ms is not within [0%, 110%] of 731ms - 14.6% [±71.0] +39.3% [±76.0] Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 831ms is not within [0%, 110%] of 696ms - 19.4% [±24.4]
ScrollAnnotatedJavaEditorTest#testScrollJavaEditorLineWise1() n/a +3.5% [±0.1] - 0.9% [±0.0] Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 14.45s is not within [0%, 110%] of 12.61s - 14.6% [±0.1] - 1.0% [±0.3]
ScrollAnnotatedJavaEditorTest#testScrollJavaEditorLineWiseMoveCaret1() n/a +3.0% [±0.0] - 1.0% [±0.1] Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 21.9s is not within [0%, 110%] of 18.26s - 19.9% [±0.2] - 2.1% [±0.1]
ScrollAnnotatedJavaEditorTest#testScrollJavaEditorLineWiseSelect1() n/a +1.8% [±0.1] - 2.0% [±0.0] - 9.1% [±0.1] +1.5% [±0.2]
ScrollAnnotatedJavaEditorTest#testScrollJavaEditorPageWise() n/a +5.8% [±0.4] +2.5% [±0.1] - 0.6% [±0.2] +1.0% [±0.3]
ScrollJavaEditorTest#testScrollJavaEditorLineWise2() n/a - 0.6% [±0.0] +0.1% [±0.0] Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 13.1s is not within [0%, 110%] of 11.42s - 14.7% [±0.3] +4.2% [±0.2]
ScrollJavaEditorTest#testScrollJavaEditorLineWiseMoveCaret2() n/a - 4.3% [±0.1] - 2.9% [±0.0] Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 20.62s is not within [0%, 110%] of 17.1s - 20.6% [±0.2] +1.1% [±0.2]
ScrollJavaEditorTest#testScrollJavaEditorLineWiseSelect2() n/a - 2.2% [±0.1] - 5.8% [±0.1] - 7.2% [±0.0] +4.6% [±0.3]
ScrollJavaEditorTest#testScrollJavaEditorPageWise() n/a +4.1% [±0.6] +0.9% [±0.3] +3.2% [±2.4] +2.2% [±0.4]
ScrollTextEditorTest#testScrollTextEditorLineWise2() n/a - 2.0% [±0.1] +0.8% [±0.0] +0.2% [±0.2] +5.7% [±0.4]
ScrollTextEditorTest#testScrollTextEditorLineWiseMoveCaret2() n/a - 6.8% [±0.1] - 1.4% [±0.1] +1.9% [±0.0] +1.8% [±0.4]
ScrollTextEditorTest#testScrollTextEditorLineWiseSelect2() n/a - 7.5% [±0.1] - 4.1% [±0.0] +6.2% [±0.1] +6.1% [±0.1]
ScrollTextEditorTest#testScrollTextEditorPageWise() n/a - 2.6% [±0.2] - 1.7% [±0.1] - 2.2% [±0.3] - 1.1% [±0.7]
*ScrollVerticalRuler1000Test#testScrollTextEditorLineWiseMoveCaret2() (vs. I20071127-0800) n/a - 75.2% [±0.2] - 246.4% [±0.1] - 180.3% [±0.4] - 804.0% [±0.4]
*ScrollVerticalRuler1000Test#testScrollTextEditorPageWise() (vs. I20071127-0800) n/a - 29.2% [±2.3] - 105.6% [±0.5] - 120.6% [±0.8] - 253.6% [±2.6]
*ScrollVerticalRuler100Test#testScrollTextEditorLineWiseMoveCaret2() (vs. I20071127-0800) n/a - 53.0% [±2.0] - 214.4% [±0.7] - 233.8% [±1.2] - 846.2% [±8.2]
*ScrollVerticalRuler100Test#testScrollTextEditorPageWise() (vs. I20071127-0800) n/a - 31.2% [±0.4] - 115.6% [±2.4] - 244.4% [±28.9] - 319.5% [±13.0]
*ScrollVerticalRuler5000Test#testScrollTextEditorPageWise() (vs. I20071127-0800) n/a - 64.2% [±0.3] - 117.1% [±0.3] - 174.8% [±0.3] - 262.1% [±0.2]
SynchronizedLineDifferInitializationTest#testInitializationWithFewChanges() n/a +1.8% [±2.0] +0.0% [±0.2] +0.4% [±1.8] +1.8% [±0.5]
SynchronizedLineDifferInitializationTest#testInitializationWithManyChanges() n/a - 0.5% [±0.4] - 0.3% [±0.2] - 1.1% [±1.1] - 0.6% [±1.3]
SynchronizedLineDifferInitializationTest#testInitializationWithManyChangesButEqualSize() n/a - 0.4% [±5.9] +0.4% [±0.3] +4.8% [±4.4] - 0.7% [±1.4]
SynchronizedLineDifferInitializationTest#testInitializationWithNoChanges() n/a +0.2% [±0.2] - 0.2% [±0.1] - 1.1% [±1.4] - 1.8% [±0.9]
TextMoveLineTest#test() n/a Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 847ms is not within [0%, 110%] of 751ms - 12.8% [±60.5] Performance criteria not met when compared to '{config=eclipseperflnx3, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 800ms is not within [0%, 110%] of 497ms - 61.0% [±88.0] +0.0% [±0.7] - 1.1% [±1.7]
TextNonInitialTypingTest#testTypeAMethod() n/a Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 103ms is not within [0%, 110%] of 5ms - 1,960.0% [±1,983.4] Performance criteria not met when compared to '{config=eclipseperflnx3, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 257ms is not within [0%, 110%] of 168ms - 53.0% [±52.6] - 4.1% [±2.0] - 4.2% [±2.8]
ToggleCommentTest#testToggleComment2()-comment n/a Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 200ms is not within [0%, 110%] of 179ms - 11.7% [±3.0] - 1.6% [±3.7] +66.9% [±40.4] Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 172ms is not within [0%, 110%] of 151ms - 13.9% [±3.4]
ToggleCommentTest#testToggleComment2()-uncomment n/a - 7.4% [±0.5] Performance criteria not met when compared to '{config=eclipseperflnx3, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 148ms is not within [0%, 110%] of 130ms - 13.8% [±10.3] +43.2% [±9.6] - 9.6% [±0.2]
UndoJavaEditorTest#testUndoJavaEditor2() n/a - 5.7% [±1.2] - 0.1% [±0.5] +12.4% [±9.3] - 1.0% [±6.1]
UndoTextEditorTest#testUndoTextEditor2() n/a Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 301ms is not within [0%, 110%] of 249ms - 20.9% [±17.8] +2.0% [±7.7] - 5.5% [±19.2] Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 219ms is not within [0%, 110%] of 195ms - 12.3% [±12.1]