Performance of org.eclipse.jdt.text: M20071023-1652 relative to 3.2

RHEL 4.0 Sun 1.4.2_10 (3 GHz 2.5 GB)

Win XP Sun 1.4.2_10 (3 GHz 2 GB)

RHEL 3.0 Sun 1.4.2_10 (3 GHz 2 GB)

Win XP Sun 1.4.2_10 (2 GHz 512 MB)

RHEL 3.0 Sun 1.4.2_10 (2 GHz 512 MB)


Scenario Status

The following table gives a complete but compact view of performance results for the component.
Each line of the table shows the results for one scenario on all machines.

The name of the scenario is in bold when its results are also displayed in the fingerprints
and starts with an '*' when the scenario has no results in the last baseline run.

Here are information displayed for each test (ie. in each cell): Hints:

All 110 scenarios

RHEL 3.0 Sun 1.4.2_10 (3 GHz 2 GB)
RHEL 4.0 Sun 1.4.2_10 (3 GHz 2.5 GB)
Win XP Sun 1.4.2_10 (2 GHz 512 MB)
Win XP Sun 1.4.2_10 (3 GHz 2 GB)
ActivateJavaEditorTest#testActivateEditor() Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 5.09s is not within [0%, 110%] of 4.53s - 12.3% [±2.2] Performance criteria not met when compared to '{config=eclipseperflnx3_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 4.06s is not within [0%, 110%] of 3.58s - 13.4% [±4.9] - 8.8% [±6.2] - 4.6% [±6.6]
ActivateTextEditorTest#testActivateEditor() Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 1.38s is not within [0%, 110%] of 1.24s - 11.8% [±1.0] - 7.5% [±1.0] +2.3% [±1.2] Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 597ms is not within [0%, 110%] of 522ms - 14.4% [±0.9]
CodeCompletionPerformanceTest#testApplicationNoParamters() +6.1% [±1.8] - 3.4% [±2.0] +8.7% [±2.9] +0.7% [±1.9]
CodeCompletionPerformanceTest#testApplicationWithParamterGuesses() +7.9% [±1.0] +7.9% [±0.7] +5.1% [±0.9] +5.9% [±1.0]
CodeCompletionPerformanceTest#testApplicationWithParamterGuesses2() +17.9% [±1.8] +15.9% [±1.7] +22.6% [±4.5] +14.1% [±1.5]
CodeCompletionPerformanceTest#testApplicationWithParamterNames() +2.7% [±1.7] - 1.3% [±1.8] +9.7% [±2.2] +4.7% [±1.4]
CodeCompletionPerformanceTest#testCompletionNoParamters() +7.5% [±0.9] +9.3% [±1.3] +7.5% [±1.6] +4.9% [±2.1]
CodeCompletionPerformanceTest#testCompletionWithParamterGuesses() +10.6% [±0.7] +9.6% [±0.4] +7.8% [±0.6] +7.8% [±1.0]
CodeCompletionPerformanceTest#testCompletionWithParamterGuesses2() +6.5% [±0.6] +5.8% [±0.3] +3.3% [±0.7] +4.1% [±0.6]
CodeCompletionPerformanceTest#testCompletionWithParamterNames() +9.2% [±0.8] +9.2% [±0.4] +5.3% [±0.7] +8.3% [±1.0]
ContentTypeTest#testJavaDirty() +0.0% [±2.3] +1.0% [±1.5] - 3.6% [±6.3] +2.9% [±5.1]
ContentTypeTest#testPluginPropertiesDirty() +2.5% [±1.7] +0.7% [±0.8] - 9.2% [±3.7] +2.7% [±3.7]
ContentTypeTest#testPluginXMLDirty() Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 1.73s is not within [0%, 110%] of 1.18s - 46.4% [±0.6] Performance criteria not met when compared to '{config=eclipseperflnx3_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 1.32s is not within [0%, 110%] of 853ms - 54.4% [±0.4] Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 2.76s is not within [0%, 110%] of 1.74s - 59.0% [±0.7] Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 1.75s is not within [0%, 110%] of 1.15s - 52.2% [±0.5]
ContentTypeTest#testPropertiesDirty() +4.9% [±2.6] +0.0% [±1.8] Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 106ms is not within [0%, 110%] of 93ms - 14.0% [±6.2] +2.8% [±4.8]
ContentTypeTest#testTextDirty() - 1.0% [±2.0] +2.0% [±1.9] +6.9% [±5.6] +5.8% [±4.8]
ConvertLineDelimitersProjectTest#test() +39.6% [±26.9] +0.7% [±18.6] +24.9% [±9.7] +24.1% [±4.9]
DocumentLineDifferInitializationTest#testInitializationWithFewChanges() - 0.2% [±0.2] - 0.2% [±0.2] +1.4% [±1.6] +80.8% [±80.7]
DocumentLineDifferInitializationTest#testInitializationWithManyChanges() +0.0% [±0.5] +0.6% [±0.2] +0.0% [±1.6] +0.0% [±0.1]
DocumentLineDifferInitializationTest#testInitializationWithManyChangesButEqualSize() - 0.1% [±0.0] +0.1% [±0.1] - 1.1% [±1.8] - 5.9% [±3.1]
DocumentLineDifferInitializationTest#testInitializationWithNoChanges() - 0.4% [±0.2] +0.0% [±0.2] +0.4% [±0.8] +0.0% [±0.7]
DocumentLineDifferModificationTest#testEditingChanged() +50.0% [±3.5] +55.0% [±4.9] +47.9% [±7.0] +27.0% [±8.9]
DocumentLineDifferModificationTest#testEditingUnchanged() +66.7% [±6.5] +76.9% [±9.1] +58.8% [±22.7] +1,400.0% [±224.0]
DocumentPerformanceTest#measureDeleteInsert() +93.1% [±0.4] +93.3% [±0.1] +92.9% [±0.2] +92.9% [±0.3]
DocumentPerformanceTest#measureGetAll() [n/a] [n/a] [n/a] [n/a]
DocumentPerformanceTest#measureGetChar() Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 153ms is not within [0%, 110%] of 97ms - 57.7% [±1.2] Performance criteria not met when compared to '{config=eclipseperflnx3_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 68ms is not within [0%, 110%] of 57ms - 19.3% [±0.2] Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 235ms is not within [0%, 110%] of 132ms - 78.0% [±1.6] Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 156ms is not within [0%, 110%] of 99ms - 57.6% [±2.1]
DocumentPerformanceTest#measureGetLength() Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 197ms is not within [0%, 110%] of 148ms - 33.1% [±1.1] Performance criteria not met when compared to '{config=eclipseperflnx3_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 83ms is not within [0%, 110%] of 73ms - 13.7% [±0.2] Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 285ms is not within [0%, 110%] of 225ms - 26.7% [±1.1] Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 185ms is not within [0%, 110%] of 146ms - 26.7% [±1.7]
DocumentPerformanceTest#measureGetLine() Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 71ms is not within [0%, 110%] of 60ms - 18.3% [±1.4] - 6.5% [±1.5] - 8.4% [±5.1] +0.0% [±4.0]
DocumentPerformanceTest#measureGetNumberOfLines() Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 129ms is not within [0%, 110%] of 110ms - 17.3% [±0.7] - 7.5% [±0.3] +4.8% [±8.7] Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 127ms is not within [0%, 110%] of 103ms - 23.3% [±2.1]
DocumentPerformanceTest#measureInsertAtEnd() +89.3% [±0.3] +89.7% [±0.1] +90.7% [±0.2] +89.6% [±0.4]
DocumentPerformanceTest#measureInsertAtStart() +96.9% [±0.0] +97.0% [±0.0] +97.2% [±0.0] +97.0% [±0.1]
DocumentPerformanceTest#measureLineByIndex() Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 130ms is not within [0%, 110%] of 106ms - 22.6% [±1.0] - 8.5% [±0.2] +21.9% [±1.1] Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 157ms is not within [0%, 110%] of 106ms - 48.1% [±2.5]
DocumentPerformanceTest#measureLineByOffset() - 3.6% [±1.0] - 1.7% [±0.2] - 4.6% [±0.5] - 3.1% [±1.1]
DocumentPerformanceTest#measureLineDelimiterByIndex() Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 151ms is not within [0%, 110%] of 106ms - 42.5% [±1.3] - 7.0% [±0.3] Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 251ms is not within [0%, 110%] of 156ms - 60.9% [±1.0] Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 164ms is not within [0%, 110%] of 100ms - 64.0% [±2.5]
DocumentPerformanceTest#measureLineInfoByIndex() Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 245ms is not within [0%, 110%] of 204ms - 20.1% [±0.4] +4.7% [±0.3] Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 296ms is not within [0%, 110%] of 233ms - 27.0% [±0.8] Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 244ms is not within [0%, 110%] of 203ms - 20.2% [±0.8]
DocumentPerformanceTest#measureLineInfoByOffset() - 6.2% [±0.7] +0.0% [±0.5] - 3.0% [±0.8] - 4.2% [±0.8]
DocumentPerformanceTest#measureLineLengthByIndex() Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 128ms is not within [0%, 110%] of 101ms - 26.7% [±0.8] - 8.6% [±0.2] Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 235ms is not within [0%, 110%] of 157ms - 49.7% [±1.3] Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 157ms is not within [0%, 110%] of 141ms - 11.3% [±0.9]
DocumentPerformanceTest#measureRandomReplace() +90.9% [±0.1] +89.9% [±0.0] +97.3% [±0.0] +95.2% [±0.1]
DocumentPerformanceTest#measureRepeatedReplace() +7.1% [±0.9] +12.8% [±0.5] +6.9% [±1.2] +7.4% [±1.2]
DocumentPerformanceTest#measureSet() +5.0% [±1.1] +1.9% [±0.9] +2.6% [±3.3] +3.5% [±4.7]
DocumentPerformanceTest#measureTypingReplaceInLargeFile() - 9.9% [±1.1] +1.4% [±0.4] +18.2% [±1.8] +21.4% [±1.7]
DocumentPerformanceTest#measureTypingReplaceInSmallFile() Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 181ms is not within [0%, 110%] of 157ms - 15.3% [±0.9] - 0.7% [±0.2] +15.2% [±1.8] +19.7% [±1.7]
GapTextStorePerformanceTest#measureDeleteInsert() +94.2% [±0.5] +94.9% [±0.1] +94.8% [±0.2] +95.1% [±0.6]
GapTextStorePerformanceTest#measureGetAll() +3.6% [±0.6] +3.3% [±0.1] +1.2% [±0.2] +1.5% [±0.7]
GapTextStorePerformanceTest#measureGetChar() +17.1% [±0.5] +10.2% [±0.1] +17.2% [±0.3] +19.3% [±2.7]
GapTextStorePerformanceTest#measureGetLine() - 5.9% [±0.7] +2.4% [±0.2] - 0.6% [±0.5] +0.7% [±0.8]
GapTextStorePerformanceTest#measureInsertAtEnd() +2.3% [±0.9] +2.6% [±1.1] +0.9% [±1.7] +0.0% [±6.5]
GapTextStorePerformanceTest#measureInsertAtStart() +97.4% [±0.2] +97.4% [±0.1] +97.7% [±0.1] +97.3% [±0.3]
GapTextStorePerformanceTest#measureRandomReplace() +92.2% [±0.1] +90.6% [±0.0] +97.7% [±0.0] +96.0% [±0.1]
GapTextStorePerformanceTest#measureRepeatedReplace() +75.9% [±6.4] +82.4% [±0.3] +70.2% [±5.5] +73.1% [±1.8]
GapTextStorePerformanceTest#measureSet() +35.5% [±0.7] +77.4% [±0.2] +27.9% [±0.3] +36.2% [±1.0]
GapTextStorePerformanceTest#measureTypingReplaceInLargeFile() - 3.7% [±3.1] +0.0% [±0.8] +10.5% [±6.0] +12.5% [±10.3]
GapTextStorePerformanceTest#measureTypingReplaceInSmallFile() Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 29ms is not within [0%, 110%] of 25ms - 16.0% [±3.3] +0.0% [±0.7] +13.5% [±6.7] +9.1% [±11.0]
JavaExpandSelectionTest#test() +10.3% [±2.0] +7.8% [±0.3] +26.8% [±1.8] +15.5% [±0.9]
JavaFormatterProjectTest#test() - 2.4% [±13.9] - 4.3% [±6.5] Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 3.33s is not within [0%, 110%] of 3.01s - 10.7% [±1.9] Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 2.49s is not within [0%, 110%] of 2.09s - 19.0% [±1.1]
JavaFormatterTest#test() +28.5% [±1.0] +19.6% [±2.6] +39.7% [±1.9] +28.2% [±0.8]
JavaIndenterTest#testJavaIndenter2() +25.0% [±2.5] +12.5% [±4.4] Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 23ms is not within [0%, 110%] of 16ms - 43.8% [±46.9] +0.0% [±0.0]
JavaMoveLineTest#test() +97.1% [±94.0] +94.6% [±96.8] +13.1% [±1.9] +7.5% [±1.0]
JavaReplaceAllTest#test() +6.3% [±3.5] +3.9% [±2.7] +1.8% [±1.5] - 2.5% [±9.7]
JavaReplaceAllWithQuickDiffTest#test() - 7.5% [±9.3] - 5.1% [±11.2] +0.6% [±2.0] - 0.4% [±2.9]
LineTrackerPerformanceTest#testLineByIndex() - 6.3% [±0.9] - 0.3% [±0.1] - 8.8% [±0.2] Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 642ms is not within [0%, 110%] of 566ms - 13.4% [±0.4]
LineTrackerPerformanceTest#testLineByIndex2() +1.5% [±0.3] +0.0% [±0.1] Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 703ms is not within [0%, 110%] of 636ms - 5.7% [±0.2] - 0.6% [±0.4]
LineTrackerPerformanceTest#testLineByOffset() - 1.0% [±0.8] - 0.3% [±0.2] Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 750ms is not within [0%, 110%] of 680ms +0.2% [±0.2] +1.0% [±0.3]
LineTrackerPerformanceTest#testLineByOffset2() +1.5% [±0.1] - 0.5% [±0.1] Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 4.68s is not within [0%, 110%] of 4.25s - 3.8% [±0.0] +0.5% [±0.1]
LineTrackerPerformanceTest#testRandomReplace() +11.5% [±0.7] +13.4% [±0.1] - 1.3% [±2.2] +9.5% [±0.7]
LineTrackerPerformanceTest#testReplace() +2.2% [±0.8] - 0.3% [±0.4] +1.2% [±0.7] - 0.3% [±0.8]
LineTrackerPerformanceTest#testSet() +0.0% [±0.7] +0.3% [±0.2] - 1.9% [±0.8] +3.8% [±0.9]
NonInitialTypingTest#testTypeAMethod() Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 370ms is not within [0%, 110%] of 4ms - 9,150.0% [±4,554.4] +13.2% [±4.7] +8.0% [±5.3] - 9.1% [±3.2]
OpenJavaContentAssistTest#test1()-cold +51.2% [±2.3] +51.7% [±3.5] +45.1% [±4.3] +66.3% [±2.8]
OpenJavaContentAssistTest#test1()-warm +55.6% [±2.7] +50.2% [±2.6] +54.7% [±3.1] +68.6% [±2.6]
OpenJavaEditorStartupTest#testJavaEditorStartup() +1.3% [n/a] +0.9% [n/a] - 5.0% [n/a] +0.3% [n/a]
OpenJavaEditorTest#testOpenEditor3() - 7.7% [±2.5] - 2.8% [±2.8] +9.0% [±1.5] - 4.5% [±3.0]
OpenJavaEditorTest#testOpenEditor4() Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 779ms is not within [0%, 110%] of 667ms - 16.8% [±4.2] Performance criteria not met when compared to '{config=eclipseperflnx3_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 615ms is not within [0%, 110%] of 555ms - 10.8% [±3.0] - 0.1% [±3.7] - 9.6% [±3.3]
OpenJavaEditorTest#testOpenEditor5() +2.9% [±4.1] +8.8% [±2.4] +11.3% [±2.8] +0.8% [±3.8]
OpenJavaEditorTest#testOpenEditor6() - 9.0% [±6.1] +4.7% [±4.7] - 0.9% [±6.4] Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 389ms is not within [0%, 110%] of 350ms - 11.1% [±5.0]
OpenJavaEditorTest#testOpenJavaEditor1() +19.3% [±5.8] +4.2% [±4.9] +11.1% [±2.9] +9.7% [±5.5]
OpenJavaEditorTest#testOpenJavaEditor2() +19.8% [±7.9] +7.2% [±7.0] +16.3% [±7.6] +2.8% [±6.1]
OpenPreferencePageTest#testOpenPreferencePage()-cold Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 271ms is not within [0%, 110%] of 1ms - 27,000.0% [n/a] Performance criteria not met when compared to '{config=eclipseperflnx3_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 194ms is not within [0%, 110%] of 135ms - 43.7% [n/a] Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 282ms is not within [0%, 110%] of 172ms - 64.0% [n/a] Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 203ms is not within [0%, 110%] of 109ms - 86.2% [n/a]
OpenQuickOutlineTest#testOpenQuickOutline1()-cold +27.1% [±2.4] +33.6% [±3.0] +31.6% [±3.9] +44.5% [±3.3]
OpenQuickOutlineTest#testOpenQuickOutline1()-warm +24.8% [±2.0] +30.8% [±1.5] +37.8% [±4.6] +44.2% [±3.3]
OpenTextEditorStartupTest#testTextEditorStartup() Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 10.26s is not within [0%, 110%] of 8.76s - Explanation comment: The startup with open Text editor performance has been decreased due to general start-up time degradation. See the org.eclipse.core.tests.runtime.perf.UIStartupTest.testUIApplicationStartup performance test on the detailed org.eclipse.core performance results page. - 17.2% [n/a] Performance criteria not met when compared to '{config=eclipseperflnx3_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 8.69s is not within [0%, 110%] of 7.5s - Explanation comment: The startup with open Text editor performance has been decreased due to general start-up time degradation. See the org.eclipse.core.tests.runtime.perf.UIStartupTest.testUIApplicationStartup performance test on the detailed org.eclipse.core performance results page. - 15.8% [n/a] Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 12.5s is not within [0%, 110%] of 10.52s - Explanation comment: The startup with open Text editor performance has been decreased due to general start-up time degradation. See the org.eclipse.core.tests.runtime.perf.UIStartupTest.testUIApplicationStartup performance test on the detailed org.eclipse.core performance results page. - 18.9% [n/a] Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 8.23s is not within [0%, 110%] of 7.16s - Explanation comment: The startup with open Text editor performance has been decreased due to general start-up time degradation. See the org.eclipse.core.tests.runtime.perf.UIStartupTest.testUIApplicationStartup performance test on the detailed org.eclipse.core performance results page. - 15.1% [n/a]
OpenTextEditorTest#testOpenEditor3() Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 129ms is not within [0%, 110%] of 112ms - 15.2% [±1.6] - 0.8% [±1.2] +3.1% [±1.9] +2.1% [±1.5]
OpenTextEditorTest#testOpenTextEditor1() Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 123ms is not within [0%, 110%] of 108ms - 13.9% [±2.6] - 1.6% [±1.3] - 6.0% [±1.9] - 5.8% [±1.4]
OpenTextEditorTest#testOpenTextEditor2() Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 116ms is not within [0%, 110%] of 95ms - 22.1% [±4.2] - 2.6% [±4.0] - 2.8% [±5.8] - 8.5% [±3.8]
RevertJavaEditorTest#test2() +10.8% [±5.6] +12.6% [±2.8] Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 271ms is not within [0%, 110%] of 212ms - 27.8% [±17.1] +14.1% [±6.0]
RevertJavaEditorTest#testRevertJavaEditor() +13.7% [±4.2] +20.2% [±5.3] +55.8% [±44.7] +10.7% [±4.2]
RevertTextEditorTest#testRevertTextEditor() Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 35ms is not within [0%, 110%] of 26ms - 34.6% [±12.9] Performance criteria not met when compared to '{config=eclipseperflnx3_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 32ms is not within [0%, 110%] of 24ms - 33.3% [±13.2] +17.0% [±13.5] +0.0% [±1.0]
SaveJavaEditorTest#test1() +20.5% [±59.4] +90.7% [±57.7] +14.7% [±6.8] +26.8% [±20.1]
SaveTextEditorTest#test1() +56.9% [±62.9] Performance criteria not met when compared to '{config=eclipseperflnx3_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 593ms is not within [0%, 110%] of 314ms - 88.9% [±51.3] +40.8% [±49.0] Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 1.03s is not within [0%, 110%] of 594ms - 74.1% [±53.9]
ScrollAnnotatedJavaEditorTest#testScrollJavaEditorLineWise1() - 1.6% [±0.1] - 3.2% [±0.0] - 9.7% [±0.1] - 6.9% [±0.1]
ScrollAnnotatedJavaEditorTest#testScrollJavaEditorLineWiseMoveCaret1() +4.3% [±0.1] - 5.0% [±0.0] Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 18.86s is not within [0%, 110%] of 15.86s - 18.9% [±0.1] Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 15.76s is not within [0%, 110%] of 14.12s - 11.6% [±0.1]
ScrollAnnotatedJavaEditorTest#testScrollJavaEditorLineWiseSelect1() - 8.2% [±0.0] Performance criteria not met when compared to '{config=eclipseperflnx3_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 42.68s is not within [0%, 110%] of 38.66s - 10.4% [±0.0] Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 31.59s is not within [0%, 110%] of 28.61s - 10.4% [±0.0] Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 17.84s is not within [0%, 110%] of 15.24s - 17.1% [±0.1]
ScrollAnnotatedJavaEditorTest#testScrollJavaEditorPageWise() +4.1% [±0.1] - 2.1% [±0.5] - 5.2% [±0.1] - 2.6% [±0.1]
ScrollJavaEditorTest#testScrollJavaEditorLineWise2() - 5.0% [±0.1] - 3.3% [±0.0] - 9.3% [±0.0] - 5.3% [±0.1]
ScrollJavaEditorTest#testScrollJavaEditorLineWiseMoveCaret2() +2.0% [±0.0] - 4.9% [±0.2] Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 18.11s is not within [0%, 110%] of 14.68s - 23.3% [±0.1] Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 14.85s is not within [0%, 110%] of 13.32s - 11.5% [±0.1]
ScrollJavaEditorTest#testScrollJavaEditorLineWiseSelect2() Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 47.52s is not within [0%, 110%] of 42.54s - 11.7% [±0.0] Performance criteria not met when compared to '{config=eclipseperflnx3_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 41s is not within [0%, 110%] of 37.19s - 10.2% [±0.1] Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 31.15s is not within [0%, 110%] of 27.55s - 13.1% [±0.0] Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 16.95s is not within [0%, 110%] of 14.5s - 17.0% [±0.1]
ScrollJavaEditorTest#testScrollJavaEditorPageWise() +3.6% [±1.0] - 4.4% [±0.4] - 3.7% [±0.6] - 2.8% [±0.3]
ScrollTextEditorTest#testScrollTextEditorLineWise2() - 7.2% [±0.1] - 5.0% [±0.1] - 9.1% [±0.1] - 8.7% [±0.1]
ScrollTextEditorTest#testScrollTextEditorLineWiseMoveCaret2() - 2.6% [±0.1] - 10.0% [±0.1] Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 18.6s is not within [0%, 110%] of 13.82s - 34.6% [±0.1] Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 10.09s is not within [0%, 110%] of 8.54s - 18.2% [±0.2]
ScrollTextEditorTest#testScrollTextEditorLineWiseSelect2() Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 26.95s is not within [0%, 110%] of 22.24s - 21.2% [±0.0] Performance criteria not met when compared to '{config=eclipseperflnx3_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 26.15s is not within [0%, 110%] of 21.91s - 19.4% [±0.4] Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 13.75s is not within [0%, 110%] of 11.1s - 23.9% [±0.1] Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 12.16s is not within [0%, 110%] of 9.79s - 24.2% [±0.2]
ScrollTextEditorTest#testScrollTextEditorPageWise() +1.7% [±0.4] - 7.6% [±0.3] - 7.1% [±0.1] - 4.8% [±0.1]
SynchronizedLineDifferInitializationTest#testInitializationWithFewChanges() - 2.0% [±2.0] +0.2% [±0.2] +0.7% [±1.2] - 0.9% [±1.3]
SynchronizedLineDifferInitializationTest#testInitializationWithManyChanges() +0.7% [±0.7] +0.0% [±0.1] - 1.2% [±0.5] - 1.2% [±1.3]
SynchronizedLineDifferInitializationTest#testInitializationWithManyChangesButEqualSize() +7.8% [±4.0] +0.0% [±0.1] - 1.7% [±1.4] +0.0% [±1.9]
SynchronizedLineDifferInitializationTest#testInitializationWithNoChanges() - 0.4% [±0.2] +0.0% [±0.2] +3.9% [±1.5] - 0.2% [±0.8]
TextMoveLineTest#test() +42.5% [±34.0] +10.8% [±54.2] +4.7% [±0.4] +1.0% [±1.1]
TextNonInitialTypingTest#testTypeAMethod() Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 196ms is not within [0%, 110%] of 5ms - 3,820.0% [±3,833.3] +45.5% [±27.1] Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 375ms is not within [0%, 110%] of 322ms - 16.5% [±1.7] Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 250ms is not within [0%, 110%] of 203ms - 23.2% [±0.2]
ToggleCommentTest#testToggleComment2()-comment +9.1% [±4.3] +17.6% [±3.2] +39.0% [±22.5] +96.3% [±0.8]
ToggleCommentTest#testToggleComment2()-uncomment +5.3% [±1.9] +14.5% [±3.7] Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 3.3s is not within [0%, 110%] of 1.15s - 188.1% [±228.2] +84.4% [±2.2]
UndoJavaEditorTest#testUndoJavaEditor2() +54.6% [±0.3] +58.5% [±2.2] +79.6% [±7.9] +53.0% [±0.5]
UndoTextEditorTest#testUndoTextEditor2() +97.0% [±0.1] +97.7% [±0.1] +99.0% [±1.6] +97.5% [±0.2]