All 110 scenarios |
RHEL 3.0 Sun 1.4.2_10 (3 GHz 2 GB)
| RHEL 4.0 Sun 1.4.2_10 (3 GHz 2.5 GB)
| Win XP Sun 1.4.2_10 (2 GHz 512 MB)
| Win XP Sun 1.4.2_10 (3 GHz 2 GB)
|
ActivateJavaEditorTest#testActivateEditor()
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 5.09s is not within [0%, 110%] of 4.53s
- 12.3% [±2.2]
|
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 4.06s is not within [0%, 110%] of 3.58s
- 13.4% [±4.9]
|
- 8.8% [±6.2]
|
- 4.6% [±6.6]
|
ActivateTextEditorTest#testActivateEditor()
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 1.38s is not within [0%, 110%] of 1.24s
- 11.8% [±1.0]
|
- 7.5% [±1.0]
|
+2.3% [±1.2]
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 597ms is not within [0%, 110%] of 522ms
- 14.4% [±0.9]
|
CodeCompletionPerformanceTest#testApplicationNoParamters()
|
+6.1% [±1.8]
|
- 3.4% [±2.0]
|
+8.7% [±2.9]
|
+0.7% [±1.9]
|
CodeCompletionPerformanceTest#testApplicationWithParamterGuesses()
|
+7.9% [±1.0]
|
+7.9% [±0.7]
|
+5.1% [±0.9]
|
+5.9% [±1.0]
|
CodeCompletionPerformanceTest#testApplicationWithParamterGuesses2()
|
+17.9% [±1.8]
|
+15.9% [±1.7]
|
+22.6% [±4.5]
|
+14.1% [±1.5]
|
CodeCompletionPerformanceTest#testApplicationWithParamterNames()
|
+2.7% [±1.7]
|
- 1.3% [±1.8]
|
+9.7% [±2.2]
|
+4.7% [±1.4]
|
CodeCompletionPerformanceTest#testCompletionNoParamters()
|
+7.5% [±0.9]
|
+9.3% [±1.3]
|
+7.5% [±1.6]
|
+4.9% [±2.1]
|
CodeCompletionPerformanceTest#testCompletionWithParamterGuesses()
|
+10.6% [±0.7]
|
+9.6% [±0.4]
|
+7.8% [±0.6]
|
+7.8% [±1.0]
|
CodeCompletionPerformanceTest#testCompletionWithParamterGuesses2()
|
+6.5% [±0.6]
|
+5.8% [±0.3]
|
+3.3% [±0.7]
|
+4.1% [±0.6]
|
CodeCompletionPerformanceTest#testCompletionWithParamterNames()
|
+9.2% [±0.8]
|
+9.2% [±0.4]
|
+5.3% [±0.7]
|
+8.3% [±1.0]
|
ContentTypeTest#testJavaDirty()
|
+0.0% [±2.3]
|
+1.0% [±1.5]
|
- 3.6% [±6.3]
|
+2.9% [±5.1]
|
ContentTypeTest#testPluginPropertiesDirty()
|
+2.5% [±1.7]
|
+0.7% [±0.8]
|
- 9.2% [±3.7]
|
+2.7% [±3.7]
|
ContentTypeTest#testPluginXMLDirty()
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 1.73s is not within [0%, 110%] of 1.18s
- 46.4% [±0.6]
|
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 1.32s is not within [0%, 110%] of 853ms
- 54.4% [±0.4]
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 2.76s is not within [0%, 110%] of 1.74s
- 59.0% [±0.7]
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 1.75s is not within [0%, 110%] of 1.15s
- 52.2% [±0.5]
|
ContentTypeTest#testPropertiesDirty()
|
+4.9% [±2.6]
|
+0.0% [±1.8]
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 106ms is not within [0%, 110%] of 93ms
- 14.0% [±6.2]
|
+2.8% [±4.8]
|
ContentTypeTest#testTextDirty()
|
- 1.0% [±2.0]
|
+2.0% [±1.9]
|
+6.9% [±5.6]
|
+5.8% [±4.8]
|
ConvertLineDelimitersProjectTest#test()
|
+39.6% [±26.9]
|
+0.7% [±18.6]
|
+24.9% [±9.7]
|
+24.1% [±4.9]
|
DocumentLineDifferInitializationTest#testInitializationWithFewChanges()
|
- 0.2% [±0.2]
|
- 0.2% [±0.2]
|
+1.4% [±1.6]
|
+80.8% [±80.7]
|
DocumentLineDifferInitializationTest#testInitializationWithManyChanges()
|
+0.0% [±0.5]
|
+0.6% [±0.2]
|
+0.0% [±1.6]
|
+0.0% [±0.1]
|
DocumentLineDifferInitializationTest#testInitializationWithManyChangesButEqualSize()
|
- 0.1% [±0.0]
|
+0.1% [±0.1]
|
- 1.1% [±1.8]
|
- 5.9% [±3.1]
|
DocumentLineDifferInitializationTest#testInitializationWithNoChanges()
|
- 0.4% [±0.2]
|
+0.0% [±0.2]
|
+0.4% [±0.8]
|
+0.0% [±0.7]
|
DocumentLineDifferModificationTest#testEditingChanged()
|
+50.0% [±3.5]
|
+55.0% [±4.9]
|
+47.9% [±7.0]
|
+27.0% [±8.9]
|
DocumentLineDifferModificationTest#testEditingUnchanged()
|
+66.7% [±6.5]
|
+76.9% [±9.1]
|
+58.8% [±22.7]
|
+1,400.0% [±224.0]
|
DocumentPerformanceTest#measureDeleteInsert()
|
+93.1% [±0.4]
|
+93.3% [±0.1]
|
+92.9% [±0.2]
|
+92.9% [±0.3]
|
DocumentPerformanceTest#measureGetAll()
|
[n/a]
|
[n/a]
|
[n/a]
|
[n/a]
|
DocumentPerformanceTest#measureGetChar()
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 153ms is not within [0%, 110%] of 97ms
- 57.7% [±1.2]
|
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 68ms is not within [0%, 110%] of 57ms
- 19.3% [±0.2]
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 235ms is not within [0%, 110%] of 132ms
- 78.0% [±1.6]
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 156ms is not within [0%, 110%] of 99ms
- 57.6% [±2.1]
|
DocumentPerformanceTest#measureGetLength()
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 197ms is not within [0%, 110%] of 148ms
- 33.1% [±1.1]
|
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 83ms is not within [0%, 110%] of 73ms
- 13.7% [±0.2]
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 285ms is not within [0%, 110%] of 225ms
- 26.7% [±1.1]
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 185ms is not within [0%, 110%] of 146ms
- 26.7% [±1.7]
|
DocumentPerformanceTest#measureGetLine()
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 71ms is not within [0%, 110%] of 60ms
- 18.3% [±1.4]
|
- 6.5% [±1.5]
|
- 8.4% [±5.1]
|
+0.0% [±4.0]
|
DocumentPerformanceTest#measureGetNumberOfLines()
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 129ms is not within [0%, 110%] of 110ms
- 17.3% [±0.7]
|
- 7.5% [±0.3]
|
+4.8% [±8.7]
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 127ms is not within [0%, 110%] of 103ms
- 23.3% [±2.1]
|
DocumentPerformanceTest#measureInsertAtEnd()
|
+89.3% [±0.3]
|
+89.7% [±0.1]
|
+90.7% [±0.2]
|
+89.6% [±0.4]
|
DocumentPerformanceTest#measureInsertAtStart()
|
+96.9% [±0.0]
|
+97.0% [±0.0]
|
+97.2% [±0.0]
|
+97.0% [±0.1]
|
DocumentPerformanceTest#measureLineByIndex()
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 130ms is not within [0%, 110%] of 106ms
- 22.6% [±1.0]
|
- 8.5% [±0.2]
|
+21.9% [±1.1]
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 157ms is not within [0%, 110%] of 106ms
- 48.1% [±2.5]
|
DocumentPerformanceTest#measureLineByOffset()
|
- 3.6% [±1.0]
|
- 1.7% [±0.2]
|
- 4.6% [±0.5]
|
- 3.1% [±1.1]
|
DocumentPerformanceTest#measureLineDelimiterByIndex()
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 151ms is not within [0%, 110%] of 106ms
- 42.5% [±1.3]
|
- 7.0% [±0.3]
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 251ms is not within [0%, 110%] of 156ms
- 60.9% [±1.0]
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 164ms is not within [0%, 110%] of 100ms
- 64.0% [±2.5]
|
DocumentPerformanceTest#measureLineInfoByIndex()
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 245ms is not within [0%, 110%] of 204ms
- 20.1% [±0.4]
|
+4.7% [±0.3]
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 296ms is not within [0%, 110%] of 233ms
- 27.0% [±0.8]
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 244ms is not within [0%, 110%] of 203ms
- 20.2% [±0.8]
|
DocumentPerformanceTest#measureLineInfoByOffset()
|
- 6.2% [±0.7]
|
+0.0% [±0.5]
|
- 3.0% [±0.8]
|
- 4.2% [±0.8]
|
DocumentPerformanceTest#measureLineLengthByIndex()
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 128ms is not within [0%, 110%] of 101ms
- 26.7% [±0.8]
|
- 8.6% [±0.2]
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 235ms is not within [0%, 110%] of 157ms
- 49.7% [±1.3]
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 157ms is not within [0%, 110%] of 141ms
- 11.3% [±0.9]
|
DocumentPerformanceTest#measureRandomReplace()
|
+90.9% [±0.1]
|
+89.9% [±0.0]
|
+97.3% [±0.0]
|
+95.2% [±0.1]
|
DocumentPerformanceTest#measureRepeatedReplace()
|
+7.1% [±0.9]
|
+12.8% [±0.5]
|
+6.9% [±1.2]
|
+7.4% [±1.2]
|
DocumentPerformanceTest#measureSet()
|
+5.0% [±1.1]
|
+1.9% [±0.9]
|
+2.6% [±3.3]
|
+3.5% [±4.7]
|
DocumentPerformanceTest#measureTypingReplaceInLargeFile()
|
- 9.9% [±1.1]
|
+1.4% [±0.4]
|
+18.2% [±1.8]
|
+21.4% [±1.7]
|
DocumentPerformanceTest#measureTypingReplaceInSmallFile()
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 181ms is not within [0%, 110%] of 157ms
- 15.3% [±0.9]
|
- 0.7% [±0.2]
|
+15.2% [±1.8]
|
+19.7% [±1.7]
|
GapTextStorePerformanceTest#measureDeleteInsert()
|
+94.2% [±0.5]
|
+94.9% [±0.1]
|
+94.8% [±0.2]
|
+95.1% [±0.6]
|
GapTextStorePerformanceTest#measureGetAll()
|
+3.6% [±0.6]
|
+3.3% [±0.1]
|
+1.2% [±0.2]
|
+1.5% [±0.7]
|
GapTextStorePerformanceTest#measureGetChar()
|
+17.1% [±0.5]
|
+10.2% [±0.1]
|
+17.2% [±0.3]
|
+19.3% [±2.7]
|
GapTextStorePerformanceTest#measureGetLine()
|
- 5.9% [±0.7]
|
+2.4% [±0.2]
|
- 0.6% [±0.5]
|
+0.7% [±0.8]
|
GapTextStorePerformanceTest#measureInsertAtEnd()
|
+2.3% [±0.9]
|
+2.6% [±1.1]
|
+0.9% [±1.7]
|
+0.0% [±6.5]
|
GapTextStorePerformanceTest#measureInsertAtStart()
|
+97.4% [±0.2]
|
+97.4% [±0.1]
|
+97.7% [±0.1]
|
+97.3% [±0.3]
|
GapTextStorePerformanceTest#measureRandomReplace()
|
+92.2% [±0.1]
|
+90.6% [±0.0]
|
+97.7% [±0.0]
|
+96.0% [±0.1]
|
GapTextStorePerformanceTest#measureRepeatedReplace()
|
+75.9% [±6.4]
|
+82.4% [±0.3]
|
+70.2% [±5.5]
|
+73.1% [±1.8]
|
GapTextStorePerformanceTest#measureSet()
|
+35.5% [±0.7]
|
+77.4% [±0.2]
|
+27.9% [±0.3]
|
+36.2% [±1.0]
|
GapTextStorePerformanceTest#measureTypingReplaceInLargeFile()
|
- 3.7% [±3.1]
|
+0.0% [±0.8]
|
+10.5% [±6.0]
|
+12.5% [±10.3]
|
GapTextStorePerformanceTest#measureTypingReplaceInSmallFile()
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 29ms is not within [0%, 110%] of 25ms
- 16.0% [±3.3]
|
+0.0% [±0.7]
|
+13.5% [±6.7]
|
+9.1% [±11.0]
|
JavaExpandSelectionTest#test()
|
+10.3% [±2.0]
|
+7.8% [±0.3]
|
+26.8% [±1.8]
|
+15.5% [±0.9]
|
JavaFormatterProjectTest#test()
|
- 2.4% [±13.9]
|
- 4.3% [±6.5]
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 3.33s is not within [0%, 110%] of 3.01s
- 10.7% [±1.9]
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 2.49s is not within [0%, 110%] of 2.09s
- 19.0% [±1.1]
|
JavaFormatterTest#test()
|
+28.5% [±1.0]
|
+19.6% [±2.6]
|
+39.7% [±1.9]
|
+28.2% [±0.8]
|
JavaIndenterTest#testJavaIndenter2()
|
+25.0% [±2.5]
|
+12.5% [±4.4]
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 23ms is not within [0%, 110%] of 16ms
- 43.8% [±46.9]
|
+0.0% [±0.0]
|
JavaMoveLineTest#test()
|
+97.1% [±94.0]
|
+94.6% [±96.8]
|
+13.1% [±1.9]
|
+7.5% [±1.0]
|
JavaReplaceAllTest#test()
|
+6.3% [±3.5]
|
+3.9% [±2.7]
|
+1.8% [±1.5]
|
- 2.5% [±9.7]
|
JavaReplaceAllWithQuickDiffTest#test()
|
- 7.5% [±9.3]
|
- 5.1% [±11.2]
|
+0.6% [±2.0]
|
- 0.4% [±2.9]
|
LineTrackerPerformanceTest#testLineByIndex()
|
- 6.3% [±0.9]
|
- 0.3% [±0.1]
|
- 8.8% [±0.2]
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 642ms is not within [0%, 110%] of 566ms
- 13.4% [±0.4]
|
LineTrackerPerformanceTest#testLineByIndex2()
|
+1.5% [±0.3]
|
+0.0% [±0.1]
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 703ms is not within [0%, 110%] of 636ms
- 5.7% [±0.2]
|
- 0.6% [±0.4]
|
LineTrackerPerformanceTest#testLineByOffset()
|
- 1.0% [±0.8]
|
- 0.3% [±0.2]
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 750ms is not within [0%, 110%] of 680ms
+0.2% [±0.2]
|
+1.0% [±0.3]
|
LineTrackerPerformanceTest#testLineByOffset2()
|
+1.5% [±0.1]
|
- 0.5% [±0.1]
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 4.68s is not within [0%, 110%] of 4.25s
- 3.8% [±0.0]
|
+0.5% [±0.1]
|
LineTrackerPerformanceTest#testRandomReplace()
|
+11.5% [±0.7]
|
+13.4% [±0.1]
|
- 1.3% [±2.2]
|
+9.5% [±0.7]
|
LineTrackerPerformanceTest#testReplace()
|
+2.2% [±0.8]
|
- 0.3% [±0.4]
|
+1.2% [±0.7]
|
- 0.3% [±0.8]
|
LineTrackerPerformanceTest#testSet()
|
+0.0% [±0.7]
|
+0.3% [±0.2]
|
- 1.9% [±0.8]
|
+3.8% [±0.9]
|
NonInitialTypingTest#testTypeAMethod()
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 370ms is not within [0%, 110%] of 4ms
- 9,150.0% [±4,554.4]
|
+13.2% [±4.7]
|
+8.0% [±5.3]
|
- 9.1% [±3.2]
|
OpenJavaContentAssistTest#test1()-cold
|
+51.2% [±2.3]
|
+51.7% [±3.5]
|
+45.1% [±4.3]
|
+66.3% [±2.8]
|
OpenJavaContentAssistTest#test1()-warm
|
+55.6% [±2.7]
|
+50.2% [±2.6]
|
+54.7% [±3.1]
|
+68.6% [±2.6]
|
OpenJavaEditorStartupTest#testJavaEditorStartup()
|
+1.3% [n/a]
|
+0.9% [n/a]
|
- 5.0% [n/a]
|
+0.3% [n/a]
|
OpenJavaEditorTest#testOpenEditor3()
|
- 7.7% [±2.5]
|
- 2.8% [±2.8]
|
+9.0% [±1.5]
|
- 4.5% [±3.0]
|
OpenJavaEditorTest#testOpenEditor4()
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 779ms is not within [0%, 110%] of 667ms
- 16.8% [±4.2]
|
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 615ms is not within [0%, 110%] of 555ms
- 10.8% [±3.0]
|
- 0.1% [±3.7]
|
- 9.6% [±3.3]
|
OpenJavaEditorTest#testOpenEditor5()
|
+2.9% [±4.1]
|
+8.8% [±2.4]
|
+11.3% [±2.8]
|
+0.8% [±3.8]
|
OpenJavaEditorTest#testOpenEditor6()
|
- 9.0% [±6.1]
|
+4.7% [±4.7]
|
- 0.9% [±6.4]
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 389ms is not within [0%, 110%] of 350ms
- 11.1% [±5.0]
|
OpenJavaEditorTest#testOpenJavaEditor1()
|
+19.3% [±5.8]
|
+4.2% [±4.9]
|
+11.1% [±2.9]
|
+9.7% [±5.5]
|
OpenJavaEditorTest#testOpenJavaEditor2()
|
+19.8% [±7.9]
|
+7.2% [±7.0]
|
+16.3% [±7.6]
|
+2.8% [±6.1]
|
OpenPreferencePageTest#testOpenPreferencePage()-cold
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 271ms is not within [0%, 110%] of 1ms
- 27,000.0% [n/a]
|
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 194ms is not within [0%, 110%] of 135ms
- 43.7% [n/a]
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 282ms is not within [0%, 110%] of 172ms
- 64.0% [n/a]
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 203ms is not within [0%, 110%] of 109ms
- 86.2% [n/a]
|
OpenQuickOutlineTest#testOpenQuickOutline1()-cold
|
+27.1% [±2.4]
|
+33.6% [±3.0]
|
+31.6% [±3.9]
|
+44.5% [±3.3]
|
OpenQuickOutlineTest#testOpenQuickOutline1()-warm
|
+24.8% [±2.0]
|
+30.8% [±1.5]
|
+37.8% [±4.6]
|
+44.2% [±3.3]
|
OpenTextEditorStartupTest#testTextEditorStartup()
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 10.26s is not within [0%, 110%] of 8.76s - Explanation comment: The startup with open Text editor performance has been decreased due to general start-up time degradation. See the org.eclipse.core.tests.runtime.perf.UIStartupTest.testUIApplicationStartup performance test on the detailed org.eclipse.core performance results page.
- 17.2% [n/a]
|
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 8.69s is not within [0%, 110%] of 7.5s - Explanation comment: The startup with open Text editor performance has been decreased due to general start-up time degradation. See the org.eclipse.core.tests.runtime.perf.UIStartupTest.testUIApplicationStartup performance test on the detailed org.eclipse.core performance results page.
- 15.8% [n/a]
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 12.5s is not within [0%, 110%] of 10.52s - Explanation comment: The startup with open Text editor performance has been decreased due to general start-up time degradation. See the org.eclipse.core.tests.runtime.perf.UIStartupTest.testUIApplicationStartup performance test on the detailed org.eclipse.core performance results page.
- 18.9% [n/a]
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 8.23s is not within [0%, 110%] of 7.16s - Explanation comment: The startup with open Text editor performance has been decreased due to general start-up time degradation. See the org.eclipse.core.tests.runtime.perf.UIStartupTest.testUIApplicationStartup performance test on the detailed org.eclipse.core performance results page.
- 15.1% [n/a]
|
OpenTextEditorTest#testOpenEditor3()
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 129ms is not within [0%, 110%] of 112ms
- 15.2% [±1.6]
|
- 0.8% [±1.2]
|
+3.1% [±1.9]
|
+2.1% [±1.5]
|
OpenTextEditorTest#testOpenTextEditor1()
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 123ms is not within [0%, 110%] of 108ms
- 13.9% [±2.6]
|
- 1.6% [±1.3]
|
- 6.0% [±1.9]
|
- 5.8% [±1.4]
|
OpenTextEditorTest#testOpenTextEditor2()
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 116ms is not within [0%, 110%] of 95ms
- 22.1% [±4.2]
|
- 2.6% [±4.0]
|
- 2.8% [±5.8]
|
- 8.5% [±3.8]
|
RevertJavaEditorTest#test2()
|
+10.8% [±5.6]
|
+12.6% [±2.8]
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 271ms is not within [0%, 110%] of 212ms
- 27.8% [±17.1]
|
+14.1% [±6.0]
|
RevertJavaEditorTest#testRevertJavaEditor()
|
+13.7% [±4.2]
|
+20.2% [±5.3]
|
+55.8% [±44.7]
|
+10.7% [±4.2]
|
RevertTextEditorTest#testRevertTextEditor()
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 35ms is not within [0%, 110%] of 26ms
- 34.6% [±12.9]
|
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 32ms is not within [0%, 110%] of 24ms
- 33.3% [±13.2]
|
+17.0% [±13.5]
|
+0.0% [±1.0]
|
SaveJavaEditorTest#test1()
|
+20.5% [±59.4]
|
+90.7% [±57.7]
|
+14.7% [±6.8]
|
+26.8% [±20.1]
|
SaveTextEditorTest#test1()
|
+56.9% [±62.9]
|
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 593ms is not within [0%, 110%] of 314ms
- 88.9% [±51.3]
|
+40.8% [±49.0]
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 1.03s is not within [0%, 110%] of 594ms
- 74.1% [±53.9]
|
ScrollAnnotatedJavaEditorTest#testScrollJavaEditorLineWise1()
|
- 1.6% [±0.1]
|
- 3.2% [±0.0]
|
- 9.7% [±0.1]
|
- 6.9% [±0.1]
|
ScrollAnnotatedJavaEditorTest#testScrollJavaEditorLineWiseMoveCaret1()
|
+4.3% [±0.1]
|
- 5.0% [±0.0]
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 18.86s is not within [0%, 110%] of 15.86s
- 18.9% [±0.1]
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 15.76s is not within [0%, 110%] of 14.12s
- 11.6% [±0.1]
|
ScrollAnnotatedJavaEditorTest#testScrollJavaEditorLineWiseSelect1()
|
- 8.2% [±0.0]
|
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 42.68s is not within [0%, 110%] of 38.66s
- 10.4% [±0.0]
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 31.59s is not within [0%, 110%] of 28.61s
- 10.4% [±0.0]
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 17.84s is not within [0%, 110%] of 15.24s
- 17.1% [±0.1]
|
ScrollAnnotatedJavaEditorTest#testScrollJavaEditorPageWise()
|
+4.1% [±0.1]
|
- 2.1% [±0.5]
|
- 5.2% [±0.1]
|
- 2.6% [±0.1]
|
ScrollJavaEditorTest#testScrollJavaEditorLineWise2()
|
- 5.0% [±0.1]
|
- 3.3% [±0.0]
|
- 9.3% [±0.0]
|
- 5.3% [±0.1]
|
ScrollJavaEditorTest#testScrollJavaEditorLineWiseMoveCaret2()
|
+2.0% [±0.0]
|
- 4.9% [±0.2]
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 18.11s is not within [0%, 110%] of 14.68s
- 23.3% [±0.1]
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 14.85s is not within [0%, 110%] of 13.32s
- 11.5% [±0.1]
|
ScrollJavaEditorTest#testScrollJavaEditorLineWiseSelect2()
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 47.52s is not within [0%, 110%] of 42.54s
- 11.7% [±0.0]
|
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 41s is not within [0%, 110%] of 37.19s
- 10.2% [±0.1]
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 31.15s is not within [0%, 110%] of 27.55s
- 13.1% [±0.0]
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 16.95s is not within [0%, 110%] of 14.5s
- 17.0% [±0.1]
|
ScrollJavaEditorTest#testScrollJavaEditorPageWise()
|
+3.6% [±1.0]
|
- 4.4% [±0.4]
|
- 3.7% [±0.6]
|
- 2.8% [±0.3]
|
ScrollTextEditorTest#testScrollTextEditorLineWise2()
|
- 7.2% [±0.1]
|
- 5.0% [±0.1]
|
- 9.1% [±0.1]
|
- 8.7% [±0.1]
|
ScrollTextEditorTest#testScrollTextEditorLineWiseMoveCaret2()
|
- 2.6% [±0.1]
|
- 10.0% [±0.1]
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 18.6s is not within [0%, 110%] of 13.82s
- 34.6% [±0.1]
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 10.09s is not within [0%, 110%] of 8.54s
- 18.2% [±0.2]
|
ScrollTextEditorTest#testScrollTextEditorLineWiseSelect2()
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 26.95s is not within [0%, 110%] of 22.24s
- 21.2% [±0.0]
|
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 26.15s is not within [0%, 110%] of 21.91s
- 19.4% [±0.4]
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 13.75s is not within [0%, 110%] of 11.1s
- 23.9% [±0.1]
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 12.16s is not within [0%, 110%] of 9.79s
- 24.2% [±0.2]
|
ScrollTextEditorTest#testScrollTextEditorPageWise()
|
+1.7% [±0.4]
|
- 7.6% [±0.3]
|
- 7.1% [±0.1]
|
- 4.8% [±0.1]
|
SynchronizedLineDifferInitializationTest#testInitializationWithFewChanges()
|
- 2.0% [±2.0]
|
+0.2% [±0.2]
|
+0.7% [±1.2]
|
- 0.9% [±1.3]
|
SynchronizedLineDifferInitializationTest#testInitializationWithManyChanges()
|
+0.7% [±0.7]
|
+0.0% [±0.1]
|
- 1.2% [±0.5]
|
- 1.2% [±1.3]
|
SynchronizedLineDifferInitializationTest#testInitializationWithManyChangesButEqualSize()
|
+7.8% [±4.0]
|
+0.0% [±0.1]
|
- 1.7% [±1.4]
|
+0.0% [±1.9]
|
SynchronizedLineDifferInitializationTest#testInitializationWithNoChanges()
|
- 0.4% [±0.2]
|
+0.0% [±0.2]
|
+3.9% [±1.5]
|
- 0.2% [±0.8]
|
TextMoveLineTest#test()
|
+42.5% [±34.0]
|
+10.8% [±54.2]
|
+4.7% [±0.4]
|
+1.0% [±1.1]
|
TextNonInitialTypingTest#testTypeAMethod()
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 196ms is not within [0%, 110%] of 5ms
- 3,820.0% [±3,833.3]
|
+45.5% [±27.1]
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 375ms is not within [0%, 110%] of 322ms
- 16.5% [±1.7]
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 250ms is not within [0%, 110%] of 203ms
- 23.2% [±0.2]
|
ToggleCommentTest#testToggleComment2()-comment
|
+9.1% [±4.3]
|
+17.6% [±3.2]
|
+39.0% [±22.5]
|
+96.3% [±0.8]
|
ToggleCommentTest#testToggleComment2()-uncomment
|
+5.3% [±1.9]
|
+14.5% [±3.7]
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}':
Elapsed Process: 3.3s is not within [0%, 110%] of 1.15s
- 188.1% [±228.2]
|
+84.4% [±2.2]
|
UndoJavaEditorTest#testUndoJavaEditor2()
|
+54.6% [±0.3]
|
+58.5% [±2.2]
|
+79.6% [±7.9]
|
+53.0% [±0.5]
|
UndoTextEditorTest#testUndoTextEditor2()
|
+97.0% [±0.1]
|
+97.7% [±0.1]
|
+99.0% [±1.6]
|
+97.5% [±0.2]
|