All 110 scenarios |
RHEL 3.0 Sun 1.4.2_10 (3 GHz 2 GB)
| RHEL 4.0 Sun 1.4.2_10 (3 GHz 2.5 GB)
| Win XP Sun 1.4.2_10 (2 GHz 512 MB)
| Win XP Sun 1.4.2_10 (3 GHz 2 GB)
|
| ActivateJavaEditorTest#testActivateEditor()
|
- 8.3% [±5.2]
|
- 7.5% [±4.0]
|
- 7.7% [±9.5]
|
- 5.3% [±7.4]
|
| ActivateTextEditorTest#testActivateEditor()
|
- 7.5% [±0.8]
|
- 8.1% [±0.5]
|
+1.3% [±1.2]
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 600ms is not within [0%, 110%] of 515ms
- 16.5% [±0.8]
|
| CodeCompletionPerformanceTest#testApplicationNoParamters()
|
+0.2% [±2.0]
|
+0.3% [±2.1]
|
+9.5% [±2.8]
|
+1.2% [±1.8]
|
| CodeCompletionPerformanceTest#testApplicationWithParamterGuesses()
|
+7.9% [±0.9]
|
+11.2% [±0.6]
|
+4.4% [±0.9]
|
+4.5% [±1.0]
|
| CodeCompletionPerformanceTest#testApplicationWithParamterGuesses2()
|
+17.9% [±1.7]
|
+19.3% [±1.7]
|
+19.8% [±2.1]
|
+13.7% [±1.4]
|
| CodeCompletionPerformanceTest#testApplicationWithParamterNames()
|
+2.1% [±1.7]
|
+2.6% [±1.7]
|
+10.4% [±2.1]
|
+3.9% [±1.6]
|
| CodeCompletionPerformanceTest#testCompletionNoParamters()
|
+7.2% [±0.7]
|
+8.7% [±0.5]
|
+0.6% [±1.9]
|
+5.5% [±1.0]
|
| CodeCompletionPerformanceTest#testCompletionWithParamterGuesses()
|
+7.6% [±0.6]
|
+13.7% [±0.6]
|
+7.5% [±0.7]
|
+8.1% [±1.1]
|
| CodeCompletionPerformanceTest#testCompletionWithParamterGuesses2()
|
+5.2% [±0.5]
|
+8.1% [±0.4]
|
+2.0% [±0.6]
|
+1.1% [±0.7]
|
| CodeCompletionPerformanceTest#testCompletionWithParamterNames()
|
+10.1% [±0.8]
|
+11.0% [±0.6]
|
+7.3% [±0.6]
|
+4.5% [±1.0]
|
| ContentTypeTest#testJavaDirty()
|
+1.9% [±1.6]
|
+1.0% [±1.5]
|
+6.7% [±7.7]
|
+2.9% [±5.5]
|
| ContentTypeTest#testPluginPropertiesDirty()
|
+3.2% [±1.3]
|
+0.0% [±1.0]
|
- 2.3% [±4.1]
|
- 2.7% [±3.8]
|
| ContentTypeTest#testPluginXMLDirty()
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 1.75s is not within [0%, 110%] of 1.16s
- 51.3% [±0.7]
|
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 1.32s is not within [0%, 110%] of 858ms
- 54.0% [±0.4]
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 2.67s is not within [0%, 110%] of 1.79s
- 49.3% [±0.4]
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 1.74s is not within [0%, 110%] of 1.18s
- 48.0% [±0.5]
|
| ContentTypeTest#testPropertiesDirty()
|
+1.7% [±1.3]
|
+1.8% [±1.6]
|
- 6.0% [±4.9]
|
+0.0% [±0.3]
|
| ContentTypeTest#testTextDirty()
|
+2.0% [±1.6]
|
+2.0% [±2.1]
|
+3.6% [±5.8]
|
+4.0% [±4.9]
|
| ConvertLineDelimitersProjectTest#test()
|
+26.8% [±20.0]
|
+61.1% [±38.9]
|
+6.3% [±13.8]
|
+27.9% [±2.9]
|
| DocumentLineDifferInitializationTest#testInitializationWithFewChanges()
|
- 2.0% [±2.0]
|
+0.3% [±0.1]
|
+0.5% [±1.6]
|
- 4.9% [±1.2]
|
| DocumentLineDifferInitializationTest#testInitializationWithManyChanges()
|
+0.5% [±0.4]
|
+0.0% [±0.1]
|
- 1.6% [±0.8]
|
+91.9% [n/a]
|
| DocumentLineDifferInitializationTest#testInitializationWithManyChangesButEqualSize()
|
+3.9% [±4.0]
|
+0.0% [±0.1]
|
+1.2% [±1.9]
|
- 1.9% [±1.5]
|
| DocumentLineDifferInitializationTest#testInitializationWithNoChanges()
|
+0.0% [±0.0]
|
+0.2% [±0.1]
|
- 2.2% [±1.1]
|
+2.0% [±1.1]
|
| DocumentLineDifferModificationTest#testEditingChanged()
|
+44.0% [±5.3]
|
+56.1% [±6.0]
|
+50.7% [±5.4]
|
+32.4% [±9.7]
|
| DocumentLineDifferModificationTest#testEditingUnchanged()
|
+64.3% [±2.6]
|
+71.4% [±4.3]
|
+82.6% [±29.1]
|
[n/a]
|
| DocumentPerformanceTest#measureDeleteInsert()
|
+93.1% [±0.3]
|
+93.1% [±0.1]
|
+93.2% [±0.3]
|
+92.5% [±0.4]
|
| DocumentPerformanceTest#measureGetAll()
|
[n/a]
|
[n/a]
|
+100.0% [±75.6]
|
[n/a]
|
| DocumentPerformanceTest#measureGetChar()
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 198ms is not within [0%, 110%] of 98ms
- 102.0% [±2.0]
|
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 68ms is not within [0%, 110%] of 56ms
- 21.4% [±1.2]
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 232ms is not within [0%, 110%] of 128ms
- 81.2% [±1.4]
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 151ms is not within [0%, 110%] of 99ms
- 52.5% [±3.9]
|
| DocumentPerformanceTest#measureGetLength()
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 193ms is not within [0%, 110%] of 148ms
- 30.4% [±4.4]
|
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 83ms is not within [0%, 110%] of 73ms
- 13.7% [±0.2]
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 281ms is not within [0%, 110%] of 249ms
- 12.9% [±4.1]
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 184ms is not within [0%, 110%] of 144ms
- 27.8% [±1.5]
|
| DocumentPerformanceTest#measureGetLine()
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 72ms is not within [0%, 110%] of 59ms
- 22.0% [±1.4]
|
- 2.1% [±1.5]
|
+3.3% [±5.0]
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 68ms is not within [0%, 110%] of 61ms
- 11.5% [±4.5]
|
| DocumentPerformanceTest#measureGetNumberOfLines()
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 131ms is not within [0%, 110%] of 109ms
- 20.2% [±1.7]
|
- 6.0% [±0.3]
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 255ms is not within [0%, 110%] of 171ms
- 49.1% [±1.3]
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 126ms is not within [0%, 110%] of 108ms
- 16.7% [±1.7]
|
| DocumentPerformanceTest#measureInsertAtEnd()
|
+89.5% [±0.3]
|
+89.5% [±0.4]
|
+90.7% [±0.2]
|
+89.6% [±0.4]
|
| DocumentPerformanceTest#measureInsertAtStart()
|
+96.9% [±0.0]
|
+96.9% [±0.0]
|
+97.2% [±0.0]
|
+96.9% [±0.1]
|
| DocumentPerformanceTest#measureLineByIndex()
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 130ms is not within [0%, 110%] of 106ms
- 22.6% [±1.1]
|
- 9.9% [±1.5]
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 307ms is not within [0%, 110%] of 207ms
- 48.3% [±2.6]
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 175ms is not within [0%, 110%] of 110ms
- 59.1% [±2.0]
|
| DocumentPerformanceTest#measureLineByOffset()
|
- 6.7% [±0.7]
|
- 1.7% [±0.3]
|
- 4.6% [±0.7]
|
- 2.1% [±1.3]
|
| DocumentPerformanceTest#measureLineDelimiterByIndex()
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 130ms is not within [0%, 110%] of 101ms
- 28.7% [±1.9]
|
- 8.6% [±0.2]
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 257ms is not within [0%, 110%] of 156ms
- 64.7% [±1.4]
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 157ms is not within [0%, 110%] of 102ms
- 53.9% [±1.9]
|
| DocumentPerformanceTest#measureLineInfoByIndex()
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 245ms is not within [0%, 110%] of 213ms
- 15.0% [±0.6]
|
+4.7% [±0.2]
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 327ms is not within [0%, 110%] of 254ms
- 28.7% [±0.8]
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 245ms is not within [0%, 110%] of 203ms
- 20.7% [±1.0]
|
| DocumentPerformanceTest#measureLineInfoByOffset()
|
- 6.2% [±0.5]
|
- 0.7% [±0.5]
|
- 3.6% [±0.7]
|
- 3.3% [±1.0]
|
| DocumentPerformanceTest#measureLineLengthByIndex()
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 128ms is not within [0%, 110%] of 100ms
- 28.0% [±1.0]
|
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 78ms is not within [0%, 110%] of 70ms
- 11.4% [±2.6]
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 224ms is not within [0%, 110%] of 165ms
- 35.8% [±1.5]
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 155ms is not within [0%, 110%] of 100ms
- 55.0% [±2.2]
|
| DocumentPerformanceTest#measureRandomReplace()
|
+91.0% [±0.1]
|
+89.8% [±0.1]
|
+97.3% [±0.0]
|
+95.1% [±0.1]
|
| DocumentPerformanceTest#measureRepeatedReplace()
|
+7.1% [±1.3]
|
+9.8% [±0.6]
|
+8.1% [±1.2]
|
+6.9% [±1.4]
|
| DocumentPerformanceTest#measureSet()
|
+3.4% [±1.4]
|
+0.0% [±1.0]
|
+24.0% [±4.9]
|
+0.0% [±4.4]
|
| DocumentPerformanceTest#measureTypingReplaceInLargeFile()
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 180ms is not within [0%, 110%] of 159ms
- 13.2% [±1.4]
|
+2.1% [±0.5]
|
+17.2% [±1.7]
|
+21.0% [±1.7]
|
| DocumentPerformanceTest#measureTypingReplaceInSmallFile()
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 180ms is not within [0%, 110%] of 158ms
- 13.9% [±0.6]
|
+1.4% [±0.8]
|
+14.1% [±1.9]
|
+22.5% [±1.5]
|
| GapTextStorePerformanceTest#measureDeleteInsert()
|
+94.7% [±0.3]
|
+94.7% [±0.1]
|
+94.9% [±0.2]
|
+95.1% [±0.6]
|
| GapTextStorePerformanceTest#measureGetAll()
|
+2.7% [±0.6]
|
- 0.7% [±0.1]
|
+2.2% [±0.2]
|
+1.6% [±0.7]
|
| GapTextStorePerformanceTest#measureGetChar()
|
+17.2% [±0.5]
|
+10.9% [±0.1]
|
+17.9% [±0.8]
|
+17.5% [±0.6]
|
| GapTextStorePerformanceTest#measureGetLine()
|
- 2.5% [±0.6]
|
+3.2% [±0.3]
|
- 1.3% [±0.8]
|
- 1.9% [±0.9]
|
| GapTextStorePerformanceTest#measureInsertAtEnd()
|
+0.0% [±1.8]
|
+0.0% [±1.2]
|
+3.7% [±2.3]
|
+2.5% [±6.4]
|
| GapTextStorePerformanceTest#measureInsertAtStart()
|
+97.3% [±0.2]
|
+97.3% [±0.1]
|
+97.5% [±0.1]
|
+97.8% [±0.3]
|
| GapTextStorePerformanceTest#measureRandomReplace()
|
+92.3% [±0.1]
|
+90.6% [±0.0]
|
+97.8% [±0.0]
|
+96.0% [±0.1]
|
| GapTextStorePerformanceTest#measureRepeatedReplace()
|
+74.5% [±6.6]
|
+82.4% [±0.3]
|
+71.9% [±0.9]
|
+75.9% [±4.3]
|
| GapTextStorePerformanceTest#measureSet()
|
+36.7% [±0.6]
|
+75.0% [±0.2]
|
+30.4% [±0.3]
|
+32.2% [±0.9]
|
| GapTextStorePerformanceTest#measureTypingReplaceInLargeFile()
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 27ms is not within [0%, 110%] of 24ms
- 12.5% [±3.8]
|
+0.0% [±0.8]
|
+23.8% [±4.5]
|
+13.0% [±10.8]
|
| GapTextStorePerformanceTest#measureTypingReplaceInSmallFile()
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 30ms is not within [0%, 110%] of 25ms
- 20.0% [±4.8]
|
+0.0% [±0.6]
|
+15.8% [±6.7]
|
+9.1% [±11.0]
|
| JavaExpandSelectionTest#test()
|
+13.1% [±1.2]
|
+8.1% [±0.8]
|
+25.1% [±0.8]
|
+15.5% [±1.0]
|
| JavaFormatterProjectTest#test()
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 3.52s is not within [0%, 110%] of 3.08s
- 14.2% [±16.1]
|
- 8.5% [±11.1]
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 4.01s is not within [0%, 110%] of 3.09s
- 29.6% [±1.8]
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 2.71s is not within [0%, 110%] of 2.07s
- 31.0% [±1.5]
|
| JavaFormatterTest#test()
|
+31.5% [±2.5]
|
+21.3% [±0.7]
|
+40.8% [±2.0]
|
+27.8% [±2.2]
|
| JavaIndenterTest#testJavaIndenter2()
|
+51.6% [±35.5]
|
+6.2% [±3.1]
|
+6.2% [±3.1]
|
- 6.7% [±0.0]
|
| JavaMoveLineTest#test()
|
+88.5% [±61.4]
|
- 4.1% [±75.3]
|
+14.6% [±5.2]
|
+9.1% [±1.4]
|
| JavaReplaceAllTest#test()
|
+7.6% [±1.9]
| n/a
|
- 3.0% [±1.1]
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 1.74s is not within [0%, 110%] of 1.56s
- 11.7% [±9.8]
|
| JavaReplaceAllWithQuickDiffTest#test()
|
- 8.3% [±7.4]
| n/a
|
- 2.3% [±1.6]
|
- 6.4% [±2.0]
|
| LineTrackerPerformanceTest#testLineByIndex()
|
+13.2% [±0.2]
|
+0.3% [±0.1]
|
+8.5% [±0.2]
|
+3.1% [±0.3]
|
| LineTrackerPerformanceTest#testLineByIndex2()
|
+0.4% [±0.3]
|
+0.0% [±0.1]
|
+0.9% [±0.2]
|
- 0.4% [±0.4]
|
| LineTrackerPerformanceTest#testLineByOffset()
|
+16.6% [±0.4]
|
+0.6% [±0.2]
|
+3.3% [±0.2]
|
+17.4% [±0.3]
|
| LineTrackerPerformanceTest#testLineByOffset2()
|
+0.3% [±0.1]
|
+0.0% [±0.1]
|
- 1.5% [±0.0]
|
+0.7% [±0.1]
|
| LineTrackerPerformanceTest#testRandomReplace()
|
+11.5% [±0.8]
|
+11.4% [±0.1]
|
+1.0% [±0.6]
|
+10.6% [±0.7]
|
| LineTrackerPerformanceTest#testReplace()
|
+1.4% [±0.7]
|
- 0.3% [±0.3]
|
- 2.6% [±0.7]
|
+0.6% [±0.7]
|
| LineTrackerPerformanceTest#testSet()
|
- 0.5% [±0.6]
|
+0.3% [±0.2]
|
+1.0% [±0.6]
|
- 1.1% [±1.0]
|
| NonInitialTypingTest#testTypeAMethod()
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 465ms is not within [0%, 110%] of 31ms
- 1,400.0% [±781.3]
|
+12.1% [±2.8]
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 776ms is not within [0%, 110%] of 661ms
- 17.4% [±12.7]
|
- 7.9% [±2.2]
|
| OpenJavaContentAssistTest#test1()-cold
|
+55.1% [±1.3]
|
+50.3% [±3.0]
|
+55.4% [±3.8]
|
+66.8% [±3.2]
|
| OpenJavaContentAssistTest#test1()-warm
|
+55.4% [±2.7]
|
+53.6% [±3.1]
|
+56.9% [±4.1]
|
+65.5% [±2.7]
|
| OpenJavaEditorStartupTest#testJavaEditorStartup()
|
+1.1% [n/a]
|
- 0.6% [n/a]
|
- 7.6% [n/a]
|
+0.1% [n/a]
|
| OpenJavaEditorTest#testOpenEditor3()
|
- 9.1% [±2.7]
|
- 0.9% [±2.6]
|
+4.7% [±3.6]
|
- 8.0% [±3.1]
|
| OpenJavaEditorTest#testOpenEditor4()
|
- 9.8% [±3.2]
|
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 621ms is not within [0%, 110%] of 556ms
- 11.7% [±4.1]
|
+1.8% [±3.7]
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 547ms is not within [0%, 110%] of 496ms
- 10.3% [±3.0]
|
| OpenJavaEditorTest#testOpenEditor5()
|
+6.9% [±2.5]
|
+5.9% [±3.1]
|
+5.5% [±4.3]
|
+3.1% [±4.1]
|
| OpenJavaEditorTest#testOpenEditor6()
|
- 6.2% [±5.5]
|
- 8.8% [±4.2]
|
- 1.0% [±5.7]
|
- 5.3% [±5.0]
|
| OpenJavaEditorTest#testOpenJavaEditor1()
|
+14.4% [±6.3]
|
+9.0% [±5.6]
|
+1.1% [±8.3]
|
+6.3% [±7.2]
|
| OpenJavaEditorTest#testOpenJavaEditor2()
|
+23.9% [±7.9]
|
+8.4% [±7.1]
|
+14.0% [±6.1]
|
+1.7% [±5.0]
|
| OpenPreferencePageTest#testOpenPreferencePage()-cold
|
+0.0% [n/a]
|
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 193ms is not within [0%, 110%] of 137ms
- 40.9% [n/a]
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 282ms is not within [0%, 110%] of 172ms
- 64.0% [n/a]
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 187ms is not within [0%, 110%] of 109ms
- 71.6% [n/a]
|
| OpenQuickOutlineTest#testOpenQuickOutline1()-cold
|
+17.7% [±2.3]
|
+11.1% [±3.6]
|
+2.5% [±5.3]
|
+27.4% [±3.0]
|
| OpenQuickOutlineTest#testOpenQuickOutline1()-warm
|
+17.1% [±1.8]
|
+12.5% [±2.1]
|
+7.4% [±2.0]
|
+30.9% [±2.9]
|
| OpenTextEditorStartupTest#testTextEditorStartup()
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 10.36s is not within [0%, 110%] of 8.75s - Explanation comment: The startup with open Text editor performance has been decreased due to general start-up time degradation. See the org.eclipse.core.tests.runtime.perf.UIStartupTest.testUIApplicationStartup performance test on the detailed org.eclipse.core performance results page.
- 18.4% [n/a]
|
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 8.74s is not within [0%, 110%] of 7.6s - Explanation comment: The startup with open Text editor performance has been decreased due to general start-up time degradation. See the org.eclipse.core.tests.runtime.perf.UIStartupTest.testUIApplicationStartup performance test on the detailed org.eclipse.core performance results page.
- 15.0% [n/a]
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 12.36s is not within [0%, 110%] of 10.41s - Explanation comment: The startup with open Text editor performance has been decreased due to general start-up time degradation. See the org.eclipse.core.tests.runtime.perf.UIStartupTest.testUIApplicationStartup performance test on the detailed org.eclipse.core performance results page.
- 18.8% [n/a]
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 8.3s is not within [0%, 110%] of 7.17s - Explanation comment: The startup with open Text editor performance has been decreased due to general start-up time degradation. See the org.eclipse.core.tests.runtime.perf.UIStartupTest.testUIApplicationStartup performance test on the detailed org.eclipse.core performance results page.
- 15.7% [n/a]
|
| OpenTextEditorTest#testOpenEditor3()
|
- 6.1% [±1.5]
|
- 0.8% [±1.2]
|
+3.8% [±2.1]
|
+3.1% [±1.5]
|
| OpenTextEditorTest#testOpenTextEditor1()
|
- 1.8% [±3.4]
|
- 0.8% [±1.2]
|
- 4.0% [±1.9]
|
- 4.6% [±1.4]
|
| OpenTextEditorTest#testOpenTextEditor2()
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 108ms is not within [0%, 110%] of 97ms
- 11.3% [±4.1]
|
+0.9% [±2.9]
|
- 4.3% [±5.9]
|
- 3.6% [±1.4]
|
| RevertJavaEditorTest#test2()
|
+15.1% [±2.1]
|
+18.1% [±2.3]
|
+9.6% [±6.7]
|
+12.6% [±2.1]
|
| RevertJavaEditorTest#testRevertJavaEditor()
|
+15.8% [±5.5]
|
+19.1% [±5.8]
|
+19.0% [±6.4]
|
+43.0% [±38.2]
|
| RevertTextEditorTest#testRevertTextEditor()
|
+0.0% [±11.6]
|
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 33ms is not within [0%, 110%] of 24ms
- 37.5% [±15.3]
|
- 7.0% [±6.9]
|
- 9.7% [±10.2]
|
| SaveJavaEditorTest#test1()
|
+35.1% [±74.2]
|
+67.8% [±45.5]
|
+9.3% [±12.8]
| n/a
|
| SaveTextEditorTest#test1()
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 893ms is not within [0%, 110%] of 399ms
- 123.8% [±77.4]
|
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 901ms is not within [0%, 110%] of 309ms
- 191.6% [±105.3]
|
+40.6% [±26.4]
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 777ms is not within [0%, 110%] of 578ms
- 34.4% [±15.3]
|
| ScrollAnnotatedJavaEditorTest#testScrollJavaEditorLineWise1()
|
+0.1% [±0.1]
|
- 4.7% [±0.0]
|
- 8.3% [±0.2]
|
- 5.6% [±0.2]
|
| ScrollAnnotatedJavaEditorTest#testScrollJavaEditorLineWiseMoveCaret1()
|
+5.0% [±0.1]
|
- 5.6% [±0.1]
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 18.62s is not within [0%, 110%] of 15.82s
- 17.7% [±0.1]
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 15.71s is not within [0%, 110%] of 14.11s
- 11.3% [±0.1]
|
| ScrollAnnotatedJavaEditorTest#testScrollJavaEditorLineWiseSelect1()
|
- 7.6% [±0.0]
|
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 42.71s is not within [0%, 110%] of 38.51s
- 10.9% [±0.1]
|
- 8.1% [±0.1]
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 17.84s is not within [0%, 110%] of 15.26s
- 16.9% [±0.1]
|
| ScrollAnnotatedJavaEditorTest#testScrollJavaEditorPageWise()
|
+4.3% [±0.4]
|
- 3.5% [±0.2]
|
- 2.9% [±0.1]
|
- 2.3% [±0.1]
|
| ScrollJavaEditorTest#testScrollJavaEditorLineWise2()
|
- 2.2% [±0.1]
|
- 4.7% [±0.1]
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 12.46s is not within [0%, 110%] of 11.29s
- 10.4% [±0.2]
|
- 4.7% [±0.1]
|
| ScrollJavaEditorTest#testScrollJavaEditorLineWiseMoveCaret2()
|
+9.3% [±0.1]
|
- 5.9% [±0.1]
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 18.17s is not within [0%, 110%] of 14.53s
- 25.1% [±0.1]
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 14.84s is not within [0%, 110%] of 13.36s
- 11.1% [±0.0]
|
| ScrollJavaEditorTest#testScrollJavaEditorLineWiseSelect2()
|
- 7.9% [±0.0]
|
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 41.26s is not within [0%, 110%] of 36.58s
- 12.8% [±0.2]
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 30.61s is not within [0%, 110%] of 27.52s
- 11.2% [±0.1]
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 16.96s is not within [0%, 110%] of 14.52s
- 16.9% [±0.0]
|
| ScrollJavaEditorTest#testScrollJavaEditorPageWise()
|
+6.2% [±0.2]
|
- 3.5% [±0.7]
|
- 3.9% [±0.6]
|
- 3.8% [±0.3]
|
| ScrollTextEditorTest#testScrollTextEditorLineWise2()
|
- 2.9% [±0.1]
|
- 6.8% [±0.1]
|
- 9.5% [±0.2]
|
- 9.6% [±0.1]
|
| ScrollTextEditorTest#testScrollTextEditorLineWiseMoveCaret2()
|
+6.4% [±0.1]
|
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 17.64s is not within [0%, 110%] of 15.83s
- 11.5% [±0.2]
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 18.7s is not within [0%, 110%] of 13.84s
- 35.1% [±0.0]
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 10.09s is not within [0%, 110%] of 8.55s
- 18.0% [±0.2]
|
| ScrollTextEditorTest#testScrollTextEditorLineWiseSelect2()
|
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 25.6s is not within [0%, 110%] of 22.38s
- 14.4% [±0.1]
|
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 26.42s is not within [0%, 110%] of 21.7s
- 21.8% [±0.1]
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 13.71s is not within [0%, 110%] of 11.02s
- 24.4% [±0.0]
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 12.18s is not within [0%, 110%] of 9.82s
- 24.1% [±0.1]
|
| ScrollTextEditorTest#testScrollTextEditorPageWise()
|
+4.9% [±0.1]
|
- 8.5% [±0.3]
|
- 5.7% [±0.2]
|
- 5.9% [±0.1]
|
| SynchronizedLineDifferInitializationTest#testInitializationWithFewChanges()
|
+2.1% [±2.0]
|
+0.0% [±0.1]
|
- 0.4% [±1.6]
|
- 0.5% [±1.0]
|
| SynchronizedLineDifferInitializationTest#testInitializationWithManyChanges()
|
+0.0% [±0.0]
|
+0.0% [±0.0]
|
- 0.1% [±1.2]
|
+0.0% [±0.1]
|
| SynchronizedLineDifferInitializationTest#testInitializationWithManyChangesButEqualSize()
|
+0.1% [±0.0]
|
+0.1% [±0.3]
|
+0.0% [±1.0]
|
+0.0% [±2.2]
|
| SynchronizedLineDifferInitializationTest#testInitializationWithNoChanges()
|
+0.2% [±0.0]
|
- 0.2% [±0.1]
|
- 1.3% [±1.3]
|
+0.0% [±0.0]
|
| TextMoveLineTest#test()
|
+23.2% [±67.8]
|
+20.2% [±51.6]
|
+6.1% [±0.5]
|
+0.9% [±0.8]
|
| TextNonInitialTypingTest#testTypeAMethod()
|
+50.0% [±51.9]
|
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 301ms is not within [0%, 110%] of 207ms
- 45.4% [±51.0]
|
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 375ms is not within [0%, 110%] of 301ms
- 24.6% [±1.7]
|
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200706111606, jvm=sun}':
Elapsed Process: 250ms is not within [0%, 110%] of 203ms
- 23.2% [±0.2]
|
| ToggleCommentTest#testToggleComment2()-comment
|
+17.3% [±3.5]
|
+12.6% [±4.1]
|
+64.1% [±43.2]
|
+96.2% [±0.5]
|
| ToggleCommentTest#testToggleComment2()-uncomment
|
+17.2% [±5.1]
|
+25.5% [±10.1]
|
+46.2% [±75.7]
|
+87.6% [±15.4]
|
| UndoJavaEditorTest#testUndoJavaEditor2()
|
+54.9% [±0.1]
|
+62.2% [±2.4]
|
+80.2% [±0.3]
|
+54.1% [±0.1]
|
| UndoTextEditorTest#testUndoTextEditor2()
|
+97.3% [±0.4]
|
+97.5% [±0.3]
|
+99.2% [±2.1]
|
+93.9% [±3.4]
|
