All 110 scenarios |
SLED 10 Sun 1.6.0_17 (2 x 3.00GHz - 3GB RAM)
| RHEL 5.0 Sun 6.0_04 (2 x 3.00GHz - 3GB RAM)
| Win XP Sun 1.6.0_17 (2 x 3.00GHz - 3GB RAM)
| Win XP Sun 1.6.0_17 (2 x 3.00GHz - 3GB RAM)
|
ActivateJavaEditorTest#testActivateEditor()
|
- 4.0% [±2.2]
|
- 1.3% [±1.7]
| n/a | n/a |
ActivateTextEditorTest#testActivateEditor()
|
+4.2% [±1.2]
|
+2.0% [±1.4]
| n/a | n/a |
CodeCompletionPerformanceTest#testApplicationNoParamters()
|
+3.4% [±2.0]
|
- 0.3% [±2.3]
| n/a | n/a |
CodeCompletionPerformanceTest#testApplicationWithParamterGuesses()
|
+8.4% [±7.3]
|
Performance criteria not met when compared to 'R-3.6-201006080911_201109021800': Elapsed Process= 13.3s is not within [0%, 110'%] of 1.4s
- 832.8% [±51.7]
| n/a | n/a |
CodeCompletionPerformanceTest#testApplicationWithParamterGuesses2()
|
+8.2% [±7.2]
|
Performance criteria not met when compared to 'R-3.6-201006080911_201109021800': Elapsed Process= 14.3s is not within [0%, 110'%] of 1.8s
- 716.6% [±43.5]
| n/a | n/a |
CodeCompletionPerformanceTest#testApplicationWithParamterNames()
|
+8.9% [±7.2]
|
Performance criteria not met when compared to 'R-3.6-201006080911_201109021800': Elapsed Process= 13.4s is not within [0%, 110'%] of 1.5s
- 813.8% [±50.8]
| n/a | n/a |
CodeCompletionPerformanceTest#testCompletionNoParamters()
|
- 3.2% [±2.0]
|
- 1.5% [±1.8]
| n/a | n/a |
CodeCompletionPerformanceTest#testCompletionWithParamterGuesses()
|
- 2.6% [±1.1]
|
- 1.5% [±1.1]
| n/a | n/a |
CodeCompletionPerformanceTest#testCompletionWithParamterGuesses2()
|
- 3.9% [±0.3]
|
- 0.8% [±0.3]
| n/a | n/a |
CodeCompletionPerformanceTest#testCompletionWithParamterNames()
|
- 1.0% [±1.2]
|
- 2.1% [±0.8]
| n/a | n/a |
ContentTypeTest#testJavaDirty()
|
+14.0% [±4.2]
|
+11.5% [±4.0]
| n/a | n/a |
ContentTypeTest#testPluginPropertiesDirty()
|
+9.6% [±1.5]
|
+13.8% [±1.7]
| n/a | n/a |
ContentTypeTest#testPluginXMLDirty()
|
- 0.2% [±0.4]
|
- 0.7% [±0.1]
| n/a | n/a |
ContentTypeTest#testPropertiesDirty()
|
+15.2% [±3.7]
|
+7.8% [±2.8]
| n/a | n/a |
ContentTypeTest#testTextDirty()
|
+9.4% [±5.1]
|
+17.5% [±2.2]
| n/a | n/a |
ConvertLineDelimitersProjectTest#test()
|
- 2.9% [±4.6]
|
+3.8% [±11.9]
| n/a | n/a |
DocumentLineDifferInitializationTest#testInitializationWithFewChanges()
|
+0.0% [±0.0]
|
Performance criteria not met when compared to 'R-3.6-201006080911_201109021800': Elapsed Process= 0.6s is not within [0%, 110'%] of 0.54s
- 11.5% [±1.8]
| n/a | n/a |
DocumentLineDifferInitializationTest#testInitializationWithManyChanges()
|
- 0.2% [±0.1]
|
+0.8% [±3.1]
| n/a | n/a |
DocumentLineDifferInitializationTest#testInitializationWithManyChangesButEqualSize()
|
+0.3% [±3.3]
|
- 2.2% [±3.1]
| n/a | n/a |
DocumentLineDifferInitializationTest#testInitializationWithNoChanges()
|
+0.0% [±0.0]
|
Performance criteria not met when compared to 'R-3.6-201006080911_201109021800': Elapsed Process= 0.6s is not within [0%, 110'%] of 0.54s
- 11.3% [±1.5]
| n/a | n/a |
DocumentLineDifferModificationTest#testEditingChanged()
|
+0.0% [±1.9]
|
+5.9% [±5.1]
| n/a | n/a |
DocumentLineDifferModificationTest#testEditingUnchanged()
|
Performance criteria not met when compared to 'R-3.6-201006080911_201109021800': Elapsed Process= 4ms is not within [0%, 110'%] of 2ms
- 100.0% [±39.3]
|
+33.3% [±19.9]
| n/a | n/a |
DocumentPerformanceTest#measureDeleteInsert()
|
+0.0% [±1.7]
|
- 5.6% [±2.1]
| n/a | n/a |
DocumentPerformanceTest#measureGetChar()
|
+0.0% [±0.2]
|
+0.0% [±0.2]
| n/a | n/a |
DocumentPerformanceTest#measureGetLength()
|
+0.0% [±0.3]
|
+0.0% [±0.2]
| n/a | n/a |
DocumentPerformanceTest#measureGetLine()
|
+11.8% [±2.7]
|
- 3.2% [±1.3]
| n/a | n/a |
DocumentPerformanceTest#measureGetNumberOfLines()
|
+14.5% [±0.2]
|
+2.5% [±2.3]
| n/a | n/a |
DocumentPerformanceTest#measureInsertAtEnd()
|
+2.9% [±1.7]
|
Performance criteria not met when compared to 'R-3.6-201006080911_201109021800': Elapsed Process= 38ms is not within [0%, 110'%] of 33ms
- 15.2% [±1.8]
| n/a | n/a |
DocumentPerformanceTest#measureInsertAtStart()
|
+1.4% [±1.2]
|
- 2.8% [±1.1]
| n/a | n/a |
DocumentPerformanceTest#measureLineByIndex()
|
+0.8% [±0.2]
|
- 0.8% [±0.2]
| n/a | n/a |
DocumentPerformanceTest#measureLineByOffset()
|
+0.0% [±0.1]
|
+0.0% [±0.1]
| n/a | n/a |
DocumentPerformanceTest#measureLineDelimiterByIndex()
|
+28.5% [±0.1]
|
- 1.6% [±0.2]
| n/a | n/a |
DocumentPerformanceTest#measureLineInfoByIndex()
|
+0.7% [±0.3]
|
- 0.7% [±0.3]
| n/a | n/a |
DocumentPerformanceTest#measureLineInfoByOffset()
|
+0.0% [±0.2]
|
+4.9% [±0.2]
| n/a | n/a |
DocumentPerformanceTest#measureLineLengthByIndex()
|
+0.0% [±0.2]
|
+0.0% [±0.2]
| n/a | n/a |
DocumentPerformanceTest#measureRandomReplace()
|
+0.8% [±0.3]
|
- 9.0% [±0.3]
| n/a | n/a |
DocumentPerformanceTest#measureRepeatedReplace()
|
+2.5% [±0.6]
|
Performance criteria not met when compared to 'R-3.6-201006080911_201109021800': Elapsed Process= 0.18s is not within [0%, 110'%] of 0.12s
- 49.6% [±0.5]
| n/a | n/a |
DocumentPerformanceTest#measureSet()
|
+11.6% [±3.2]
|
+0.0% [±1.3]
| n/a | n/a |
DocumentPerformanceTest#measureTypingReplaceInLargeFile()
|
- 1.3% [±0.5]
|
- 5.4% [±0.5]
| n/a | n/a |
DocumentPerformanceTest#measureTypingReplaceInSmallFile()
|
+0.7% [±0.4]
|
+0.0% [±0.4]
| n/a | n/a |
GapTextStorePerformanceTest#measureDeleteInsert()
|
+0.0% [±2.2]
|
- 9.1% [±2.4]
| n/a | n/a |
GapTextStorePerformanceTest#measureGetAll()
|
+0.0% [±0.2]
|
+0.0% [±0.2]
| n/a | n/a |
GapTextStorePerformanceTest#measureGetChar()
|
+0.0% [±0.2]
|
+0.0% [±0.1]
| n/a | n/a |
GapTextStorePerformanceTest#measureGetLine()
|
+14.9% [±1.1]
|
+0.0% [±0.1]
| n/a | n/a |
GapTextStorePerformanceTest#measureInsertAtEnd()
|
+0.0% [±1.7]
|
+0.0% [±1.9]
| n/a | n/a |
GapTextStorePerformanceTest#measureInsertAtStart()
|
+9.1% [±2.6]
|
+0.0% [±3.4]
| n/a | n/a |
GapTextStorePerformanceTest#measureRandomReplace()
|
- 1.0% [±0.3]
|
- 1.0% [±0.3]
| n/a | n/a |
GapTextStorePerformanceTest#measureRepeatedReplace()
|
+9.5% [±0.7]
|
- 5.3% [±0.8]
| n/a | n/a |
GapTextStorePerformanceTest#measureSet()
|
+2.1% [±0.4]
|
+24.5% [±0.4]
| n/a | n/a |
GapTextStorePerformanceTest#measureTypingReplaceInLargeFile()
|
- 4.2% [±1.6]
|
+0.0% [±1.1]
| n/a | n/a |
GapTextStorePerformanceTest#measureTypingReplaceInSmallFile()
|
+0.0% [±1.5]
|
- 4.2% [±1.2]
| n/a | n/a |
JavaExpandSelectionTest#test()
|
- 0.2% [±0.5]
|
+5.7% [±0.2]
| n/a | n/a |
JavaFormatterProjectTest#test()
|
+12.6% [±11.8]
|
- 0.3% [±5.1]
| n/a | n/a |
JavaFormatterTest#test()
|
+0.0% [±0.7]
|
- 2.5% [±7.2]
| n/a | n/a |
JavaIndenterTest#testJavaIndenter2()
|
+27.3% [±36.4]
|
+13.0% [±15.4]
| n/a | n/a |
*JavaMoveLineTest#test() (vs. R-3.6-201006080911_201108261800)
|
+1.9% [±7.3]
|
- 0.5% [±0.3]
| n/a | n/a |
*JavaReplaceAllTest#test() (vs. R-3.6-201006080911_201108261800)
|
+6.7% [±1.4]
|
+9.4% [±7.0]
| n/a | n/a |
*JavaReplaceAllWithQuickDiffTest#test() (vs. R-3.6-201006080911_201108261800)
|
+0.0% [±2.6]
|
+3.3% [±1.9]
| n/a | n/a |
LineTrackerPerformanceTest#testLineByIndex()
|
- 0.3% [±0.6]
|
+0.2% [±0.4]
| n/a | n/a |
LineTrackerPerformanceTest#testLineByIndex2()
|
- 0.4% [±0.1]
|
+0.0% [±0.1]
| n/a | n/a |
LineTrackerPerformanceTest#testLineByOffset()
|
Performance criteria not met when compared to 'R-3.6-201006080911_201109021800': Elapsed Process= 0.34s is not within [0%, 110'%] of 0.3s
- 10.5% [±3.6]
|
+1.6% [±0.7]
| n/a | n/a |
LineTrackerPerformanceTest#testLineByOffset2()
|
+0.4% [±0.0]
|
- 0.4% [±0.0]
| n/a | n/a |
LineTrackerPerformanceTest#testRandomReplace()
|
+0.8% [±0.2]
|
- 2.1% [±0.5]
| n/a | n/a |
LineTrackerPerformanceTest#testReplace()
|
+0.7% [±0.4]
|
+0.0% [±0.4]
| n/a | n/a |
LineTrackerPerformanceTest#testSet()
|
+2.4% [±0.2]
|
- 0.8% [±0.2]
| n/a | n/a |
*NonInitialTypingTest#testTypeAMethod() (vs. R-3.6-201006080911_201108261800)
|
+11.5% [±27.0]
|
Performance criteria not met when compared to 'R-3.6-201006080911_201109021800': Elapsed Process= 36ms is not within [0%, 110'%] of 23ms
- 56.5% [±61.1]
| n/a | n/a |
OpenJavaContentAssistTest#test1()-cold
|
Performance criteria not met when compared to 'R-3.6-201006080911_201109021800': Elapsed Process= 0.24s is not within [0%, 110'%] of 0.22s
- 14.0% [±5.9]
|
+14.6% [±5.1]
| n/a | n/a |
OpenJavaContentAssistTest#test1()-warm
|
Performance criteria not met when compared to 'R-3.6-201006080911_201109021800': Elapsed Process= 0.13s is not within [0%, 110'%] of 0.12s
- 12.7% [±8.7]
|
+0.6% [±3.5]
| n/a | n/a |
OpenJavaEditorStartupTest#testJavaEditorStartup()
|
+2.0% [n/a]
|
- 6.3% [n/a]
| n/a | n/a |
OpenJavaEditorTest#testOpenEditor3()
|
+1.3% [±2.3]
|
+5.7% [±2.5]
| n/a | n/a |
OpenJavaEditorTest#testOpenEditor4()
|
+0.0% [±2.6]
|
+2.0% [±1.8]
| n/a | n/a |
OpenJavaEditorTest#testOpenEditor5()
|
- 4.4% [±2.6]
|
+3.8% [±2.5]
| n/a | n/a |
OpenJavaEditorTest#testOpenEditor6()
|
- 4.5% [±5.2]
|
+1.5% [±3.7]
| n/a | n/a |
OpenJavaEditorTest#testOpenJavaEditor1()
|
- 0.2% [±5.9]
|
+1.3% [±3.7]
| n/a | n/a |
OpenJavaEditorTest#testOpenJavaEditor2()
|
+3.7% [±4.8]
|
- 4.6% [±3.0]
| n/a | n/a |
*OpenPreferencePageTest#testOpenPreferencePage()-cold (vs. R-3.6-201006080911_201108261800)
|
- 2.7% [n/a]
|
- 2.8% [n/a]
| n/a | n/a |
OpenQuickOutlineTest#testOpenQuickOutline1()-cold
|
- 2.4% [±2.0]
|
+8.7% [±1.8]
| n/a | n/a |
OpenQuickOutlineTest#testOpenQuickOutline1()-warm
|
- 2.1% [±1.5]
|
- 0.8% [±1.1]
| n/a | n/a |
OpenTextEditorStartupTest#testTextEditorStartup()
|
- 7.4% [n/a]
|
- 6.2% [n/a]
| n/a | n/a |
OpenTextEditorTest#testOpenEditor3()
|
+4.3% [±0.3]
|
+2.6% [±0.2]
| n/a | n/a |
OpenTextEditorTest#testOpenTextEditor1()
|
- 1.5% [±2.8]
|
- 1.6% [±0.5]
| n/a | n/a |
OpenTextEditorTest#testOpenTextEditor2()
|
+1.5% [±3.9]
|
+1.0% [±2.7]
| n/a | n/a |
RevertJavaEditorTest#test2()
|
- 3.5% [±2.5]
|
- 0.7% [±3.3]
| n/a | n/a |
RevertJavaEditorTest#testRevertJavaEditor()
|
- 2.1% [±4.7]
|
+6.8% [±5.1]
| n/a | n/a |
RevertTextEditorTest#testRevertTextEditor()
|
+0.0% [±8.3]
|
+38.1% [±22.8]
| n/a | n/a |
SaveJavaEditorTest#test1()
|
Performance criteria not met when compared to 'R-3.6-201006080911_201109021800': Elapsed Process= 1.1s is not within [0%, 110'%] of 0.3s
- 268.8% [±274.6]
|
- 9.8% [±11.8]
| n/a | n/a |
SaveTextEditorTest#test1()
|
Performance criteria not met when compared to 'R-3.6-201006080911_201109021800': Elapsed Process= 0.53s is not within [0%, 110'%] of 0.45s
- 18.1% [±62.6]
|
Performance criteria not met when compared to 'R-3.6-201006080911_201109021800': Elapsed Process= 0.39s is not within [0%, 110'%] of 0.3s
- 30.1% [±25.3]
| n/a | n/a |
*ScrollAnnotatedJavaEditorTest#testScrollJavaEditorLineWise1() (vs. R-3.6-201006080911_201108261800)
|
+6.1% [±0.2]
|
- 9.1% [±0.5]
| n/a | n/a |
ScrollJavaEditorTest#testScrollJavaEditorLineWise2()
|
+6.7% [±0.4]
|
- 8.6% [±0.6]
| n/a | n/a |
ScrollTextEditorTest#testScrollTextEditorLineWise2()
|
+6.7% [±0.3]
|
- 5.5% [±0.3]
| n/a | n/a |
ScrollTextEditorTest#testScrollTextEditorLineWiseMoveCaret2()
|
+11.1% [±0.1]
| n/a | n/a | n/a |
ScrollTextEditorTest#testScrollTextEditorLineWiseSelect2()
|
+19.4% [±0.2]
|
+15.3% [±0.5]
| n/a | n/a |
*ScrollVerticalRuler1000Test#testScrollTextEditorPageWise() (vs. R-3.6-201006080911_201108261800)
|
+99.9% [±0.2]
| n/a | n/a | n/a |
*ScrollVerticalRuler100Test#testScrollTextEditorLineWiseMoveCaret2() (vs. R-3.6-201006080911_201108261800)
|
+99.9% [±0.0]
| n/a | n/a | n/a |
*ScrollVerticalRuler100Test#testScrollTextEditorPageWise() (vs. R-3.6-201006080911_201108261800)
|
+100.0% [±5.9]
|
+100.0% [±3.1]
| n/a | n/a |
SpellCheckingTest#test()Java Editor: Spell checking
|
+14.4% [±0.2]
|
+14.7% [±0.1]
| n/a | n/a |
SynchronizedLineDifferInitializationTest#testInitializationWithFewChanges()
|
+0.5% [±0.1]
|
Performance criteria not met when compared to 'R-3.6-201006080911_201109021800': Elapsed Process= 0.6s is not within [0%, 110'%] of 0.52s
- 14.1% [±0.1]
| n/a | n/a |
SynchronizedLineDifferInitializationTest#testInitializationWithManyChanges()
|
+0.7% [±0.1]
|
- 4.9% [±4.0]
| n/a | n/a |
SynchronizedLineDifferInitializationTest#testInitializationWithManyChangesButEqualSize()
|
+0.3% [±0.2]
|
+1.3% [±4.2]
| n/a | n/a |
SynchronizedLineDifferInitializationTest#testInitializationWithNoChanges()
|
+0.3% [±0.2]
|
Performance criteria not met when compared to 'R-3.6-201006080911_201109021800': Elapsed Process= 0.6s is not within [0%, 110'%] of 0.52s
- 14.5% [±0.3]
| n/a | n/a |
*TextMoveLineTest#test() (vs. R-3.6-201006080911_201108261800)
|
+0.5% [±0.4]
|
+0.2% [±0.4]
| n/a | n/a |
*TextNonInitialTypingTest#testTypeAMethod() (vs. R-3.6-201006080911_201108261800)
|
+0.0% [±3.4]
|
+66.7% [±58.0]
| n/a | n/a |
ToggleCommentTest#testToggleComment2()-comment
|
- 2.0% [±2.4]
|
- 1.8% [±3.7]
| n/a | n/a |
ToggleCommentTest#testToggleComment2()-uncomment
|
- 0.7% [±2.3]
|
+1.8% [±2.4]
| n/a | n/a |
UndoJavaEditorTest#testUndoJavaEditor2()
|
+8.7% [±9.6]
|
+0.5% [±15.1]
| n/a | n/a |
UndoTextEditorTest#testUndoTextEditor2()
|
- 4.2% [±11.3]
|
+5.6% [±9.2]
| n/a | n/a |
WhitespaceCharacterPainterTest#testScrollTextEditorLineWise2()
|
+5.7% [±0.2]
|
Performance criteria not met when compared to 'R-3.6-201006080911_201109021800': Elapsed Process= 23s is not within [0%, 110'%] of 19.6s
- 17.5% [±0.1]
| n/a | n/a |
WhitespaceCharacterPainterTest#testScrollTextEditorLineWiseMoveCaret2()
|
+9.5% [±0.3]
|
+6.8% [±0.3]
| n/a | n/a |
WhitespaceCharacterPainterTest#testScrollTextEditorLineWiseSelect2()
|
+22.6% [±0.2]
|
+19.1% [±0.2]
| n/a | n/a |
WordRulePerformanceTest#measureIgnoreCase()
|
+3.3% [±0.7]
|
- 1.7% [±0.4]
| n/a | n/a |