Performance of org.eclipse.jdt.text: M20080911-1700 relative to 3.3 (200806171530)

RHEL 4.0 Sun 1.4.2_10 (3 GHz 2.5 GB)

Win XP Sun 1.4.2_10 (3 GHz 2 GB)

RHEL 3.0 Sun 1.4.2_10 (3 GHz 2 GB)

Win XP Sun 1.4.2_10 (2 GHz 512 MB)


Scenario Status

The following table gives a complete but compact view of performance results for the component.
Each line of the table shows the results for one scenario on all machines.

The name of the scenario is in bold when its results are also displayed in the fingerprints
and starts with an '*' when the scenario has no results in the last baseline run.

Here are information displayed for each test (ie. in each cell): Hints:

All 113 scenarios
RHEL 3.0 Sun 1.4.2_10 (2 GHz 512 MB)
RHEL 3.0 Sun 1.4.2_10 (3 GHz 2 GB)
RHEL 4.0 Sun 1.4.2_10 (3 GHz 2.5 GB)
Win XP Sun 1.4.2_10 (2 GHz 512 MB)
Win XP Sun 1.4.2_10 (3 GHz 2 GB)
ActivateTextEditorTest#testActivateEditor() n/a Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 1.8s is not within [0%, 110'%] of 1.3s - 40.7% [±0.7] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 1.6s is not within [0%, 110'%] of 1.1s - 44.4% [±0.4] Performance criteria not met when compared to 'N20070802-0010': Elapsed Process= 1.0s is not within [0%, 110'%] of 681ms - 55.1% [±1.3] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 1.0s is not within [0%, 110'%] of 637ms - 70.6% [±1.3]
CodeCompletionPerformanceTest#testApplicationNoParamters() n/a - 3.8% [±1.4] - 2.2% [±1.3] +18.3% [±10.2] - 5.5% [±2.6]
CodeCompletionPerformanceTest#testApplicationWithParamterGuesses() n/a +2.3% [±0.9] +1.1% [±0.7] +1.6% [±1.0] +2.2% [±2.7]
CodeCompletionPerformanceTest#testApplicationWithParamterGuesses2() n/a +1.1% [±1.4] - 2.1% [±1.5] - 7.1% [±1.7] - 2.6% [±1.6]
CodeCompletionPerformanceTest#testApplicationWithParamterNames() n/a Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 1.8s is not within [0%, 110'%] of 1.1s - 65.1% [±2.3] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 1.5s is not within [0%, 110'%] of 1.0s - 57.9% [±2.0] Performance criteria not met when compared to 'N20070802-0010': Elapsed Process= 2.0s is not within [0%, 110'%] of 1.6s - 22.4% [±1.8] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 1.5s is not within [0%, 110'%] of 1.0s - 42.4% [±2.2]
CodeCompletionPerformanceTest#testCompletionNoParamters() n/a +1.5% [±1.0] +2.5% [±2.6] +0.2% [±1.1] +0.9% [±3.3]
CodeCompletionPerformanceTest#testCompletionWithParamterGuesses() n/a +1.8% [±1.3] +1.4% [±0.5] +0.6% [±0.8] +2.2% [±1.2]
CodeCompletionPerformanceTest#testCompletionWithParamterGuesses2() n/a - 1.4% [±0.8] - 1.8% [±0.2] - 3.8% [±0.7] - 0.9% [±2.2]
CodeCompletionPerformanceTest#testCompletionWithParamterNames() n/a +3.5% [±0.8] +2.5% [±0.4] +1.8% [±0.8] +3.5% [±2.0]
ContentTypeTest#testJavaDirty() n/a - 0.9% [±2.9] +0.0% [±1.9] +0.0% [±6.3] +9.4% [±6.5]
ContentTypeTest#testPluginPropertiesDirty() n/a +0.6% [±1.0] +0.7% [±0.9] - 2.3% [±4.1] - 2.7% [±3.7]
ContentTypeTest#testPluginXMLDirty() n/a Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 2.2s is not within [0%, 110'%] of 1.7s - 28.4% [±0.9] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 1.6s is not within [0%, 110'%] of 1.3s - 27.3% [±0.3] Performance criteria not met when compared to 'N20070802-0010': Elapsed Process= 3.3s is not within [0%, 110'%] of 2.9s - 11.2% [±0.3] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 2.2s is not within [0%, 110'%] of 1.7s - 25.7% [±1.9]
ContentTypeTest#testPropertiesDirty() n/a - 4.4% [±3.1] +1.9% [±1.7] +11.0% [±2.8] - 2.8% [±5.5]
ContentTypeTest#testTextDirty() n/a - 1.0% [±1.6] +2.0% [±1.7] +0.0% [±5.5] +3.1% [±3.2]
ConvertLineDelimitersProjectTest#test() n/a +8.4% [±40.2] +10.7% [±15.1] +73.2% [±0.6] - 4.8% [±6.2]
DocumentLineDifferInitializationTest#testInitializationWithFewChanges() n/a +1.6% [±1.6] - 0.2% [±0.1] - 3.4% [±1.8] n/a
DocumentLineDifferInitializationTest#testInitializationWithManyChanges() n/a +0.0% [±0.0] +0.0% [±0.1] +0.5% [±0.6] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 5.4s is not within [0%, 110'%] of 812ms - 565.8% [±565.7]
DocumentLineDifferInitializationTest#testInitializationWithManyChangesButEqualSize() n/a +0.0% [±0.0] - 0.1% [±0.1] +2.8% [±2.3] n/a
DocumentLineDifferInitializationTest#testInitializationWithNoChanges() n/a - 0.2% [±0.0] +0.0% [±0.1] +0.0% [±1.7] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 2.1s is not within [0%, 110'%] of 546ms - 291.6% [±288.0]
DocumentLineDifferModificationTest#testEditingChanged() n/a +6.9% [±5.3] +5.3% [±6.3] +3.1% [±5.1] +32.0% [±12.0]
DocumentLineDifferModificationTest#testEditingUnchanged() n/a Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 6ms is not within [0%, 110'%] of 4ms - 50.0% [±25.4] +0.0% [±11.8] +100.0% [±431.9] +13.3% [±10.4]
DocumentPerformanceTest#measureDeleteInsert() n/a +0.0% [±2.2] +0.0% [±1.6] +0.0% [±4.1] +2.9% [±5.6]
DocumentPerformanceTest#measureGetChar() n/a +0.0% [±2.9] +0.0% [±0.2] +2.5% [±1.2] +0.7% [±1.8]
DocumentPerformanceTest#measureGetLength() n/a +2.1% [±2.4] +0.0% [±0.4] +1.7% [±1.0] - 1.1% [±2.7]
DocumentPerformanceTest#measureGetLine() n/a +7.9% [±1.3] - 2.0% [±1.3] - 1.1% [±3.0] - 2.9% [±3.7]
DocumentPerformanceTest#measureGetNumberOfLines() n/a Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 151ms is not within [0%, 110'%] of 127ms - 18.9% [±0.9] +44.2% [±0.1] +8.3% [±1.4] +14.1% [±2.3]
DocumentPerformanceTest#measureInsertAtEnd() n/a +1.6% [±1.5] - 1.9% [±1.4] +1.5% [±1.9] +5.0% [±3.9]
DocumentPerformanceTest#measureInsertAtStart() n/a - 0.7% [±1.2] +0.0% [±0.8] - 0.3% [±0.9] - 2.4% [±1.6]
DocumentPerformanceTest#measureLineByIndex() n/a Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 156ms is not within [0%, 110'%] of 136ms - 14.7% [±1.3] +0.0% [±0.2] +25.5% [±1.2] +11.8% [±1.6]
DocumentPerformanceTest#measureLineByOffset() n/a - 1.0% [±0.7] +0.0% [±0.4] +1.7% [±0.9] - 2.0% [±1.2]
DocumentPerformanceTest#measureLineDelimiterByIndex() n/a +0.8% [±1.5] - 1.3% [±0.5] +25.8% [±1.3] +16.0% [±2.2]
DocumentPerformanceTest#measureLineInfoByIndex() n/a Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 278ms is not within [0%, 110'%] of 238ms - 16.8% [±0.7] +3.2% [±0.3] +2.0% [±1.1] +10.7% [±1.4]
DocumentPerformanceTest#measureLineInfoByOffset() n/a - 2.4% [±0.6] - 2.0% [±0.4] +0.0% [±0.8] +0.8% [±1.0]
DocumentPerformanceTest#measureLineLengthByIndex() n/a - 0.8% [±0.9] +0.0% [±0.2] +19.8% [±1.4] +16.5% [±1.9]
DocumentPerformanceTest#measureRandomReplace() n/a +0.8% [±0.9] - 0.8% [±0.3] +3.5% [±1.9] +3.8% [±3.1]
DocumentPerformanceTest#measureRepeatedReplace() n/a - 0.6% [±0.9] +2.1% [±0.6] +8.7% [±1.2] - 1.1% [±2.0]
DocumentPerformanceTest#measureSet() n/a - 3.6% [±1.3] +0.0% [±1.1] +6.6% [±2.7] +7.0% [±4.3]
DocumentPerformanceTest#measureTypingReplaceInLargeFile() n/a - 4.6% [±1.1] - 0.7% [±0.2] +3.9% [±2.2] - 0.9% [±2.2]
DocumentPerformanceTest#measureTypingReplaceInSmallFile() n/a - 1.7% [±1.3] +0.0% [±0.2] +7.0% [±2.8] +0.9% [±2.3]
GapTextStorePerformanceTest#measureDeleteInsert() n/a +0.0% [±2.1] - 5.0% [±2.2] +5.0% [±3.5] - 4.5% [±11.6]
GapTextStorePerformanceTest#measureGetAll() n/a - 2.5% [±0.7] - 0.7% [±0.1] - 0.3% [±0.5] - 2.5% [±1.9]
GapTextStorePerformanceTest#measureGetChar() n/a - 0.2% [±0.4] +0.5% [±0.3] - 0.1% [±0.6] +0.0% [±0.7]
GapTextStorePerformanceTest#measureGetLine() n/a +0.7% [±0.6] +4.0% [±0.1] - 1.3% [±1.1] - 0.7% [±1.5]
GapTextStorePerformanceTest#measureInsertAtEnd() n/a +0.0% [±0.9] - 2.7% [±1.3] +0.9% [±2.1] +7.0% [±5.9]
GapTextStorePerformanceTest#measureInsertAtStart() n/a +4.0% [±2.8] +0.0% [±2.4] +1.6% [±2.9] +0.0% [±11.6]
GapTextStorePerformanceTest#measureRandomReplace() n/a +1.9% [±3.4] +0.0% [±0.1] +0.6% [±1.7] - 4.9% [±5.5]
GapTextStorePerformanceTest#measureRepeatedReplace() n/a +2.9% [±2.4] - 7.7% [±1.4] - 9.4% [±4.4] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 37ms is not within [0%, 110'%] of 32ms - 15.6% [±6.4]
GapTextStorePerformanceTest#measureSet() n/a - 3.4% [±1.2] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 66ms is not within [0%, 110'%] of 59ms - 11.9% [±0.5] - 1.0% [±0.4] - 2.9% [±1.6]
GapTextStorePerformanceTest#measureTypingReplaceInLargeFile() n/a +3.3% [±2.7] +0.0% [±0.9] - 9.1% [±7.4] +5.3% [±11.1]
GapTextStorePerformanceTest#measureTypingReplaceInSmallFile() n/a Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 35ms is not within [0%, 110'%] of 30ms - 16.7% [±8.6] +0.0% [±0.7] +0.0% [±6.9] +0.0% [±11.6]
JavaExpandSelectionTest#test() n/a Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 533ms is not within [0%, 110'%] of 465ms - 14.6% [±2.8] - 8.5% [±0.5] - 3.2% [±1.4] - 6.6% [±4.6]
JavaFormatterProjectTest#test() n/a +24.6% [±9.7] +16.4% [±6.8] +12.7% [±5.9] +14.1% [±1.0]
JavaFormatterTest#test() n/a +27.6% [±2.8] +28.8% [±0.3] +28.2% [±3.7] +26.3% [±3.8]
JavaIndenterTest#testJavaIndenter2() n/a +0.0% [±4.7] +0.0% [±0.0] +0.0% [±0.0] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 16ms is not within [0%, 110'%] of 8ms - 100.0% [±100.0]
JavaMoveLineTest#test() n/an/an/a - 7.6% [±1.9] +3.3% [±1.4]
*JavaReplaceAllTest#test() (vs. N20070802-0010) n/a Performance criteria not met when compared to 'N20070802-0010': Elapsed Process= 2.0s is not within [0%, 110'%] of 1.7s - 17.5% [±3.2] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 1.7s is not within [0%, 110'%] of 1.2s - 35.6% [±0.6] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 2.4s is not within [0%, 110'%] of 1.7s - 39.3% [±1.7] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 2.1s is not within [0%, 110'%] of 1.6s - 29.0% [±3.6]
JavaReplaceAllWithQuickDiffTest#test() n/a Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 2.1s is not within [0%, 110'%] of 1.7s - 24.2% [±2.9] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 1.6s is not within [0%, 110'%] of 1.3s - 23.1% [±0.6] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 2.4s is not within [0%, 110'%] of 1.8s - 34.0% [±1.4] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 2.0s is not within [0%, 110'%] of 1.6s - 25.6% [±4.5]
LineTrackerPerformanceTest#testLineByIndex() n/a +5.4% [±2.0] +0.2% [±0.2] +13.1% [±0.4] +3.1% [±1.2]
LineTrackerPerformanceTest#testLineByIndex2() n/a - 0.7% [±0.4] - 0.4% [±0.1] +2.0% [±0.5] - 1.2% [±1.1]
LineTrackerPerformanceTest#testLineByOffset() n/a Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 474ms is not within [0%, 110'%] of 404ms - 17.3% [±0.6] +0.0% [±0.2] +0.8% [±0.4] +25.0% [±1.1]
LineTrackerPerformanceTest#testLineByOffset2() n/a - 0.7% [±0.1] - 0.4% [±0.1] +1.2% [±0.2] +4.0% [±0.3]
LineTrackerPerformanceTest#testRandomReplace() n/a +0.9% [±0.9] - 1.4% [±0.1] - 0.8% [±1.3] +4.5% [±2.7]
LineTrackerPerformanceTest#testReplace() n/a - 4.0% [±0.9] +1.3% [±0.4] - 1.6% [±1.6] - 4.0% [±1.6]
LineTrackerPerformanceTest#testSet() n/a - 2.2% [±1.0] +0.0% [±0.2] +1.6% [±1.8] +1.6% [±2.1]
NonInitialTypingTest#testTypeAMethod() n/a +7.6% [±6.3] +56.5% [±52.6] - 4.7% [±3.9] +6.2% [±3.6]
OpenJavaContentAssistTest#test1()-cold n/a Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 486ms is not within [0%, 110'%] of 279ms - 74.2% [±5.4] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 273ms is not within [0%, 110'%] of 153ms - 78.4% [±7.7] Performance criteria not met when compared to 'N20070802-0010': Elapsed Process= 296ms is not within [0%, 110'%] of 221ms - 33.9% [±11.5] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 198ms is not within [0%, 110'%] of 136ms - 45.6% [±5.8]
OpenJavaContentAssistTest#test1()-warm n/a Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 386ms is not within [0%, 110'%] of 267ms - 44.6% [±4.3] - 4.7% [±6.8] Performance criteria not met when compared to 'N20070802-0010': Elapsed Process= 234ms is not within [0%, 110'%] of 191ms - 22.5% [±7.7] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 178ms is not within [0%, 110'%] of 129ms - 38.0% [±6.5]
OpenJavaEditorStartupTest#testJavaEditorStartup() n/a - 5.5% [n/a] - 6.6% [n/a] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 19.5s is not within [0%, 110'%] of 16.6s - 17.6% [n/a] - 7.2% [n/a]
OpenJavaEditorTest#testOpenEditor3() n/a Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 965ms is not within [0%, 110'%] of 832ms - 16.0% [±2.5] - 8.4% [±2.4] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 1.2s is not within [0%, 110'%] of 887ms - 41.9% [±4.2] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 851ms is not within [0%, 110'%] of 692ms - 23.0% [±2.4]
OpenJavaEditorTest#testOpenEditor4() n/a Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 845ms is not within [0%, 110'%] of 710ms - 19.0% [±2.7] - 3.2% [±3.4] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 1.0s is not within [0%, 110'%] of 776ms - 33.9% [±4.9] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 740ms is not within [0%, 110'%] of 600ms - 23.3% [±3.2]
OpenJavaEditorTest#testOpenEditor5() n/a - 6.8% [±2.8] - 4.1% [±4.2] - 8.7% [±4.7] - 2.4% [±4.3]
OpenJavaEditorTest#testOpenEditor6() n/a - 2.9% [±4.3] +0.0% [±3.4] - 6.9% [±5.7] - 1.5% [±4.6]
OpenJavaEditorTest#testOpenJavaEditor1() n/a Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 514ms is not within [0%, 110'%] of 444ms - 15.8% [±7.2] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 535ms is not within [0%, 110'%] of 449ms - 19.2% [±8.4] +2.9% [±17.7] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 544ms is not within [0%, 110'%] of 425ms - 28.0% [±8.3]
OpenJavaEditorTest#testOpenJavaEditor2() n/a Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 480ms is not within [0%, 110'%] of 419ms - 14.6% [±6.2] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 507ms is not within [0%, 110'%] of 439ms - 15.5% [±7.6] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 646ms is not within [0%, 110'%] of 413ms - 56.4% [±10.3] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 551ms is not within [0%, 110'%] of 432ms - 27.5% [±8.2]
OpenPreferencePageTest#testOpenPreferencePage()-cold n/a Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 272ms is not within [0%, 110'%] of 1ms - 27,100.0% [n/a] - 6.3% [n/a] - 5.4% [n/a] +8.6% [n/a]
OpenQuickOutlineTest#testOpenQuickOutline1()-cold n/a - 5.5% [±2.1] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 270ms is not within [0%, 110'%] of 236ms - 14.4% [±1.7] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 317ms is not within [0%, 110'%] of 271ms - 17.0% [±1.8] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 258ms is not within [0%, 110'%] of 203ms - 27.1% [±2.7]
OpenQuickOutlineTest#testOpenQuickOutline1()-warm n/a - 5.9% [±1.0] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 271ms is not within [0%, 110'%] of 231ms - 17.3% [±0.9] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 322ms is not within [0%, 110'%] of 283ms - 13.8% [±4.3] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 263ms is not within [0%, 110'%] of 205ms - 28.3% [±3.7]
OpenTextEditorStartupTest#testTextEditorStartup() n/a Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 11.3s is not within [0%, 110'%] of 10.1s - 11.6% [n/a] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 9.6s is not within [0%, 110'%] of 8.7s - 11.0% [n/a] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 14.2s is not within [0%, 110'%] of 12.7s - 12.1% [n/a] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 9.5s is not within [0%, 110'%] of 8.5s - 12.1% [n/a]
OpenTextEditorTest#testOpenEditor3() n/a Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 153ms is not within [0%, 110'%] of 117ms - 30.8% [±2.3] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 159ms is not within [0%, 110'%] of 131ms - 21.4% [±1.7] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 155ms is not within [0%, 110'%] of 126ms - 23.0% [±0.5] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 116ms is not within [0%, 110'%] of 95ms - 22.1% [±0.8]
OpenTextEditorTest#testOpenTextEditor1() n/a Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 143ms is not within [0%, 110'%] of 115ms - 24.3% [±2.6] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 147ms is not within [0%, 110'%] of 124ms - 18.5% [±1.3] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 174ms is not within [0%, 110'%] of 152ms - 14.5% [±2.0] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 110ms is not within [0%, 110'%] of 90ms - 22.2% [±1.8]
OpenTextEditorTest#testOpenTextEditor2() n/a Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 141ms is not within [0%, 110'%] of 106ms - 33.0% [±5.2] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 147ms is not within [0%, 110'%] of 116ms - 26.7% [±3.0] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 173ms is not within [0%, 110'%] of 140ms - 23.6% [±5.8] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 111ms is not within [0%, 110'%] of 89ms - 24.7% [±5.3]
RevertJavaEditorTest#test2() n/a +8.8% [±4.1] - 6.5% [±6.5] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 218ms is not within [0%, 110'%] of 184ms - 18.5% [±4.2] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 174ms is not within [0%, 110'%] of 131ms - 32.8% [±7.5]
RevertJavaEditorTest#testRevertJavaEditor() n/a - 4.7% [±5.3] - 3.4% [±6.3] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 306ms is not within [0%, 110'%] of 262ms - 16.8% [±10.3] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 247ms is not within [0%, 110'%] of 178ms - 38.8% [±8.8]
RevertTextEditorTest#testRevertTextEditor() n/a Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 41ms is not within [0%, 110'%] of 35ms - 17.1% [±20.1] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 39ms is not within [0%, 110'%] of 29ms - 34.5% [±12.6] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 78ms is not within [0%, 110'%] of 40ms - 95.0% [±42.2] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 53ms is not within [0%, 110'%] of 31ms - 71.0% [±20.2]
SaveJavaEditorTest#test1() n/a +8.8% [±31.7] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 2.3s is not within [0%, 110'%] of 1.6s - 43.0% [±103.0] +58.1% [±7.2] +61.2% [±26.1]
SaveTextEditorTest#test1() n/a - 1.8% [±48.6] +50.3% [±36.2] Performance criteria not met when compared to 'N20070802-0010': Elapsed Process= 6.5s is not within [0%, 110'%] of 5.0s - 29.3% [±120.6] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 1.1s is not within [0%, 110'%] of 696ms - 58.9% [±52.6]
ScrollAnnotatedJavaEditorTest#testScrollJavaEditorLineWise1() n/a +0.0% [±0.1] - 3.9% [±0.0] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 15.7s is not within [0%, 110'%] of 12.6s - 24.7% [±0.1] - 1.7% [±0.3]
ScrollAnnotatedJavaEditorTest#testScrollJavaEditorLineWiseMoveCaret1() n/a +1.0% [±0.1] - 2.5% [±0.1] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 23.5s is not within [0%, 110'%] of 18.2s - 28.9% [±0.3] - 2.5% [±0.1]
ScrollAnnotatedJavaEditorTest#testScrollJavaEditorLineWiseSelect1() n/a +0.0% [±0.1] - 3.8% [±0.0] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 35.2s is not within [0%, 110'%] of 31.1s - 13.1% [±0.1] +1.0% [±0.2]
ScrollAnnotatedJavaEditorTest#testScrollJavaEditorPageWise() n/a +1.7% [±0.4] +2.9% [±0.1] +1.0% [±0.1] +1.6% [±0.3]
ScrollJavaEditorTest#testScrollJavaEditorLineWise2() n/a - 4.6% [±0.1] - 2.8% [±0.0] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 14.3s is not within [0%, 110'%] of 11.4s - 25.5% [±0.1] +3.8% [±0.3]
ScrollJavaEditorTest#testScrollJavaEditorLineWiseMoveCaret2() n/a - 7.3% [±0.1] - 4.4% [±0.1] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 21.9s is not within [0%, 110'%] of 17.1s - 28.2% [±0.2] +0.5% [±0.2]
ScrollJavaEditorTest#testScrollJavaEditorLineWiseSelect2() n/a - 5.1% [±0.0] - 7.3% [±0.1] - 9.9% [±0.1] +4.1% [±0.3]
ScrollJavaEditorTest#testScrollJavaEditorPageWise() n/a +0.9% [±0.4] +0.7% [±0.3] +6.8% [±2.5] +3.1% [±0.2]
ScrollTextEditorTest#testScrollTextEditorLineWise2() n/a - 6.3% [±0.1] - 2.4% [±0.0] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 10.8s is not within [0%, 110'%] of 9.1s - 18.3% [±0.3] +4.9% [±0.4]
ScrollTextEditorTest#testScrollTextEditorLineWiseMoveCaret2() n/a - 9.8% [±0.1] - 3.6% [±0.1] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 18.8s is not within [0%, 110'%] of 16.7s - 12.1% [±0.1] +1.0% [±0.4]
ScrollTextEditorTest#testScrollTextEditorLineWiseSelect2() n/a Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 27.5s is not within [0%, 110'%] of 24.7s - 11.2% [±0.0] - 6.9% [±0.1] +4.3% [±0.3] +5.5% [±0.1]
ScrollTextEditorTest#testScrollTextEditorPageWise() n/a - 6.7% [±0.1] - 0.8% [±0.1] +0.5% [±0.7] +0.0% [±0.6]
*ScrollVerticalRuler1000Test#testScrollTextEditorLineWiseMoveCaret2() (vs. I20071127-0800) n/a Performance criteria not met when compared to 'I20071127-0800': Elapsed Process= 16.5s is not within [0%, 110'%] of 9.0s - 82.6% [±0.2] Performance criteria not met when compared to 'N20071202-0010': Elapsed Process= 31.5s is not within [0%, 110'%] of 8.6s - 263.5% [±0.1] Performance criteria not met when compared to 'I20071127-0800': Elapsed Process= 28.7s is not within [0%, 110'%] of 9.5s - 202.2% [±0.1] Performance criteria not met when compared to 'I20071127-0800': Elapsed Process= 42.2s is not within [0%, 110'%] of 4.5s - 838.3% [±0.7]
*ScrollVerticalRuler1000Test#testScrollTextEditorPageWise() (vs. I20071127-0800) n/a Performance criteria not met when compared to 'I20071127-0800': Elapsed Process= 1.3s is not within [0%, 110'%] of 1.0s - 34.3% [±1.9] Performance criteria not met when compared to 'N20071202-0010': Elapsed Process= 2.0s is not within [0%, 110'%] of 981ms - 108.0% [±0.5] Performance criteria not met when compared to 'I20071127-0800': Elapsed Process= 1.3s is not within [0%, 110'%] of 630ms - 118.3% [±1.7] Performance criteria not met when compared to 'I20071127-0800': Elapsed Process= 2.0s is not within [0%, 110'%] of 573ms - 249.7% [±2.0]
*ScrollVerticalRuler100Test#testScrollTextEditorLineWiseMoveCaret2() (vs. I20071127-0800) n/a Performance criteria not met when compared to 'I20071127-0800': Elapsed Process= 1.3s is not within [0%, 110'%] of 830ms - 58.3% [±1.9] Performance criteria not met when compared to 'N20071202-0010': Elapsed Process= 2.6s is not within [0%, 110'%] of 814ms - 227.4% [±0.7] Performance criteria not met when compared to 'I20071127-0800': Elapsed Process= 2.0s is not within [0%, 110'%] of 588ms - 254.3% [±1.3] Performance criteria not met when compared to 'I20071127-0800': Elapsed Process= 3.2s is not within [0%, 110'%] of 338ms - 873.7% [±4.4]
*ScrollVerticalRuler100Test#testScrollTextEditorPageWise() (vs. I20071127-0800) n/a Performance criteria not met when compared to 'I20071127-0800': Elapsed Process= 103ms is not within [0%, 110'%] of 77ms - 33.8% [±0.6] Performance criteria not met when compared to 'N20071202-0010': Elapsed Process= 145ms is not within [0%, 110'%] of 77ms - 88.3% [±15.2] Performance criteria not met when compared to 'I20071127-0800': Elapsed Process= 120ms is not within [0%, 110'%] of 36ms - 233.3% [±20.3] Performance criteria not met when compared to 'I20071127-0800': Elapsed Process= 177ms is not within [0%, 110'%] of 41ms - 331.7% [±17.8]
*ScrollVerticalRuler5000Test#testScrollTextEditorPageWise() (vs. I20071127-0800) n/a Performance criteria not met when compared to 'I20071127-0800': Elapsed Process= 7.9s is not within [0%, 110'%] of 4.6s - 69.6% [±0.3] Performance criteria not met when compared to 'N20071202-0010': Elapsed Process= 9.9s is not within [0%, 110'%] of 4.5s - 116.7% [±0.3] Performance criteria not met when compared to 'I20071127-0800': Elapsed Process= 8.5s is not within [0%, 110'%] of 3.1s - 170.9% [±0.4] Performance criteria not met when compared to 'I20071127-0800': Elapsed Process= 10.5s is not within [0%, 110'%] of 2.9s - 259.3% [±0.4]
SynchronizedLineDifferInitializationTest#testInitializationWithFewChanges() n/a +0.0% [±2.8] +0.0% [±0.2] - 1.1% [±1.8] +0.2% [±1.1]
SynchronizedLineDifferInitializationTest#testInitializationWithManyChanges() n/a - 0.5% [±0.4] - 0.6% [±0.3] +0.0% [±0.1] +0.0% [±0.1]
SynchronizedLineDifferInitializationTest#testInitializationWithManyChangesButEqualSize() n/a - 5.1% [±4.4] +0.4% [±0.3] +6.3% [±4.1] +0.6% [±0.6]
SynchronizedLineDifferInitializationTest#testInitializationWithNoChanges() n/a +0.2% [±0.2] +0.0% [±0.1] - 1.1% [±1.3] - 2.0% [±0.9]
TextMoveLineTest#test() n/a Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 855ms is not within [0%, 110'%] of 751ms - 13.8% [±60.8] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 803ms is not within [0%, 110'%] of 497ms - 61.6% [±88.2] - 0.8% [±0.8] - 1.4% [±1.7]
TextNonInitialTypingTest#testTypeAMethod() n/a Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 207ms is not within [0%, 110'%] of 5ms - 4,040.0% [±2,038.7] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 279ms is not within [0%, 110'%] of 168ms - 66.1% [±52.7] - 2.7% [±1.4] +0.0% [±2.8]
ToggleCommentTest#testToggleComment2()-comment n/a - 7.3% [±2.8] - 5.5% [±5.5] +40.5% [±48.0] - 9.9% [±4.9]
ToggleCommentTest#testToggleComment2()-uncomment n/a - 7.4% [±0.4] +7.7% [±3.7] +34.1% [±11.1] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 172ms is not within [0%, 110'%] of 156ms - 10.3% [±0.0]
UndoJavaEditorTest#testUndoJavaEditor2() n/a - 3.1% [±0.6] - 0.1% [±0.2] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 8.7s is not within [0%, 110'%] of 6.5s - 34.2% [±41.8] +1.3% [±5.3]
UndoTextEditorTest#testUndoTextEditor2() n/a +6.8% [±10.0] - 3.5% [±9.3] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 703ms is not within [0%, 110'%] of 289ms - 143.3% [±183.8] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 218ms is not within [0%, 110'%] of 195ms - 11.8% [±12.1]