Performance of org.eclipse.jdt.ui: M20150204-1700 relative to R-4.4-201406061215

SUSE Linux Enterprise Server 11 (x86_64)

Scenario Status

• an icon showing whether the test fails or passes and whether it's reliable or not.
  The legend for this icon is:
  • Green (): mark a successful result, which means this test has neither significant performance regression nor significant standard error
  • Red (): mark a failing result, which means this test shows a significant performance regression (more than 10%)
  • Gray (): mark a failing result (see above) with a comment explaining this degradation.
  • Yellow ( or ): mark a failing or successful result with a significant standard error (more than 3%)
  • Black (): mark an undefined result, which means that deviation on this test is not a number (NaN) or is infinite (happens when the reference value is equals to 0!)
  • "n/a": mark a test for with no performance results
• the value of the deviation from the baseline as a percentage (ie. formula is: (build_test_time - baseline_test_time) / baseline_test_time)
• the value of the standard error of this deviation as a percentage (ie. formula is: sqrt(build_test_stddev^2 / N + baseline_test_stddev^2 / N) / baseline_test_time)
  When test only has one measure, the standard error cannot be computed and is replaced with a '[n/a]'.

• fly over image of failing tests to see the complete error message
• to look at the complete and detailed test results, click on its image

All 65 scenarios	SUSE Linux Enterprise Server 11 (x86_64)
CleanUpPerfTest#testAllCleanUps()	- 1.3% [±2.2]
CleanUpPerfTest#testCodeFormatCleanUp()	+12.3% [±7.7]
CleanUpPerfTest#testCodeStyleCleanUp()	+0.0% [±2.7]
CleanUpPerfTest#testControlStatementsCleanUp()	- 1.4% [±4.1]
CleanUpPerfTest#testConvertLoopCleanUp()	- 0.8% [±2.3]
CleanUpPerfTest#testExpressionsCleanUp()	- 7.9% [±5.2]
CleanUpPerfTest#testJava50CleanUp()	- 1.7% [±5.7]
CleanUpPerfTest#testNullCleanUp()	+1.8% [±7.4]
CleanUpPerfTest#testOrganizeImports()	+1.4% [±6.6]
CleanUpPerfTest#testSortMembersCleanUp()	+2.4% [±6.8]
CleanUpPerfTest#testStringCleanUp()	- 4.8% [±5.8]
CleanUpPerfTest#testUnnecessaryCodeCleanUp()	+11.8% [±7.4]
CleanUpPerfTest#testUnusedCodeCleanUp()	- 1.1% [±7.4]
CleanUpPerfTest#testVariableDeclarationCleanUp()	+7.4% [±7.6]
OpenTypePerfTest#testColdException()	+35.2% [n/a]
OpenTypePerfTest#testWarmException()	+24.6% [n/a]
OpenTypePerfTest#testWarmException10()	Performance criteria not met when compared to 'R-4.4-201406061215': Elapsed Process= 0.37s is not within [0%, 110'%] of 0.26s - 42.7% [±16.3]
OpenTypePerfTest#testWarmOpenSWT()	- 3.1% [n/a]
OpenTypePerfTest#testWarmOpenSWTHistory10()	- 4.3% [±2.5]
OpenTypePerfTest#testWarmS10()	Performance criteria not met when compared to 'R-4.4-201406061215': Elapsed Process= 0.35s is not within [0%, 110'%] of 0.25s - 38.6% [±3.8]
OrganizeImportsPerfTest#testOrganizeImport()	+20.2% [±9.2]
PackageExplorerColdPerfTest#testOpen()	- 0.6% [n/a]
PackageExplorerEmptyPerfTest#testOpen()	- 3.8% [n/a]
PackageExplorerPerfTest#testExpand()	+7.9% [n/a]
PackageExplorerPerfTest#testOpen()	- 5.4% [n/a]
PackageExplorerPerfTest#testRefreshClassFolder()	+12.0% [n/a]
PackageExplorerPerfTest#testSelect()	+11.9% [n/a]
PackageExplorerWarmPerfTest#testOpen()	+1.8% [±3.7]
IntroduceIndirectionPerfAcceptanceTests#testIntroduceIndirection()	- 5.2% [n/a]
MoveCompilationUnitPerfTests1#test_1000_10()	+3.3% [n/a]
MoveCompilationUnitPerfTests1#test_100_10()	- 3.0% [n/a]
MoveCompilationUnitPerfTests1#test_10_10()	- 3.8% [±6.1]
MoveCompilationUnitPerfTests2#test_10_10()	+2.1% [±2.7]
MoveCompilationUnitPerfTests2#test_10_100()	+3.2% [n/a]
MoveCompilationUnitPerfTests2#test_10_1000()	Performance criteria not met when compared to 'R-4.4-201406061215': Elapsed Process= 4.1s is not within [0%, 110'%] of 3.6s - 13.1% [n/a]
MoveStaticMembersPerfTests1#test_1000_10()	- 3.7% [n/a]
MoveStaticMembersPerfTests1#test_100_10()	+1.0% [n/a]
MoveStaticMembersPerfTests1#test_10_10()	- 2.0% [±5.1]
MoveStaticMembersPerfTests2#test_10_10()	- 3.0% [±5.1]
MoveStaticMembersPerfTests2#test_10_100()	Performance criteria not met when compared to 'R-4.4-201406061215': Elapsed Process= 2.9s is not within [0%, 110'%] of 2.6s - 10.4% [n/a]
MoveStaticMembersPerfTests2#test_10_1000()	- 0.6% [n/a]
RenameMethodPerfTests1#test_1000_10()	- 3.2% [±3.8]
RenameMethodPerfTests1#test_100_10()	+2.7% [±7.7]
RenameMethodPerfTests1#test_10_10()	- 1.7% [±6.8]
RenameMethodPerfTests2#test_10_10()	- 1.5% [±5.3]
RenameMethodPerfTests2#test_10_100()	Performance criteria not met when compared to 'R-4.4-201406061215': Elapsed Process= 0.32s is not within [0%, 110'%] of 0.28s - 10.2% [±8.7]
RenameMethodPerfTests2#test_10_1000()	- 3.0% [±8.5]
RenameMethodWithOverloadPerfTests#test_1000_10()	- 3.0% [±10.1]
RenameMethodWithOverloadPerfTests#test_100_10()	- 6.4% [±7.1]
RenameMethodWithOverloadPerfTests#test_10_10()	Performance criteria not met when compared to 'R-4.4-201406061215': Elapsed Process= 0.46s is not within [0%, 110'%] of 0.4s - 12.6% [±9.9]
RenamePackagePerfTests1#test_1000_10()	- 2.1% [±3.9]
RenamePackagePerfTests1#test_100_10()	+1.1% [±5.3]
RenamePackagePerfTests1#test_10_10()	+6.9% [±4.6]
RenamePackagePerfTests2#test_10_10()	+5.7% [±5.0]
RenamePackagePerfTests2#test_10_100()	+2.4% [±5.9]
RenamePackagePerfTests2#test_10_1000()	- 1.0% [±6.5]
RenameTypePerfAcceptanceTests#testWarm()	+25.4% [n/a]
RenameTypePerfTests1#test_1000_10()	+1.9% [±5.8]
RenameTypePerfTests1#test_100_10()	- 7.8% [±7.0]
RenameTypePerfTests1#test_10_10()	+6.8% [±4.9]
RenameTypePerfTests2#test_10_10()	- 3.8% [±4.3]
RenameTypePerfTests2#test_10_100()	+2.3% [±4.0]
RenameTypePerfTests2#test_10_1000()	- 5.7% [±5.7]
ExtractInterfaceHeapAcceptanceTests#testExtractControl()	+3.8% [n/a]
ExtractInterfacePerfAcceptanceTests#testExtractControl()	- 0.8% [n/a]