Performance of org.eclipse.jdt.ui: I20200305-0155 relative to R-4.14-20191210061

SUSE Linux Enterprise Server 12 (x86_64)

Scenario Status

• an icon showing whether the test fails or passes and whether it's reliable or not.
  The legend for this icon is:
  • Green (): mark a successful result, which means this test has neither significant performance regression nor significant standard error
  • Red (): mark a failing result, which means this test shows a significant performance regression (more than 10%)
  • Gray (): mark a failing result (see above) with a comment explaining this degradation.
  • Yellow ( or ): mark a failing or successful result with a significant standard error (more than 3%)
  • Black (): mark an undefined result, which means that deviation on this test is not a number (NaN) or is infinite (happens when the reference value is equals to 0!)
  • "n/a": mark a test for with no performance results
• the value of the deviation from the baseline as a percentage (ie. formula is: (build_test_time - baseline_test_time) / baseline_test_time)
• the value of the standard error of this deviation as a percentage (ie. formula is: sqrt(build_test_stddev^2 / N + baseline_test_stddev^2 / N) / baseline_test_time)
  When test only has one measure, the standard error cannot be computed and is replaced with a '[n/a]'.

• fly over image of failing tests to see the complete error message
• to look at the complete and detailed test results, click on its image

All 65 scenarios	SUSE Linux Enterprise Server 12 (x86_64)
*CleanUpPerfTest#testAllCleanUps() (vs. I20191016-1800)	- 4.8% [±0.4]
*CleanUpPerfTest#testCodeFormatCleanUp() (vs. I20191016-1800)	+2.5% [±1.5]
*CleanUpPerfTest#testCodeStyleCleanUp() (vs. I20191016-1800)	- 0.1% [±0.3]
*CleanUpPerfTest#testControlStatementsCleanUp() (vs. I20191016-1800)	- 4.9% [±0.2]
*CleanUpPerfTest#testConvertLoopCleanUp() (vs. I20191016-1800)	- 2.8% [±0.5]
*CleanUpPerfTest#testExpressionsCleanUp() (vs. I20191016-1800)	- 0.6% [±0.1]
*CleanUpPerfTest#testJava50CleanUp() (vs. I20191016-1800)	+1.0% [±0.2]
*CleanUpPerfTest#testNullCleanUp() (vs. I20191016-1800)	- 3.8% [±0.5]
*CleanUpPerfTest#testOrganizeImports() (vs. I20191016-1800)	Performance criteria not met when compared to 'I20191016-1800': Elapsed Process= 0.33s is not within [0%, 110'%] of 0.21s - 54.8% [±4.3]
*CleanUpPerfTest#testSortMembersCleanUp() (vs. I20191016-1800)	- 0.5% [±0.4]
*CleanUpPerfTest#testStringCleanUp() (vs. I20191016-1800)	+0.0% [±2.0]
*CleanUpPerfTest#testUnnecessaryCodeCleanUp() (vs. I20191016-1800)	+4.7% [±0.2]
*CleanUpPerfTest#testUnusedCodeCleanUp() (vs. I20191016-1800)	+6.7% [±0.0]
*CleanUpPerfTest#testVariableDeclarationCleanUp() (vs. I20191016-1800)	- 3.8% [±0.4]
*OpenTypePerfTest#testColdException() (vs. I20191016-1800)	+44.5% [±45.3]
*OpenTypePerfTest#testWarmException() (vs. I20191016-1800)	+5.7% [±13.0]
*OpenTypePerfTest#testWarmException10() (vs. I20191016-1800)	+3.7% [±0.6]
*OpenTypePerfTest#testWarmOpenSWT() (vs. I20191016-1800)	+5.9% [±12.6]
*OpenTypePerfTest#testWarmOpenSWTHistory10() (vs. I20191016-1800)	+16.2% [±0.3]
*OpenTypePerfTest#testWarmS10() (vs. I20191016-1800)	Performance criteria not met when compared to 'I20191016-1800': Elapsed Process= 92ms is not within [0%, 110'%] of 80ms - 14.3% [±1.1]
*OrganizeImportsPerfTest#testOrganizeImport() (vs. I20191016-1800)	Performance criteria not met when compared to 'I20191016-1800': Elapsed Process= 43ms is not within [0%, 110'%] of 38ms - 13.0% [±0.4]
*PackageExplorerColdPerfTest#testOpen() (vs. I20191016-1800)	Performance criteria not met when compared to 'I20191016-1800': Elapsed Process= 21ms is not within [0%, 110'%] of 18ms - 16.2% [±8.5]
*PackageExplorerEmptyPerfTest#testOpen() (vs. I20191016-1800)	Performance criteria not met when compared to 'I20191016-1800': Elapsed Process= 0.16s is not within [0%, 110'%] of 86ms - 81.4% [±31.8]
*PackageExplorerPerfTest#testExpand() (vs. I20191016-1800)	+29.4% [±17.6]
*PackageExplorerPerfTest#testOpen() (vs. I20191016-1800)	Performance criteria not met when compared to 'I20191016-1800': Elapsed Process= 0.16s is not within [0%, 110'%] of 0.12s - 35.8% [±10.0]
*PackageExplorerPerfTest#testRefreshClassFolder() (vs. I20191016-1800)	+2.4% [±14.2]
*PackageExplorerPerfTest#testSelect() (vs. I20191016-1800)	+17.4% [±29.2]
*PackageExplorerWarmPerfTest#testOpen() (vs. I20191016-1800)	Performance criteria not met when compared to 'I20191016-1800': Elapsed Process= 88ms is not within [0%, 110'%] of 70ms - 24.8% [±2.4]
*IntroduceIndirectionPerfAcceptanceTests#testIntroduceIndirection() (vs. I20191016-1800)	+3.5% [±1.2]
*MoveCompilationUnitPerfTests1#test_1000_10() (vs. I20191016-1800)	Performance criteria not met when compared to 'I20191016-1800': Elapsed Process= 4.1s is not within [0%, 110'%] of 3.6s - 11.8% [±6.5]
*MoveCompilationUnitPerfTests1#test_100_10() (vs. I20191016-1800)	- 4.2% [±8.9]
*MoveCompilationUnitPerfTests1#test_10_10() (vs. I20191016-1800)	- 7.0% [±5.4]
*MoveCompilationUnitPerfTests2#test_10_10() (vs. I20191016-1800)	- 3.5% [±15.0]
*MoveCompilationUnitPerfTests2#test_10_100() (vs. I20191016-1800)	+15.3% [±4.7]
*MoveCompilationUnitPerfTests2#test_10_1000() (vs. I20191016-1800)	+3.6% [±3.8]
*MoveStaticMembersPerfTests1#test_1000_10() (vs. I20191016-1800)	+7.4% [±3.0]
*MoveStaticMembersPerfTests1#test_100_10() (vs. I20191016-1800)	+1.7% [±8.1]
*MoveStaticMembersPerfTests1#test_10_10() (vs. I20191016-1800)	+30.1% [±4.0]
*MoveStaticMembersPerfTests2#test_10_10() (vs. I20191016-1800)	- 6.3% [±2.0]
*MoveStaticMembersPerfTests2#test_10_100() (vs. I20191016-1800)	- 2.1% [±11.5]
*MoveStaticMembersPerfTests2#test_10_1000() (vs. I20191016-1800)	+7.5% [±4.2]
*RenameMethodPerfTests1#test_1000_10() (vs. I20191016-1800)	+1.3% [±0.5]
*RenameMethodPerfTests1#test_100_10() (vs. I20191016-1800)	+7.2% [±0.7]
*RenameMethodPerfTests1#test_10_10() (vs. I20191016-1800)	- 1.3% [±0.6]
*RenameMethodPerfTests2#test_10_10() (vs. I20191016-1800)	- 8.8% [±0.9]
*RenameMethodPerfTests2#test_10_100() (vs. I20191016-1800)	- 8.3% [±0.6]
*RenameMethodPerfTests2#test_10_1000() (vs. I20191016-1800)	+6.0% [±0.3]
*RenameMethodWithOverloadPerfTests#test_1000_10() (vs. I20191016-1800)	+1.0% [±0.4]
*RenameMethodWithOverloadPerfTests#test_100_10() (vs. I20191016-1800)	+9.7% [±0.1]
*RenameMethodWithOverloadPerfTests#test_10_10() (vs. I20191016-1800)	+6.2% [±0.8]
*RenamePackagePerfTests1#test_1000_10() (vs. I20191016-1800)	+7.0% [±0.2]
*RenamePackagePerfTests1#test_100_10() (vs. I20191016-1800)	+0.4% [±0.3]
*RenamePackagePerfTests1#test_10_10() (vs. I20191016-1800)	+8.1% [±0.4]
*RenamePackagePerfTests2#test_10_10() (vs. I20191016-1800)	+8.4% [±0.2]
*RenamePackagePerfTests2#test_10_100() (vs. I20191016-1800)	+12.4% [±0.4]
*RenamePackagePerfTests2#test_10_1000() (vs. I20191016-1800)	+8.5% [±0.2]
*RenameTypePerfAcceptanceTests#testWarm() (vs. I20191016-1800)	+1.1% [±5.6]
*RenameTypePerfTests1#test_1000_10() (vs. I20191016-1800)	+7.8% [±0.1]
*RenameTypePerfTests1#test_100_10() (vs. I20191016-1800)	- 9.7% [±1.4]
*RenameTypePerfTests1#test_10_10() (vs. I20191016-1800)	+1.9% [±0.6]
*RenameTypePerfTests2#test_10_10() (vs. I20191016-1800)	+0.5% [±0.4]
*RenameTypePerfTests2#test_10_100() (vs. I20191016-1800)	- 4.1% [±0.6]
*RenameTypePerfTests2#test_10_1000() (vs. I20191016-1800)	+0.5% [±0.2]
*ExtractInterfaceHeapAcceptanceTests#testExtractControl() (vs. I20191016-1800)	+9.1% [±5.7]
*ExtractInterfacePerfAcceptanceTests#testExtractControl() (vs. I20191016-1800)	+9.3% [±2.6]