Performance of org.eclipse.jdt.ui: I20160606-1100 relative to R (201602121500)

SUSE Linux Enterprise Server 11 (x86_64)

Scenario Status

• an icon showing whether the test fails or passes and whether it's reliable or not.
  The legend for this icon is:
  • Green (): mark a successful result, which means this test has neither significant performance regression nor significant standard error
  • Red (): mark a failing result, which means this test shows a significant performance regression (more than 10%)
  • Gray (): mark a failing result (see above) with a comment explaining this degradation.
  • Yellow ( or ): mark a failing or successful result with a significant standard error (more than 3%)
  • Black (): mark an undefined result, which means that deviation on this test is not a number (NaN) or is infinite (happens when the reference value is equals to 0!)
  • "n/a": mark a test for with no performance results
• the value of the deviation from the baseline as a percentage (ie. formula is: (build_test_time - baseline_test_time) / baseline_test_time)
• the value of the standard error of this deviation as a percentage (ie. formula is: sqrt(build_test_stddev^2 / N + baseline_test_stddev^2 / N) / baseline_test_time)
  When test only has one measure, the standard error cannot be computed and is replaced with a '[n/a]'.

• fly over image of failing tests to see the complete error message
• to look at the complete and detailed test results, click on its image

All 28 scenarios	SUSE Linux Enterprise Server 11 (x86_64)
*CleanUpPerfTest#testAllCleanUps() (vs. R-4.5.2-201509040015)	- 1.8% [±6.3]
*CleanUpPerfTest#testCodeFormatCleanUp() (vs. R-4.5.2-201509040015)	Performance criteria not met when compared to 'R-4.5.2-201509040015': Elapsed Process= 0.62s is not within [0%, 110'%] of 0.51s - 22.8% [±14.2]
*CleanUpPerfTest#testCodeStyleCleanUp() (vs. R-4.5.2-201509040015)	Performance criteria not met when compared to 'R-4.5.2-201509040015': Elapsed Process= 2.6s is not within [0%, 110'%] of 2.2s - 15.1% [±7.6]
*CleanUpPerfTest#testControlStatementsCleanUp() (vs. R-4.5.2-201509040015)	Performance criteria not met when compared to 'R-4.5.2-201509040015': Elapsed Process= 0.76s is not within [0%, 110'%] of 0.68s - 11.7% [±9.0]
*CleanUpPerfTest#testConvertLoopCleanUp() (vs. R-4.5.2-201509040015)	+1.6% [±7.4]
*CleanUpPerfTest#testExpressionsCleanUp() (vs. R-4.5.2-201509040015)	- 9.7% [±12.0]
*CleanUpPerfTest#testJava50CleanUp() (vs. R-4.5.2-201509040015)	Performance criteria not met when compared to 'R-4.5.2-201509040015': Elapsed Process= 0.73s is not within [0%, 110'%] of 0.66s - 10.5% [±10.2]
*CleanUpPerfTest#testNullCleanUp() (vs. R-4.5.2-201509040015)	- 0.5% [±10.1]
*CleanUpPerfTest#testOrganizeImports() (vs. R-4.5.2-201509040015)	+7.6% [±9.8]
*CleanUpPerfTest#testSortMembersCleanUp() (vs. R-4.5.2-201509040015)	+0.4% [±9.6]
*CleanUpPerfTest#testStringCleanUp() (vs. R-4.5.2-201509040015)	Performance criteria not met when compared to 'R-4.5.2-201509040015': Elapsed Process= 0.45s is not within [0%, 110'%] of 0.38s - 18.9% [±11.8]
*CleanUpPerfTest#testUnnecessaryCodeCleanUp() (vs. R-4.5.2-201509040015)	+3.5% [±11.3]
*CleanUpPerfTest#testUnusedCodeCleanUp() (vs. R-4.5.2-201509040015)	- 9.4% [±13.8]
*CleanUpPerfTest#testVariableDeclarationCleanUp() (vs. R-4.5.2-201509040015)	+2.0% [±3.4]
*OpenTypePerfTest#testColdException() (vs. R-4.5.2-201509040015)	+4.1% [n/a]
*OpenTypePerfTest#testWarmException() (vs. R-4.5.2-201509040015)	Performance criteria not met when compared to 'R-4.5.2-201509040015': Elapsed Process= 0.37s is not within [0%, 110'%] of 0.3s - 25.3% [n/a]
*OpenTypePerfTest#testWarmException10() (vs. R-4.5.2-201509040015)	Performance criteria not met when compared to 'R-4.5.2-201509040015': Elapsed Process= 0.31s is not within [0%, 110'%] of 0.28s - 12.3% [±8.3]
*OpenTypePerfTest#testWarmOpenSWT() (vs. R-4.5.2-201509040015)	- 9.4% [n/a]
*OpenTypePerfTest#testWarmOpenSWTHistory10() (vs. R-4.5.2-201509040015)	- 6.9% [±3.3]
*OpenTypePerfTest#testWarmS10() (vs. R-4.5.2-201509040015)	- 9.6% [±8.3]
*OrganizeImportsPerfTest#testOrganizeImport() (vs. R-4.5.2-201509040015)	- 2.1% [±20.2]
*PackageExplorerColdPerfTest#testOpen() (vs. R-4.5.2-201509040015)	+0.0% [n/a]
*PackageExplorerEmptyPerfTest#testOpen() (vs. R-4.5.2-201509040015)	- 4.4% [n/a]
*PackageExplorerPerfTest#testExpand() (vs. R-4.5.2-201509040015)	Performance criteria not met when compared to 'R-4.5.2-201509040015': Elapsed Process= 73ms is not within [0%, 110'%] of 51ms - 43.1% [n/a]
*PackageExplorerPerfTest#testOpen() (vs. R-4.5.2-201509040015)	+2.4% [n/a]
*PackageExplorerPerfTest#testRefreshClassFolder() (vs. R-4.5.2-201509040015)	+1.2% [n/a]
*PackageExplorerPerfTest#testSelect() (vs. R-4.5.2-201509040015)	+45.7% [n/a]
*PackageExplorerWarmPerfTest#testOpen() (vs. R-4.5.2-201509040015)	+1.9% [±9.4]