Performance of org.eclipse.core: M20150204-1700 relative to R-4.4-201406061215

SUSE Linux Enterprise Server 11 (x86_64)

Scenario Status

• an icon showing whether the test fails or passes and whether it's reliable or not.
  The legend for this icon is:
  • Green (): mark a successful result, which means this test has neither significant performance regression nor significant standard error
  • Red (): mark a failing result, which means this test shows a significant performance regression (more than 10%)
  • Gray (): mark a failing result (see above) with a comment explaining this degradation.
  • Yellow ( or ): mark a failing or successful result with a significant standard error (more than 3%)
  • Black (): mark an undefined result, which means that deviation on this test is not a number (NaN) or is infinite (happens when the reference value is equals to 0!)
  • "n/a": mark a test for with no performance results
• the value of the deviation from the baseline as a percentage (ie. formula is: (build_test_time - baseline_test_time) / baseline_test_time)
• the value of the standard error of this deviation as a percentage (ie. formula is: sqrt(build_test_stddev^2 / N + baseline_test_stddev^2 / N) / baseline_test_time)
  When test only has one measure, the standard error cannot be computed and is replaced with a '[n/a]'.

• fly over image of failing tests to see the complete error message
• to look at the complete and detailed test results, click on its image

All 53 scenarios	SUSE Linux Enterprise Server 11 (x86_64)
BenchFileStore#testStoreExists()	+0.4% [±3.5]
BenchFileStore#testStoreIsReadOnly()	- 1.9% [±3.7]
BenchFileStore#testStoreLastModified()	+13.5% [±6.7]
BenchMiscWorkspace#testGetProject()	+4.6% [±8.2]
BenchMiscWorkspace#testNoOp()	- 1.3% [±4.2]
BenchWorkspace#testCountResources()	+68.9% [±3.3]
BenchWorkspace#testCountResourcesDuringOperation()	Performance criteria not met when compared to 'R-4.4-201406061215': Elapsed Process= 0.56s is not within [0%, 110'%] of 0.47s - 18.7% [±18.4]
BenchWorkspace#testFindMaxProblemSeverity()	- 1.6% [±1.4]
BuilderPerformanceTest#testManualBuildWithAutobuildOn()	+17.1% [±10.1]
FileSystemPerformanceTest#testPutFileInfo()	+5.6% [±1.7]
LocalHistoryPerformanceTest#testAddState()	+6.5% [±3.4]
LocalHistoryPerformanceTest#testBug28603()	+15.7% [±6.2]
LocalHistoryPerformanceTest#testClearHistory100x4()	+9.6% [±40.3]
LocalHistoryPerformanceTest#testClearHistory20x20()	+19.6% [±21.1]
LocalHistoryPerformanceTest#testClearHistory4x100()	+22.2% [±26.1]
LocalHistoryPerformanceTest#testCopyHistory100x4()	+5.2% [±2.6]
LocalHistoryPerformanceTest#testCopyHistory20x20()	- 2.8% [±2.0]
LocalHistoryPerformanceTest#testCopyHistory4x100()	- 8.8% [±5.9]
LocalHistoryPerformanceTest#testGetDeletedMembers100x4()	+18.7% [±31.0]
LocalHistoryPerformanceTest#testGetDeletedMembers20x20()	+7.0% [±29.1]
LocalHistoryPerformanceTest#testGetDeletedMembers4x100()	Performance criteria not met when compared to 'R-4.4-201406061215': Elapsed Process= 10ms is not within [0%, 110'%] of 5ms - 68.8% [±109.7]
LocalHistoryPerformanceTest#testGetHistory()	Performance criteria not met when compared to 'R-4.4-201406061215': Elapsed Process= 14ms is not within [0%, 110'%] of 11ms - 21.0% [n/a]
LocalHistoryPerformanceTest#testHistoryCleanUp100x4()	- 7.3% [±11.1]
LocalHistoryPerformanceTest#testHistoryCleanUp20x20()	+0.3% [±7.3]
MarkerPerformanceTest#testSetAttributes1()	+8.0% [n/a]
MarkerPerformanceTest#testSetAttributes2()	+8.7% [n/a]
PropertyManagerPerformanceTest#testGetProperty100x4()	- 0.5% [±8.3]
PropertyManagerPerformanceTest#testGetProperty20x20()	+2.8% [±0.4]
PropertyManagerPerformanceTest#testGetProperty4x100()	+3.9% [±0.4]
PropertyManagerPerformanceTest#testSetProperty100x4()	+8.8% [±10.8]
PropertyManagerPerformanceTest#testSetProperty20x20()	+22.4% [±7.4]
PropertyManagerPerformanceTest#testSetProperty4x100()	+15.3% [±1.8]
WorkspacePerformanceTest#testCloseOpenProject()	+14.3% [±2.9]
WorkspacePerformanceTest#testCreateResources()	+2.6% [±1.6]
WorkspacePerformanceTest#testDeleteProject()	+26.8% [±1.5]
WorkspacePerformanceTest#testFolderCopy()	+44.4% [±7.7]
WorkspacePerformanceTest#testFolderMove()	+15.8% [±8.7]
WorkspacePerformanceTest#testLoadSnapshot()	+0.0% [±23.1]
WorkspacePerformanceTest#testRefreshProject()	+4.8% [±3.5]
BenchPath#testHash()	+0.0% [±1.5]
BenchPath#testPathCreation()	- 3.8% [±5.2]
BenchPath#testToOSString()	+0.9% [±6.1]
BenchPath#testToString()	- 6.7% [±5.8]
ContentTypePerformanceTest#testLoadCatalog()	- 2.8% [n/a]
ContentTypePerformanceTest#testNameMatching()	Performance criteria not met when compared to 'R-4.4-201406061215': Elapsed Process= 0.38s is not within [0%, 110'%] of 0.29s - 32.4% [±39.2]
PreferencePerformanceTest#testGetStringCommonPrefixKeys()	+2.0% [±1.5]
PreferencePerformanceTest#testGetStringMisses()	+4.6% [±0.7]
PreferencePerformanceTest#testGetStringSequentialKeys()	+1.2% [±0.7]
PreferencePerformanceTest#testGetStringUniqueKeys()	+1.4% [±2.1]
PreferencePerformanceTest#testPutStringKeys()	+0.0% [±2.1]
PreferencePerformanceTest#testRemoveStringKeys()	- 1.7% [±3.2]
StartupTest.testApplicationStartup	+1.8% [±2.6]
UIStartupTest.testUIApplicationStartup	+1.4% [±1.6]