Performance of org.eclipse.core: M20100908-0800 relative to R-3.5-200906111540 (201008301800)

Back to global results

The following fingerprints show results for the most representative tests of the org.eclipse.core component.
Select which kind of scale you want to use:
Help on fingerprints

SLED 10 Sun 1.5.0_10 (2 x 3.00GHz - 3GB RAM)

RHEL 5.0 Sun 6.0_04 (2 x 3.00GHz - 3GB RAM)

Win XP Sun 1.5.0_10 (2 x 3.00GHz - 3GB RAM)

Win XP Sun 6.0_04 (2 x 3.00GHz - 3GB RAM)


Scenario Status

The following table gives a complete but compact view of performance results for the component.
Each line of the table shows the results for one scenario on all machines.

The name of the scenario is in bold when its results are also displayed in the fingerprints
and starts with an '*' when the scenario has no results in the last baseline run.

Here are information displayed for each test (ie. in each cell): Hints:

All 55 scenarios
SLED 10 Sun 1.5.0_10 (2 x 3.00GHz - 3GB RAM)
RHEL 5.0 Sun 6.0_04 (2 x 3.00GHz - 3GB RAM)
Win XP Sun 1.5.0_10 (2 x 3.00GHz - 3GB RAM)
Win XP Sun 6.0_04 (2 x 3.00GHz - 3GB RAM)
BenchFileStore#testStoreExists() +28.9% [±1.8] +14.9% [±1.6] - 2.4% [±1.0] +5.6% [±6.0]
BenchFileStore#testStoreIsReadOnly() +28.9% [±0.6] +14.7% [±1.1] Performance criteria not met when compared to 'R-3.5-200906111540_201008301800': Elapsed Process= 0.63s is not within [0%, 110'%] of 0.54s - 17.8% [±0.4] Performance criteria not met when compared to 'R-3.5-200906111540_201008301800': Elapsed Process= 0.62s is not within [0%, 110'%] of 0.52s - 19.8% [±0.5]
BenchFileStore#testStoreLastModified() +28.9% [±0.6] +17.6% [±0.7] - 1.9% [±0.3] +0.2% [±0.3]
BenchMiscWorkspace#testGetProject() +1.4% [±1.0] +3.9% [±1.0] - 2.8% [±0.6] Performance criteria not met when compared to 'R-3.5-200906111540_201008301800': Elapsed Process= 1.1s is not within [0%, 110'%] of 0.48s - 133.9% [±0.9]
BenchMiscWorkspace#testNoOp() +1.1% [±1.1] - 3.7% [±1.4] - 0.6% [±1.1] - 1.4% [±1.4]
BenchWorkspace#testCountResources() Performance criteria not met when compared to 'R-3.5-200906111540_201008301800': Elapsed Process= 93ms is not within [0%, 110'%] of 42ms - 121.4% [±1.2] Performance criteria not met when compared to 'R-3.5-200906111540_201008301800': Elapsed Process= 94ms is not within [0%, 110'%] of 76ms - 23.7% [±9.9] +0.0% [±2.3] +2.0% [±3.6]
BenchWorkspace#testCountResourcesDuringOperation() +3.6% [±0.5] +0.5% [±0.4] - 2.5% [±0.8] - 3.4% [±0.5]
BenchWorkspace#testFindMaxProblemSeverity() - 1.7% [±0.3] Performance criteria not met when compared to 'R-3.5-200906111540_201008301800': Elapsed Process= 3.7s is not within [0%, 110'%] of 3s - 24.2% [±0.6] - 3.8% [±0.1] Performance criteria not met when compared to 'R-3.5-200906111540_201008301800': Elapsed Process= 3.5s is not within [0%, 110'%] of 3.1s - 10.4% [±0.2]
BuilderPerformanceTest#testManualBuildWithAutobuildOn() +94.4% [±0.5] +95.2% [±0.2] +94.6% [±0.2] +92.8% [±2.5]
*FileSystemPerformanceTest#testPutFileInfo() (vs. R-3.5-200906111540_201007050919) +3.9% [±11.5] - 1.8% [±4.9] Performance criteria not met when compared to 'R-3.5-200906111540_201007050919': Elapsed Process= 6.3s is not within [0%, 110'%] of 2.7s - 130.4% [±16.6] +39.9% [±7.9]
LocalHistoryPerformanceTest#testAddState() +5.0% [±6.1] +0.0% [±6.2] +26.7% [±24.6] +39.1% [±60.3]
LocalHistoryPerformanceTest#testBug28603() +0.0% [±8.5] - 5.3% [±2.3] - 5.9% [±7.7] +29.5% [±81.2]
LocalHistoryPerformanceTest#testClearHistory100x4() +7.7% [±19.5] +0.0% [±12.6] +93.2% [±93.2] Performance criteria not met when compared to 'R-3.5-200906111540_201008301800': Elapsed Process= 15ms is not within [0%, 110'%] of 11ms - 36.4% [±35.7]
LocalHistoryPerformanceTest#testClearHistory20x20() +14.3% [±5.1] Performance criteria not met when compared to 'R-3.5-200906111540_201008301800': Elapsed Process= 6ms is not within [0%, 110'%] of 5ms - 20.0% [±19.8] +6.1% [±14.8] +26.7% [±26.2]
LocalHistoryPerformanceTest#testClearHistory4x100() Performance criteria not met when compared to 'R-3.5-200906111540_201008301800': Elapsed Process= 7ms is not within [0%, 110'%] of 6ms - 16.7% [±4.2] Performance criteria not met when compared to 'R-3.5-200906111540_201008301800': Elapsed Process= 5ms is not within [0%, 110'%] of 4ms - 25.0% [±8.8] +26.0% [±11.9] +63.6% [±50.9]
LocalHistoryPerformanceTest#testCopyHistory100x4() +7.5% [±3.8] Performance criteria not met when compared to 'R-3.5-200906111540_201008301800': Elapsed Process= 0.56s is not within [0%, 110'%] of 0.47s - 19.1% [±7.0] Performance criteria not met when compared to 'R-3.5-200906111540_201008301800': Elapsed Process= 4.2s is not within [0%, 110'%] of 3.6s - 17.7% [±17.5] +19.6% [±14.7]
LocalHistoryPerformanceTest#testCopyHistory20x20() +4.4% [±1.1] Performance criteria not met when compared to 'R-3.5-200906111540_201008301800': Elapsed Process= 0.14s is not within [0%, 110'%] of 95ms - 42.1% [±2.0] Performance criteria not met when compared to 'R-3.5-200906111540_201008301800': Elapsed Process= 1.1s is not within [0%, 110'%] of 0.95s - 15.4% [±57.6] Performance criteria not met when compared to 'R-3.5-200906111540_201008301800': Elapsed Process= 0.64s is not within [0%, 110'%] of 0.45s - 41.4% [±60.3]
LocalHistoryPerformanceTest#testCopyHistory4x100() +9.5% [±8.8] +26.6% [±52.4] Performance criteria not met when compared to 'R-3.5-200906111540_201008301800': Elapsed Process= 0.62s is not within [0%, 110'%] of 0.24s - 161.5% [±170.3] Performance criteria not met when compared to 'R-3.5-200906111540_201008301800': Elapsed Process= 0.35s is not within [0%, 110'%] of 95ms - 264.2% [±259.3]
LocalHistoryPerformanceTest#testGetDeletedMembers100x4() +8.0% [±24.2] +5.0% [±27.0] Performance criteria not met when compared to 'R-3.5-200906111540_201008301800': Elapsed Process= 31ms is not within [0%, 110'%] of 23ms - 34.8% [±76.8] +30.4% [±37.0]
LocalHistoryPerformanceTest#testGetDeletedMembers20x20() +21.4% [±25.0] +0.0% [±0.0] +34.8% [±32.7] Performance criteria not met when compared to 'R-3.5-200906111540_201008301800': Elapsed Process= 15ms is not within [0%, 110'%] of 8ms - 87.5% [±100.2]
LocalHistoryPerformanceTest#testGetDeletedMembers4x100() +0.0% [±8.8] Performance criteria not met when compared to 'R-3.5-200906111540_201008301800': Elapsed Process= 7ms is not within [0%, 110'%] of 6ms - 16.7% [±8.3] +34.8% [±32.7] Performance criteria not met when compared to 'R-3.5-200906111540_201008301800': Elapsed Process= 15ms is not within [0%, 110'%] of 8ms - 87.5% [±100.2]
LocalHistoryPerformanceTest#testGetHistory() +0.0% [n/a] +14.3% [n/a] +100.0% [n/a] [n/a]
LocalHistoryPerformanceTest#testHistoryCleanUp100x4() +4.2% [±7.0] - 2.9% [±8.0] Performance criteria not met when compared to 'R-3.5-200906111540_201008301800': Elapsed Process= 10.9s is not within [0%, 110'%] of 8.4s - 29.8% [±23.3] +16.8% [±22.7]
LocalHistoryPerformanceTest#testHistoryCleanUp20x20() - 1.0% [±0.8] +0.0% [±2.1] Performance criteria not met when compared to 'R-3.5-200906111540_201008301800': Elapsed Process= 10.5s is not within [0%, 110'%] of 7.9s - 32.5% [±21.6] +16.9% [±17.3]
MarkerPerformanceTest#testSetAttributes1() +3.5% [n/a] Performance criteria not met when compared to 'R-3.5-200906111540_201008301800': Elapsed Process= 3.2s is not within [0%, 110'%] of 2.7s - 20.2% [n/a] +0.7% [n/a] +2.2% [n/a]
MarkerPerformanceTest#testSetAttributes2() +4.0% [n/a] Performance criteria not met when compared to 'R-3.5-200906111540_201008301800': Elapsed Process= 3.3s is not within [0%, 110'%] of 2.8s - 17.8% [n/a] - 1.8% [n/a] +0.9% [n/a]
PropertyManagerPerformanceTest#testGetProperty100x4() +1.3% [±1.4] +0.0% [±1.2] - 2.1% [±5.4] - 0.6% [±2.9]
PropertyManagerPerformanceTest#testGetProperty20x20() - 0.2% [±0.2] - 0.9% [±0.2] - 0.7% [±1.5] - 1.9% [±1.7]
PropertyManagerPerformanceTest#testGetProperty4x100() - 1.5% [±0.1] - 1.3% [±0.1] +0.4% [±0.5] - 0.6% [±0.3]
PropertyManagerPerformanceTest#testSetProperty100x4() +6.9% [±6.8] +0.4% [±0.7] Performance criteria not met when compared to 'R-3.5-200906111540_201008301800': Elapsed Process= 1s is not within [0%, 110'%] of 0.94s - 11.1% [±16.8] +15.7% [±11.9]
PropertyManagerPerformanceTest#testSetProperty20x20() +1.2% [±0.7] - 0.9% [±2.4] Performance criteria not met when compared to 'R-3.5-200906111540_201008301800': Elapsed Process= 0.65s is not within [0%, 110'%] of 0.56s - 16.8% [±30.6] +15.8% [±19.5]
PropertyManagerPerformanceTest#testSetProperty4x100() +1.3% [±1.3] +1.1% [±1.7] - 4.6% [±21.1] +12.8% [±19.6]
WorkspacePerformanceTest#testCloseOpenProject() +1.3% [±1.8] +0.0% [±2.3] Performance criteria not met when compared to 'R-3.5-200906111540_201008301800': Elapsed Process= 1.5s is not within [0%, 110'%] of 0.89s - 69.1% [±62.8] +17.7% [±26.7]
WorkspacePerformanceTest#testCreateResources() +3.7% [±0.6] - 0.7% [±1.7] Performance criteria not met when compared to 'R-3.5-200906111540_201008301800': Elapsed Process= 1mn 40s is not within [0%, 110'%] of 1mn 13s - 37.2% [±2.2] +9.9% [±1.7]
WorkspacePerformanceTest#testDeleteProject() - 1.1% [±20.8] Performance criteria not met when compared to 'R-3.5-200906111540_201008301800': Elapsed Process= 1.2s is not within [0%, 110'%] of 1.1s - 15.1% [±12.1] Performance criteria not met when compared to 'R-3.5-200906111540_201008301800': Elapsed Process= 47.9s is not within [0%, 110'%] of 35.6s - 34.5% [±2.5] +20.9% [±1.9]
WorkspacePerformanceTest#testFolderCopy() Performance criteria not met when compared to 'R-3.5-200906111540_201008301800': Elapsed Process= 10.8s is not within [0%, 110'%] of 9s - 19.5% [±22.2] - 1.2% [±0.5] - 5.9% [±2.0] +3.5% [±1.2]
WorkspacePerformanceTest#testFolderMove() +6.8% [±0.8] +20.6% [±17.5] - 1.6% [±0.9] - 1.5% [±0.4]
*WorkspacePerformanceTest#testLoadSnapshot() (vs. R-3.5-200906111540_201007050919) +0.3% [±3.0] - 1.5% [±2.9] +0.6% [±1.8] - 2.9% [±3.3]
WorkspacePerformanceTest#testRefreshProject() +15.7% [±1.1] +9.0% [±0.8] +12.0% [±12.0] +16.5% [±15.5]
BenchPath#testHash() - 2.5% [±0.2] +2.9% [±0.4] Performance criteria not met when compared to 'R-3.5-200906111540_201008301800': Elapsed Process= 1.4s is not within [0%, 110'%] of 1.2s - 14.3% [±0.4] - 0.2% [±0.4]
BenchPath#testPathCreation() +1.0% [±0.2] - 1.6% [±0.4] +0.3% [±0.2] - 3.0% [±0.4]
BenchPath#testToOSString() +1.3% [±0.7] +3.9% [±0.7] +0.0% [±0.9] - 2.0% [±1.0]
BenchPath#testToString() - 0.3% [±0.8] +2.5% [±0.7] +5.0% [±0.8] - 3.0% [±1.1]
ContentTypePerformanceTest#testContentMatching() - 0.5% [±1.3] +0.7% [±1.2] - 0.5% [±1.4] - 1.4% [±0.9]
ContentTypePerformanceTest#testIsKindOf() - 3.4% [±1.0] - 3.3% [±1.3] +2.4% [±1.0] - 1.2% [±1.5]
ContentTypePerformanceTest#testLoadCatalog() - 2.1% [±1.6] +4.7% [±2.0] +1.9% [±6.7] +64.3% [±3.0]
ContentTypePerformanceTest#testNameMatching() +3.8% [±0.9] Performance criteria not met when compared to 'R-3.5-200906111540_201008301800': Elapsed Process= 0.55s is not within [0%, 110'%] of 0.5s - 11.1% [±1.0] Performance criteria not met when compared to 'R-3.5-200906111540_201008301800': Elapsed Process= 0.73s is not within [0%, 110'%] of 0.56s - 30.5% [±1.1] +1.8% [±0.9]
PreferencePerformanceTest#testGetStringCommonPrefixKeys() +1.3% [±0.9] Performance criteria not met when compared to 'R-3.5-200906111540_201008301800': Elapsed Process= 0.54s is not within [0%, 110'%] of 0.49s - 10.1% [±2.0] Performance criteria not met when compared to 'R-3.5-200906111540_201008301800': Elapsed Process= 0.59s is not within [0%, 110'%] of 0.52s - 12.7% [±1.1] - 3.2% [±1.0]
PreferencePerformanceTest#testGetStringMisses() - 7.9% [±0.3] - 6.7% [±0.6] - 5.7% [±2.3] - 0.9% [±0.8]
PreferencePerformanceTest#testGetStringSequentialKeys() +0.8% [±0.2] - 0.4% [±0.2] +0.2% [±0.7] +0.2% [±0.5]
PreferencePerformanceTest#testGetStringUniqueKeys() +1.7% [±2.0] - 0.2% [±2.1] - 2.9% [±2.2] +3.4% [±1.4]
PreferencePerformanceTest#testPutStringKeys() - 3.8% [±0.6] - 0.3% [±0.9] - 7.8% [±0.7] - 8.6% [±1.1]
PreferencePerformanceTest#testRemoveStringKeys() - 4.0% [±0.4] - 6.7% [±0.4] +9.4% [±2.4] - 6.7% [±2.1]
StartupTest.testApplicationStartup Performance criteria not met when compared to 'R-3.5-200906111540_201008301800': Elapsed Process= 1.6s is not within [0%, 110'%] of 1.3s - 24.2% [±15.9] Performance criteria not met when compared to 'R-3.5-200906111540_201008301800': Elapsed Process= 1.5s is not within [0%, 110'%] of 0.97s - 57.3% [±19.7] Performance criteria not met when compared to 'R-3.5-200906111540_201008301800': Elapsed Process= 1.8s is not within [0%, 110'%] of 1.6s - 12.2% [±0.8] Performance criteria not met when compared to 'R-3.5-200906111540_201008301800': Elapsed Process= 1.7s is not within [0%, 110'%] of 1.5s - 17.8% [±18.8]
UIStartupTest.testUIApplicationStartup Performance criteria not met when compared to 'R-3.5-200906111540_201008301800': Elapsed Process= 10.7s is not within [0%, 110'%] of 9.1s - 18.0% [±4.9] - 2.7% [±7.5] - 0.1% [±7.2] Performance criteria not met when compared to 'R-3.5-200906111540_201008301800': Elapsed Process= 9s is not within [0%, 110'%] of 8s - 12.2% [±6.2]