Performance of org.eclipse.jdt.ui: I20080617-2000 relative to 3.3 (200806171530)

RHEL 4.0 Sun 1.4.2_10 (3 GHz 2.5 GB)

RHEL 3.0 Sun 1.4.2_10 (3 GHz 2 GB)

Win XP Sun 1.4.2_10 (2 GHz 512 MB)

RHEL 3.0 Sun 1.4.2_10 (2 GHz 512 MB)


Scenario Status

The following table gives a complete but compact view of performance results for the component.
Each line of the table shows the results for one scenario on all machines.

The name of the scenario is in bold when its results are also displayed in the fingerprints
and starts with an '*' when the scenario has no results in the last baseline run.

Here are information displayed for each test (ie. in each cell): Hints:

All 66 scenarios
RHEL 3.0 Sun 1.4.2_10 (2 GHz 512 MB)
RHEL 3.0 Sun 1.4.2_10 (3 GHz 2 GB)
RHEL 4.0 Sun 1.4.2_10 (3 GHz 2.5 GB)
Win XP Sun 1.4.2_10 (2 GHz 512 MB)
Win XP Sun 1.4.2_10 (3 GHz 2 GB)
CleanUpPerfTest#testAllCleanUps() - 2.1% [±2.7] +4.2% [±1.8] +0.3% [±1.9] +0.6% [±1.3] n/a
CleanUpPerfTest#testCodeFormatCleanUp() +26.5% [±4.8] +1.0% [±11.1] - 8.0% [±5.8] Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 1.45s is not within [0%, 110%] of 1.3s - 11.4% [±1.5] n/a
CleanUpPerfTest#testCodeStyleCleanUp() - 4.6% [±1.2] +6.1% [±7.0] - 2.0% [±1.0] - 1.6% [±0.3] n/a
CleanUpPerfTest#testControlStatementsCleanUp() - 6.1% [±3.4] - 9.8% [±12.3] - 4.5% [±2.1] - 3.0% [±0.5] n/a
CleanUpPerfTest#testConvertLoopCleanUp() - 2.0% [±1.0] +1.2% [±1.6] - 1.5% [±0.7] - 2.3% [±0.9] n/a
CleanUpPerfTest#testExpressionsCleanUp() - 2.2% [±1.8] +9.2% [±7.9] - 3.3% [±2.7] - 2.6% [±0.7] n/a
CleanUpPerfTest#testJava50CleanUp() +5.0% [±7.0] - 4.4% [±5.3] - 5.9% [±5.6] - 4.0% [±0.6] n/a
CleanUpPerfTest#testNullCleanUp() - 1.8% [±5.7] - 0.4% [±6.1] - 1.0% [±6.5] - 2.2% [±5.0] n/a
CleanUpPerfTest#testOrganizeImports() Performance criteria not met when compared to '{config=eclipseperflnx1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 1.44s is not within [0%, 110%] of 1.21s - 18.5% [±11.4] - 8.8% [±10.3] - 5.1% [±8.3] - 4.3% [±0.7] n/a
CleanUpPerfTest#testSortMembersCleanUp() Performance criteria not met when compared to '{config=eclipseperflnx1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 2.04s is not within [0%, 110%] of 1.77s - 15.9% [±3.9] - 9.4% [±7.3] - 4.1% [±0.5] - 4.0% [±0.5] n/a
CleanUpPerfTest#testStringCleanUp() Performance criteria not met when compared to '{config=eclipseperflnx1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 1.33s is not within [0%, 110%] of 1.16s - 14.5% [±12.1] - 4.3% [±8.7] Performance criteria not met when compared to '{config=eclipseperflnx3, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 740ms is not within [0%, 110%] of 666ms - 11.1% [±5.2] - 2.8% [±0.5] n/a
CleanUpPerfTest#testUnnecessaryCodeCleanUp() - 2.5% [±1.1] +9.4% [±9.3] - 0.9% [±1.2] - 1.8% [±0.5] n/a
CleanUpPerfTest#testUnusedCodeCleanUp() +1.3% [±4.8] +3.4% [±5.1] - 8.9% [±6.0] - 5.1% [±1.3] n/a
CleanUpPerfTest#testVariableDeclarationCleanUp() +2.4% [±4.1] +19.9% [±8.4] - 4.4% [±0.4] - 3.4% [±0.4] n/a
OpenTypePerfTest#testColdException() - 0.4% [n/a] - 2.2% [n/a] - 6.8% [n/a] - 0.9% [n/a] n/a
OpenTypePerfTest#testWarmException() - 7.4% [n/a] Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 244ms is not within [0%, 110%] of 203ms - 20.2% [n/a] - 5.7% [n/a] Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 391ms is not within [0%, 110%] of 172ms - 127.3% [n/a] n/a
OpenTypePerfTest#testWarmException10() Performance criteria not met when compared to '{config=eclipseperflnx1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 361ms is not within [0%, 110%] of 319ms - 13.2% [±4.8] - 0.5% [±4.6] Performance criteria not met when compared to '{config=eclipseperflnx3, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 165ms is not within [0%, 110%] of 147ms - 12.2% [±4.8] - 6.3% [±9.1] n/a
OpenTypePerfTest#testWarmOpenSWT() Performance criteria not met when compared to '{config=eclipseperflnx1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 472ms is not within [0%, 110%] of 428ms - 10.3% [n/a] - 6.4% [n/a] - 4.7% [n/a] Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 250ms is not within [0%, 110%] of 203ms - 23.2% [n/a] n/a
OpenTypePerfTest#testWarmOpenSWTHistory10() - 7.3% [±1.1] - 0.5% [±1.5] - 8.3% [±1.2] Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 167ms is not within [0%, 110%] of 136ms - 22.8% [±4.9] n/a
OpenTypePerfTest#testWarmS10() - 9.1% [±2.6] - 2.8% [±4.0] Performance criteria not met when compared to '{config=eclipseperflnx3, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 191ms is not within [0%, 110%] of 168ms - 13.7% [±4.5] +8.6% [±6.6] n/a
OrganizeImportsPerfTest#testOrganizeImport() +12.3% [n/a] Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 1.45s is not within [0%, 110%] of 1.28s - 12.5% [n/a] +14.0% [n/a] +12.8% [n/a] n/a
PackageExplorerColdPerfTest#testOpen() - 46.4% [n/a] - 50.0% [n/a] - 58.8% [n/a] - 51.6% [n/a] n/a
PackageExplorerPerfTest#testExpand() Performance criteria not met when compared to '{config=eclipseperflnx1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 67ms is not within [0%, 110%] of 28ms - 139.3% [n/a] Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 22ms is not within [0%, 110%] of 17ms - 29.4% [n/a] Performance criteria not met when compared to '{config=eclipseperflnx3, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 20ms is not within [0%, 110%] of 16ms - 25.0% [n/a] +0.0% [n/a] n/a
PackageExplorerPerfTest#testOpen() +27.8% [±0.9] +26.4% [±4.4] +29.9% [±2.2] +3.7% [±9.3] n/a
PackageExplorerPerfTest#testSelect() +25.0% [n/a] +4.9% [n/a] +44.1% [n/a] +34.0% [n/a] n/a
PackageExplorerWarmPerfTest#testOpen() Performance criteria not met when compared to '{config=eclipseperflnx1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 138ms is not within [-0ms, +0ms] of 221ms +37.6% [±3.9] Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 94ms is not within [-0ms, +0ms] of 150ms +37.3% [±4.3] Performance criteria not met when compared to '{config=eclipseperflnx3, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 79ms is not within [-0ms, +0ms] of 127ms +37.8% [±4.1] Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 132ms is not within [-0ms, +0ms] of 153ms +13.7% [±5.3] n/a
TypeHierarchyPerfTest#testOpenCollHierarchy() +7.7% [n/a] +5.7% [n/a] +9.9% [n/a] Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 1.12s is not within [0%, 110%] of 969ms - 16.1% [n/a] n/a
TypeHierarchyPerfTest#testOpenObjectHierarchy() +50.2% [n/a] +22.0% [n/a] +16.4% [n/a] +19.5% [n/a] n/a
TypeHierarchyPerfTest#testOpenObjectHierarchy2() +1.9% [n/a] +19.8% [n/a] +9.6% [n/a] Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 656ms is not within [0%, 110%] of 594ms - 10.4% [n/a] n/a
IntroduceIndirectionPerfAcceptanceTests#testIntroduceIndirection() - 0.7% [n/a] +0.3% [n/a] +7.4% [n/a] - 0.9% [n/a] n/a
MoveCompilationUnitPerfTests1#test_1000_10() +0.2% [n/a] - 13.1% [n/a] - 3.1% [n/a] - 3.1% [n/a] n/a
MoveCompilationUnitPerfTests1#test_100_10() Performance criteria not met when compared to '{config=eclipseperflnx1, build=3.3_200706251500_200806171530, jvm=sun}': CPU Time: 1.58s is not within [0%, 110%] of 1.42s - 31.2% [n/a] - 50.0% [n/a] - 2.9% [n/a] - 2.8% [n/a] n/a
MoveCompilationUnitPerfTests1#test_10_10() +42.3% [±46.3] - 6.4% [±25.1] +1.6% [±6.3] - 4.7% [±3.7] n/a
MoveCompilationUnitPerfTests2#test_10_10() - 4.5% [±4.3] Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 570ms is not within [0%, 110%] of 194ms - 193.8% [±192.1] Performance criteria not met when compared to '{config=eclipseperflnx3, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 251ms is not within [0%, 110%] of 181ms - 38.7% [±42.1] - 6.6% [±3.7] n/a
MoveCompilationUnitPerfTests2#test_10_100() - 4.4% [n/a] - 0.7% [n/a] - 2.7% [n/a] - 5.9% [n/a] n/a
MoveCompilationUnitPerfTests2#test_10_1000() - 1.9% [n/a] +5.2% [n/a] +2.5% [n/a] +0.3% [n/a] n/a
MoveStaticMembersPerfTests1#test_1000_10() - 3.2% [n/a] - 5.8% [n/a] - 6.1% [n/a] - 6.8% [n/a] n/a
MoveStaticMembersPerfTests1#test_100_10() - 4.7% [n/a] - 6.3% [n/a] - 3.7% [n/a] - 5.0% [n/a] n/a
MoveStaticMembersPerfTests1#test_10_10() - 3.2% [±1.7] - 7.4% [±2.7] - 2.8% [±2.5] - 4.1% [±2.6] n/a
MoveStaticMembersPerfTests2#test_10_10() - 3.6% [±2.6] +38.1% [±44.5] - 3.8% [±1.5] - 4.2% [±3.2] n/a
MoveStaticMembersPerfTests2#test_10_100() Performance criteria not met when compared to '{config=eclipseperflnx1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 3.6s is not within [0%, 110%] of 3.22s - 11.8% [n/a] - 1.6% [n/a] +6.3% [n/a] Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 3.2s is not within [0%, 110%] of 2.89s - 10.8% [n/a] n/a
MoveStaticMembersPerfTests2#test_10_1000() +42.8% [n/a] +40.8% [n/a] +26.4% [n/a] +42.7% [n/a] n/a
RenameMethodPerfTests1#test_1000_10() - 0.7% [n/a] - 0.3% [n/a] - 0.6% [n/a] - 3.5% [n/a] n/a
RenameMethodPerfTests1#test_100_10() +3.2% [n/a] +1.2% [n/a] - 1.7% [n/a] - 2.0% [n/a] n/a
RenameMethodPerfTests1#test_10_10() +0.3% [±4.8] +4.3% [±9.3] - 3.0% [±4.9] +0.0% [±2.2] n/a
RenameMethodPerfTests2#test_10_10() +29.4% [±27.8] - 2.7% [±12.7] - 3.5% [±3.8] - 1.3% [±3.6] n/a
RenameMethodPerfTests2#test_10_100() - 5.8% [n/a] Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 2.28s is not within [0%, 110%] of 429ms - 431.7% [n/a] - 3.1% [n/a] +0.0% [n/a] n/a
RenameMethodPerfTests2#test_10_1000() - 1.0% [n/a] +2.4% [n/a] +0.6% [n/a] - 1.7% [n/a] n/a
RenameMethodWithOverloadPerfTests#test_1000_10() - 1.1% [±1.2] - 1.3% [±0.7] - 0.4% [±0.6] - 2.7% [±0.6] n/a
RenameMethodWithOverloadPerfTests#test_100_10() - 2.4% [±4.3] - 4.5% [±7.8] - 0.9% [±4.6] - 4.7% [±2.9] n/a
RenameMethodWithOverloadPerfTests#test_10_10() - 1.4% [±3.5] Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.3_200706251500_200806171530, jvm=sun}': CPU Time: 267ms is not within [0%, 110%] of 240ms - 17.6% [±15.7] - 2.9% [±3.1] - 4.3% [±1.8] n/a
RenamePackagePerfTests1#test_1000_10() Performance criteria not met when compared to '{config=eclipseperflnx1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 21.33s is not within [0%, 110%] of 19.21s - 11.0% [n/a] +3.0% [n/a] - 1.3% [n/a] - 3.2% [n/a] n/a
RenamePackagePerfTests1#test_100_10() +0.2% [n/a] - 1.2% [n/a] +2.3% [n/a] +0.5% [n/a] n/a
RenamePackagePerfTests1#test_10_10() +7.6% [±12.8] +2.8% [±8.2] +3.6% [±7.0] +1.5% [±7.3] n/a
RenamePackagePerfTests2#test_10_10() +0.9% [±8.9] +0.9% [±7.8] +2.2% [±6.4] +1.5% [±5.3] n/a
RenamePackagePerfTests2#test_10_100() - 1.5% [n/a] +3.1% [n/a] - 0.9% [n/a] +0.0% [n/a] n/a
RenamePackagePerfTests2#test_10_1000() - 2.6% [n/a] +0.4% [n/a] - 2.1% [n/a] - 1.6% [n/a] n/a
RenameTypePerfAcceptanceTests#testWarm() - 17.3% [n/a] +18.8% [n/a] +5.8% [n/a] +5.0% [n/a] n/a
RenameTypePerfTests1#test_1000_10() - 7.2% [n/a] - 0.4% [n/a] - 1.9% [n/a] - 4.0% [n/a] n/a
RenameTypePerfTests1#test_100_10() +1.3% [n/a] Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.3_200706251500_200806171530, jvm=sun}': CPU Time: 1.03s is not within [0%, 110%] of 920ms +24.4% [n/a] - 2.5% [n/a] - 3.6% [n/a] n/a
RenameTypePerfTests1#test_10_10() - 5.4% [±5.0] +55.2% [±69.0] +1.7% [±3.7] - 1.9% [±3.4] n/a
RenameTypePerfTests2#test_10_10() - 1.1% [±7.3] +1.5% [±13.7] - 1.8% [±6.3] - 4.9% [±2.4] n/a
RenameTypePerfTests2#test_10_100() - 5.4% [n/a] - 7.5% [n/a] +0.2% [n/a] - 2.4% [n/a] n/a
RenameTypePerfTests2#test_10_1000() +1.6% [n/a] +3.2% [n/a] +0.8% [n/a] +0.0% [n/a] n/a
ExtractInterfaceHeapAcceptanceTests#testExtractControl() - 1.5% [n/a] +1.6% [n/a] - 1.4% [n/a] - 1.6% [n/a] n/a
ExtractInterfacePerfAcceptanceTests#testExtractControl() - 0.2% [n/a] - 7.9% [n/a] - 1.0% [n/a] - 4.2% [n/a] n/a