Performance of org.eclipse.jdt.ui: M20071023-1652 relative to 3.2

RHEL 4.0 Sun 1.4.2_10 (3 GHz 2.5 GB)

Win XP Sun 1.4.2_10 (3 GHz 2 GB)

RHEL 3.0 Sun 1.4.2_10 (3 GHz 2 GB)

Win XP Sun 1.4.2_10 (2 GHz 512 MB)

RHEL 3.0 Sun 1.4.2_10 (2 GHz 512 MB)


Scenario Status

The following table gives a complete but compact view of performance results for the component.
Each line of the table shows the results for one scenario on all machines.

The name of the scenario is in bold when its results are also displayed in the fingerprints
and starts with an '*' when the scenario has no results in the last baseline run.

Here are information displayed for each test (ie. in each cell): Hints:

All 61 scenarios

RHEL 3.0 Sun 1.4.2_10 (2 GHz 512 MB)
RHEL 3.0 Sun 1.4.2_10 (3 GHz 2 GB)
RHEL 4.0 Sun 1.4.2_10 (3 GHz 2.5 GB)
Win XP Sun 1.4.2_10 (2 GHz 512 MB)
Win XP Sun 1.4.2_10 (3 GHz 2 GB)
CleanUpPerfTest#testAllCleanUps() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 8.22s is not within [0%, 110%] of 6.18s - 33.0% [±1.0] Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 5.36s is not within [0%, 110%] of 4.14s - 29.6% [±0.9] Performance criteria not met when compared to '{config=eclipseperflnx3_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 4.38s is not within [0%, 110%] of 3.22s - 36.1% [±1.1] Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 7.52s is not within [0%, 110%] of 5.66s - 32.9% [±0.9] Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 4.94s is not within [0%, 110%] of 3.76s - 31.2% [±0.8]
CleanUpPerfTest#testCodeStyleCleanUp() +16.5% [±1.8] +18.8% [±0.7] +16.9% [±0.8] +14.7% [±0.9] +17.4% [±0.7]
CleanUpPerfTest#testControlStatementsCleanUp() +1.9% [±1.1] +4.6% [±1.0] +5.7% [±0.7] +2.9% [±1.0] +4.8% [±0.7]
*CleanUpPerfTest#testConvertLoopCleanUp() (vs. I20070410-1043) - 1.1% [±0.7] - 4.8% [±1.1] - 2.2% [±0.8] +9.2% [±0.3] +0.4% [±0.3]
CleanUpPerfTest#testExpressionsCleanUp() - 8.5% [±0.7] +4.7% [±1.0] - 0.1% [±0.6] - 0.6% [±1.0] +0.1% [±0.8]
CleanUpPerfTest#testJava50CleanUp() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 998ms is not within [0%, 110%] of 822ms - 21.5% [±3.5] Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 651ms is not within [0%, 110%] of 561ms - 16.0% [±3.7] Performance criteria not met when compared to '{config=eclipseperflnx3_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 535ms is not within [0%, 110%] of 471ms - 13.4% [±2.9] Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 889ms is not within [0%, 110%] of 780ms - 14.0% [±2.6] - 9.6% [±1.9]
CleanUpPerfTest#testNullCleanUp() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 1.06s is not within [0%, 110%] of 957ms - 3.0% [±2.0] Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 708ms is not within [0%, 110%] of 640ms - 2.4% [±1.6] Performance criteria not met when compared to '{config=eclipseperflnx3_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 634ms is not within [0%, 110%] of 569ms - 4.1% [±1.9] Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 933ms is not within [0%, 110%] of 843ms - 10.7% [±1.8] Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 625ms is not within [0%, 110%] of 566ms - 9.3% [±1.9]
*CleanUpPerfTest#testSortMembersCleanUp() (vs. N20070125-0010) - 19.5% [±1.3] - 9.2% [±0.5] - 4.2% [±0.2] - 20.1% [±1.0] - 18.1% [±0.2]
CleanUpPerfTest#testStringCleanUp() +2.4% [±1.6] +2.7% [±1.2] +3.1% [±1.2] +7.8% [±4.7] +11.1% [±4.1]
CleanUpPerfTest#testUnnecessaryCodeCleanUp() +4.8% [±1.5] Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 434ms is not within [0%, 110%] of 336ms - 29.3% [±8.5] Performance criteria not met when compared to '{config=eclipseperflnx3_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 354ms is not within [0%, 110%] of 291ms - 21.7% [±7.0] +2.4% [±1.3] +2.1% [±2.6]
CleanUpPerfTest#testUnusedCodeCleanUp() +11.4% [±1.2] +7.9% [±1.2] +4.5% [±1.5] - 2.1% [±1.5] +5.4% [±1.4]
CleanUpPerfTest#testVariableDeclarationCleanUp() +4.5% [±1.2] +12.0% [±0.2] +11.3% [±0.2] +5.4% [±1.3] +12.4% [±0.1]
OpenTypePerfTest#testColdException() +8.9% [n/a] +18.8% [n/a] +14.6% [n/a] - 5.6% [n/a] +15.7% [n/a]
OpenTypePerfTest#testWarmException() - 4.6% [n/a] +9.1% [n/a] +16.7% [n/a] Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 218ms is not within [0%, 110%] of 156ms - 39.7% [n/a] Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 141ms is not within [0%, 110%] of 109ms - 29.4% [n/a]
OpenTypePerfTest#testWarmException10() +7.9% [±3.3] +21.4% [±4.9] +14.4% [±5.4] +6.1% [±5.6] +24.3% [±7.3]
OpenTypePerfTest#testWarmOpenSWT() +15.2% [n/a] +46.9% [n/a] +27.1% [n/a] +15.3% [n/a] +30.1% [n/a]
OpenTypePerfTest#testWarmOpenSWTHistory10() +29.4% [±34.3] - 6.9% [±4.2] Performance criteria not met when compared to '{config=eclipseperflnx3_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 147ms is not within [0%, 110%] of 112ms - 31.2% [±2.0] +6.6% [±5.8] +2.6% [±3.5]
OpenTypePerfTest#testWarmS10() - 0.6% [±2.6] +12.2% [±5.6] +0.6% [±6.9] Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 162ms is not within [0%, 110%] of 146ms - 11.0% [±4.9] +3.3% [±8.3]
OrganizeImportsPerfTest#testOrganizeImport() +22.3% [n/a] +20.7% [n/a] +20.8% [n/a] +18.6% [n/a] +22.9% [n/a]
PackageExplorerColdPerfTest#testOpen() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 43ms is not within [0%, 110%] of 23ms - 87.0% [n/a] Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 20ms is not within [0%, 110%] of 16ms - 25.0% [n/a] - 6.2% [n/a] +0.0% [n/a] +51.6% [n/a]
PackageExplorerPerfTest#testExpand() +38.3% [n/a] +33.3% [n/a] +33.3% [n/a] +66.0% [n/a] +48.4% [n/a]
PackageExplorerPerfTest#testOpen() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 262ms is not within [0%, 110%] of 235ms - 11.3% [±0.0] Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 172ms is not within [0%, 110%] of 140ms - 22.8% [±0.0] Performance criteria not met when compared to '{config=eclipseperflnx3_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 148ms is not within [0%, 110%] of 134ms - 10.0% [±0.0] Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 172ms is not within [0%, 110%] of 149ms - 15.4% [±0.0] - 6.8% [±0.0]
PackageExplorerPerfTest#testSelect() +45.2% [n/a] +26.8% [n/a] +31.9% [n/a] Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 47ms is not within [0%, 110%] of 31ms - 51.6% [n/a] +51.6% [n/a]
PackageExplorerWarmPerfTest#testOpen() - 12.2% [±1.2] - 16.8% [±2.3] - 20.0% [±1.5] - 1.2% [±1.9] - 6.6% [±1.4]
IntroduceIndirectionPerfAcceptanceTests#testIntroduceIndirection() +3.4% [n/a] +3.3% [n/a] +3.9% [n/a] +4.5% [n/a] +6.4% [n/a]
MoveCompilationUnitPerfTests1#test_1000_10() +4.5% [n/a] - 2.7% [n/a] +1.2% [n/a] +2.7% [n/a] +3.0% [n/a]
MoveCompilationUnitPerfTests1#test_100_10() - 4.0% [n/a] - 5.2% [n/a] - 2.5% [n/a] +0.0% [n/a] +1.0% [n/a]
MoveCompilationUnitPerfTests1#test_10_10() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': CPU Time: 260ms is not within [0%, 110%] of 235ms - 0.8% [±2.1] Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': CPU Time: 175ms is not within [0%, 110%] of 158ms - 9.3% [±2.1] - 2.9% [±3.1] Performance criteria not met when compared to '{config=eclipseperfwin1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': CPU Time: 360ms is not within [0%, 110%] of 324ms +2.8% [±6.8] +6.2% [±4.5]
MoveCompilationUnitPerfTests2#test_10_10() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 340ms is not within [0%, 110%] of 303ms - 9.2% [±5.3] Performance criteria not met when compared to '{config=eclipseperflnx2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 209ms is not within [0%, 110%] of 188ms - 11.0% [±4.8] Performance criteria not met when compared to '{config=eclipseperflnx3_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 190ms is not within [0%, 110%] of 171ms - 6.6% [±2.6] +4.2% [±7.3] Performance criteria not met when compared to '{config=eclipseperfwin2_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 250ms is not within [0%, 110%] of 223ms - 6.4% [±3.3]
MoveCompilationUnitPerfTests2#test_10_100() - 7.8% [n/a] +5.0% [n/a] - 0.5% [n/a] - 2.0% [n/a] +0.0% [n/a]
MoveCompilationUnitPerfTests2#test_10_1000() +28.3% [n/a] +10.8% [n/a] +24.5% [n/a] +29.8% [n/a] +15.2% [n/a]
MoveStaticMembersPerfTests1#test_1000_10() +6.7% [n/a] +10.0% [n/a] +6.7% [n/a] +6.1% [n/a] +5.8% [n/a]
MoveStaticMembersPerfTests1#test_100_10() +5.5% [n/a] +5.4% [n/a] +4.1% [n/a] +4.5% [n/a] +4.3% [n/a]
MoveStaticMembersPerfTests1#test_10_10() +0.9% [±0.7] +0.9% [±3.2] +4.3% [±0.5] +7.8% [±2.9] +6.3% [±1.3]
MoveStaticMembersPerfTests2#test_10_10() - 0.5% [±3.2] +2.5% [±2.5] +3.6% [±0.7] +7.6% [±0.8] +6.1% [±1.0]
MoveStaticMembersPerfTests2#test_10_100() +0.5% [n/a] +9.9% [n/a] - 9.2% [n/a] - 0.5% [n/a] +10.0% [n/a]
MoveStaticMembersPerfTests2#test_10_1000() +6.2% [n/a] +5.6% [n/a] +8.0% [n/a] +7.8% [n/a] +5.3% [n/a]
RenameMethodPerfTests1#test_1000_10() +8.2% [n/a] +1.6% [n/a] +1.3% [n/a] +3.4% [n/a] +3.5% [n/a]
RenameMethodPerfTests1#test_100_10() +1.5% [n/a] - 5.0% [n/a] - 1.4% [n/a] +2.1% [n/a] - 1.0% [n/a]
RenameMethodPerfTests1#test_10_10() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 329ms is not within [0%, 110%] of 272ms - 20.7% [±13.8] - 0.4% [±2.9] - 5.2% [±2.8] +0.8% [±2.0] +0.6% [±2.7]
RenameMethodPerfTests2#test_10_10() - 1.7% [±3.2] +11.6% [±10.1] - 1.4% [±3.2] +9.3% [±6.2] - 4.0% [±2.5]
RenameMethodPerfTests2#test_10_100() - 4.0% [n/a] +77.5% [n/a] - 0.7% [n/a] - 8.1% [n/a] +7.0% [n/a]
RenameMethodPerfTests2#test_10_1000() +29.5% [n/a] +24.7% [n/a] +24.2% [n/a] +28.0% [n/a] +21.7% [n/a]
RenameMethodWithOverloadPerfTests#test_1000_10() +6.8% [±0.4] +1.5% [±0.5] +1.8% [±0.3] +1.5% [±0.2] +2.0% [±0.2]
RenameMethodWithOverloadPerfTests#test_100_10() +4.2% [±1.1] +0.4% [±1.6] Performance criteria not met when compared to '{config=eclipseperflnx3_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': CPU Time: 1.71s is not within [0%, 110%] of 1.53s +0.0% [±1.3] +1.8% [±0.9] +1.8% [±0.9]
RenameMethodWithOverloadPerfTests#test_10_10() - 2.3% [±0.9] - 3.0% [±1.7] Performance criteria not met when compared to '{config=eclipseperflnx3_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': CPU Time: 275ms is not within [0%, 110%] of 249ms - 17.6% [±4.5] +18.4% [±3.0] +4.9% [±1.6]
RenamePackagePerfTests1#test_1000_10() +8.0% [n/a] +13.6% [n/a] +5.2% [n/a] +5.0% [n/a] +3.9% [n/a]
RenamePackagePerfTests1#test_100_10() - 9.3% [n/a] +6.4% [n/a] Performance criteria not met when compared to '{config=eclipseperflnx3_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 2.97s is not within [0%, 110%] of 1.45s - 104.7% [n/a] +3.9% [n/a] +4.7% [n/a]
RenamePackagePerfTests1#test_10_10() +13.0% [±4.0] +5.1% [±3.3] +3.3% [±2.2] +1.9% [±3.5] +3.9% [±2.3]
RenamePackagePerfTests2#test_10_10() +12.0% [±5.2] +1.2% [±2.8] +0.7% [±2.7] +28.7% [±8.6] +3.0% [±2.9]
RenamePackagePerfTests2#test_10_100() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': Elapsed Process: 3.23s is not within [0%, 110%] of 2.42s - 33.1% [n/a] +0.4% [n/a] - 0.4% [n/a] +2.3% [n/a] +2.5% [n/a]
RenamePackagePerfTests2#test_10_1000() +5.7% [n/a] +5.3% [n/a] +7.2% [n/a] +3.9% [n/a] +1.3% [n/a]
RenameTypePerfAcceptanceTests#testWarm() +5.8% [n/a] +7.0% [n/a] - 27.7% [n/a] +6.5% [n/a] +6.9% [n/a]
RenameTypePerfTests1#test_1000_10() - 2.1% [n/a] +10.4% [n/a] - 4.7% [n/a] +3.6% [n/a] +2.6% [n/a]
RenameTypePerfTests1#test_100_10() - 4.3% [n/a] - 35.4% [n/a] - 3.1% [n/a] +2.1% [n/a] +1.1% [n/a]
RenameTypePerfTests1#test_10_10() +1.3% [±0.9] +3.0% [±1.5] Performance criteria not met when compared to '{config=eclipseperflnx3_R3.3, build=3.2_200606291905_200707261759, jvm=sun}': CPU Time: 190ms is not within [0%, 110%] of 170ms - 2.8% [±2.1] +3.6% [±1.9] +0.4% [±3.4]
RenameTypePerfTests2#test_10_10() - 2.0% [±0.3] +42.5% [±25.3] - 3.2% [±2.5] - 0.6% [±3.1] - 3.4% [±2.9]
RenameTypePerfTests2#test_10_100() - 3.2% [n/a] - 2.5% [n/a] - 3.2% [n/a] +2.3% [n/a] +0.0% [n/a]
RenameTypePerfTests2#test_10_1000() +23.2% [n/a] +15.9% [n/a] +17.0% [n/a] +21.6% [n/a] +20.8% [n/a]
ExtractInterfaceHeapAcceptanceTests#testExtractControl() +11.2% [n/a] +13.8% [n/a] +9.5% [n/a] +11.4% [n/a] +9.7% [n/a]
ExtractInterfacePerfAcceptanceTests#testExtractControl() +8.0% [n/a] +14.7% [n/a] +10.7% [n/a] +11.4% [n/a] +11.0% [n/a]