Performance of org.eclipse.jdt.ui: M20090211-1700 relative to 3.3 (200806171530)

Back to global results

The following fingerprints show results for the most representative tests of the org.eclipse.jdt.ui component.
Select which kind of scale you want to use:

RHEL 4.0 Sun 1.4.2_10 (3 GHz 2.5 GB)

Win XP Sun 1.4.2_10 (3 GHz 2 GB)

RHEL 3.0 Sun 1.4.2_10 (3 GHz 2 GB)

RHEL 3.0 Sun 1.4.2_10 (2 GHz 512 MB)


Scenario Status

The following table gives a complete but compact view of performance results for the component.
Each line of the table shows the results for one scenario on all machines.

The name of the scenario is in bold when its results are also displayed in the fingerprints
and starts with an '*' when the scenario has no results in the last baseline run.

Here are information displayed for each test (ie. in each cell): Hints:

All 66 scenarios
RHEL 3.0 Sun 1.4.2_10 (2 GHz 512 MB)
RHEL 3.0 Sun 1.4.2_10 (3 GHz 2 GB)
RHEL 4.0 Sun 1.4.2_10 (3 GHz 2.5 GB)
Win XP Sun 1.4.2_10 (2 GHz 512 MB)
Win XP Sun 1.4.2_10 (3 GHz 2 GB)
CleanUpPerfTest#testAllCleanUps() - 1.0% [±2.3] +4.2% [±1.9] - 0.9% [±2.0] n/a +1.0% [±1.5]
CleanUpPerfTest#testCodeFormatCleanUp() +35.0% [±4.2] +5.9% [±10.4] - 8.3% [±5.8] n/a Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 1.04s is not within [0%, 110%] of 933ms - 11.0% [±3.1]
CleanUpPerfTest#testCodeStyleCleanUp() - 2.6% [±0.9] +10.4% [±6.1] - 3.2% [±1.0] n/a +0.3% [±0.7]
CleanUpPerfTest#testControlStatementsCleanUp() - 4.5% [±2.8] +1.5% [±6.4] - 5.1% [±2.3] n/a - 1.4% [±1.7]
CleanUpPerfTest#testConvertLoopCleanUp() - 1.7% [±1.0] - 1.6% [±1.8] - 1.7% [±0.8] n/a - 1.4% [±0.8]
CleanUpPerfTest#testExpressionsCleanUp() - 1.4% [±1.6] +5.3% [±8.2] - 2.9% [±1.0] n/a - 0.2% [±1.8]
CleanUpPerfTest#testJava50CleanUp() +3.0% [±7.3] - 4.9% [±6.1] +0.9% [±3.9] n/a - 4.1% [±1.8]
CleanUpPerfTest#testNullCleanUp() - 1.4% [±5.7] - 0.5% [±6.2] - 2.3% [±6.4] n/a - 0.4% [±5.6]
CleanUpPerfTest#testOrganizeImports() - 0.8% [±7.3] - 6.5% [±9.3] - 2.7% [±7.2] n/a - 2.9% [±3.3]
CleanUpPerfTest#testSortMembersCleanUp() Performance criteria not met when compared to '{config=eclipseperflnx1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 2.17s is not within [0%, 110%] of 1.77s - 22.7% [±2.0] Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 1.38s is not within [0%, 110%] of 1.22s - 13.8% [±9.1] - 4.4% [±0.5] n/a - 3.3% [±1.2]
CleanUpPerfTest#testStringCleanUp() +2.6% [±5.8] - 7.9% [±10.1] Performance criteria not met when compared to '{config=eclipseperflnx3, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 743ms is not within [0%, 110%] of 666ms - 11.6% [±5.1] n/a - 3.0% [±1.9]
CleanUpPerfTest#testUnnecessaryCodeCleanUp() - 1.5% [±0.4] +10.4% [±9.2] - 0.6% [±0.7] n/a - 2.5% [±0.7]
CleanUpPerfTest#testUnusedCodeCleanUp() +2.0% [±4.9] - 4.8% [±10.1] - 4.8% [±0.8] n/a - 3.8% [±1.8]
CleanUpPerfTest#testVariableDeclarationCleanUp() +1.9% [±4.1] +14.8% [±9.4] - 4.0% [±0.3] n/a - 5.1% [±1.0]
OpenTypePerfTest#testColdException() +2.3% [n/a] Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 8.35s is not within [0%, 110%] of 6.96s - 20.0% [n/a] - 2.1% [n/a] n/a - 0.4% [n/a]
OpenTypePerfTest#testWarmException() - 3.6% [n/a] Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 243ms is not within [0%, 110%] of 203ms - 19.7% [n/a] - 6.7% [n/a] n/a Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 141ms is not within [0%, 110%] of 110ms - 28.2% [n/a]
OpenTypePerfTest#testWarmException10() Performance criteria not met when compared to '{config=eclipseperflnx1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 365ms is not within [0%, 110%] of 319ms - 14.4% [±4.9] +0.0% [±4.9] Performance criteria not met when compared to '{config=eclipseperflnx3, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 170ms is not within [0%, 110%] of 147ms - 15.6% [±4.8] n/a +3.3% [±6.9]
OpenTypePerfTest#testWarmOpenSWT() Performance criteria not met when compared to '{config=eclipseperflnx1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 474ms is not within [0%, 110%] of 428ms - 10.7% [n/a] - 6.0% [n/a] Performance criteria not met when compared to '{config=eclipseperflnx3, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 235ms is not within [0%, 110%] of 213ms - 10.3% [n/a] n/a Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 172ms is not within [0%, 110%] of 156ms - 10.3% [n/a]
OpenTypePerfTest#testWarmOpenSWTHistory10() - 4.9% [±0.9] +1.1% [±1.4] Performance criteria not met when compared to '{config=eclipseperflnx3, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 163ms is not within [0%, 110%] of 145ms - 12.4% [±1.6] n/a Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 118ms is not within [0%, 110%] of 107ms - 10.3% [±3.5]
OpenTypePerfTest#testWarmS10() - 9.1% [±2.4] - 0.9% [±3.4] Performance criteria not met when compared to '{config=eclipseperflnx3, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 191ms is not within [0%, 110%] of 168ms - 13.7% [±4.3] n/a +0.0% [±8.0]
OrganizeImportsPerfTest#testOrganizeImport() +11.8% [n/a] +12.1% [n/a] +13.8% [n/a] n/a +12.6% [n/a]
PackageExplorerColdPerfTest#testOpen() Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 39ms is not within [0%, 110'%] of 28ms - 39.3% [n/a] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 31ms is not within [0%, 110'%] of 20ms - 55.0% [n/a] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 28ms is not within [0%, 110'%] of 17ms - 64.7% [n/a] n/a Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 32ms is not within [0%, 110'%] of 16ms - 100.0% [n/a]
PackageExplorerPerfTest#testExpand() Performance criteria not met when compared to '{config=eclipseperflnx1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 60ms is not within [0%, 110%] of 28ms - 114.3% [n/a] Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 21ms is not within [0%, 110%] of 17ms - 23.5% [n/a] Performance criteria not met when compared to '{config=eclipseperflnx3, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 19ms is not within [0%, 110%] of 16ms - 18.8% [n/a] n/a +0.0% [n/a]
PackageExplorerPerfTest#testOpen() +26.4% [±0.8] +20.8% [±8.8] +27.9% [±1.9] n/a - 0.4% [±8.0]
PackageExplorerPerfTest#testSelect() +26.3% [n/a] +4.9% [n/a] +44.1% [n/a] n/a - 6.7% [n/a]
PackageExplorerWarmPerfTest#testOpen() Performance criteria not met when compared to '{config=eclipseperflnx1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 143ms is not within [-0ms, +0ms] of 221ms +35.3% [±4.2] Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 92ms is not within [-0ms, +0ms] of 150ms +38.7% [±4.2] Performance criteria not met when compared to '{config=eclipseperflnx3, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 79ms is not within [-0ms, +0ms] of 127ms +37.8% [±4.3] n/a Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 101ms is not within [-0ms, +0ms] of 114ms +11.4% [±4.2]
TypeHierarchyPerfTest#testOpenCollHierarchy() +3.2% [n/a] +8.1% [n/a] - 5.0% [n/a] n/a Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 750ms is not within [0%, 110%] of 656ms - 14.3% [n/a]
TypeHierarchyPerfTest#testOpenObjectHierarchy() +54.0% [n/a] +22.4% [n/a] +17.8% [n/a] n/a +18.2% [n/a]
TypeHierarchyPerfTest#testOpenObjectHierarchy2() +19.5% [n/a] +6.8% [n/a] +10.5% [n/a] n/a +6.0% [n/a]
IntroduceIndirectionPerfAcceptanceTests#testIntroduceIndirection() - 0.5% [n/a] - 3.1% [n/a] +7.2% [n/a] n/a - 5.4% [n/a]
MoveCompilationUnitPerfTests1#test_1000_10() +0.4% [n/a] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 11.3s is not within [0%, 110'%] of 9.5s - 18.7% [n/a] - 1.2% [n/a] n/a - 6.2% [n/a]
MoveCompilationUnitPerfTests1#test_100_10() - 9.5% [n/a] - 6.4% [n/a] - 4.7% [n/a] n/a - 8.1% [n/a]
MoveCompilationUnitPerfTests1#test_10_10() +42.0% [±46.3] +18.9% [±20.4] - 1.1% [±5.9] n/a Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 0.28s is not within [0%, 110'%] of 0.22s - 26.0% [±8.5]
MoveCompilationUnitPerfTests2#test_10_10() Performance criteria not met when compared to '{config=eclipseperflnx1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 341ms is not within [0%, 110%] of 289ms - 18.0% [±11.8] - 5.2% [±3.0] - 3.3% [±4.6] n/a Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 270ms is not within [0%, 110%] of 229ms - 17.9% [±15.1]
MoveCompilationUnitPerfTests2#test_10_100() Performance criteria not met when compared to '{config=eclipseperflnx1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 955ms is not within [0%, 110%] of 847ms - 12.8% [n/a] - 2.4% [n/a] - 2.3% [n/a] n/a Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 641ms is not within [0%, 110%] of 563ms - 13.9% [n/a]
MoveCompilationUnitPerfTests2#test_10_1000() - 1.6% [n/a] +2.4% [n/a] +1.8% [n/a] n/a Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 3.56s is not within [0%, 110%] of 3s - 18.8% [n/a]
MoveStaticMembersPerfTests1#test_1000_10() - 2.6% [n/a] - 3.5% [n/a] - 4.9% [n/a] n/a - 7.7% [n/a]
MoveStaticMembersPerfTests1#test_100_10() - 5.1% [n/a] +4.3% [n/a] - 4.3% [n/a] n/a - 4.5% [n/a]
MoveStaticMembersPerfTests1#test_10_10() - 1.7% [±1.7] Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 580ms is not within [0%, 110%] of 432ms - 34.3% [±27.6] - 5.1% [±2.1] n/a - 6.3% [±1.2]
MoveStaticMembersPerfTests2#test_10_10() - 6.7% [±0.8] +38.9% [±44.4] - 3.1% [±1.6] n/a Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 526ms is not within [0%, 110%] of 427ms - 23.2% [±4.6]
MoveStaticMembersPerfTests2#test_10_100() Performance criteria not met when compared to '{config=eclipseperflnx1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 3.57s is not within [0%, 110%] of 3.22s - 10.7% [n/a] +7.2% [n/a] - 2.8% [n/a] n/a - 1.7% [n/a]
MoveStaticMembersPerfTests2#test_10_1000() +42.1% [n/a] +40.0% [n/a] +29.1% [n/a] n/a +38.7% [n/a]
RenameMethodPerfTests1#test_1000_10() - 1.4% [n/a] - 2.5% [n/a] - 1.4% [n/a] n/a - 6.5% [n/a]
RenameMethodPerfTests1#test_100_10() +3.4% [n/a] +1.5% [n/a] - 0.2% [n/a] n/a +2.8% [n/a]
RenameMethodPerfTests1#test_10_10() +0.7% [±6.7] +7.7% [±9.2] - 5.3% [±4.4] n/a - 2.8% [±4.8]
RenameMethodPerfTests2#test_10_10() +28.1% [±28.0] +15.8% [±8.6] - 4.7% [±4.1] n/a Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 260ms is not within [0%, 110%] of 234ms - 11.1% [±11.8]
RenameMethodPerfTests2#test_10_100() - 2.4% [n/a] - 8.4% [n/a] - 8.0% [n/a] n/a +0.0% [n/a]
RenameMethodPerfTests2#test_10_1000() - 0.5% [n/a] +2.6% [n/a] +0.3% [n/a] n/a - 1.8% [n/a]
RenameMethodWithOverloadPerfTests#test_1000_10() +3.1% [±0.9] - 2.8% [±1.2] - 1.4% [±0.6] n/a Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 25s is not within [0%, 110'%] of 20.8s - 20.1% [±4.2]
RenameMethodWithOverloadPerfTests#test_100_10() +0.1% [±4.0] +0.4% [±6.5] - 1.8% [±5.0] n/a - 9.1% [±3.1]
RenameMethodWithOverloadPerfTests#test_10_10() - 0.2% [±3.1] - 0.4% [±2.7] - 2.5% [±3.1] n/a +3.9% [±3.8]
RenamePackagePerfTests1#test_1000_10() +0.7% [n/a] +7.8% [n/a] - 5.9% [n/a] n/a - 2.8% [n/a]
RenamePackagePerfTests1#test_100_10() Performance criteria not met when compared to '{config=eclipseperflnx1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 2.87s is not within [0%, 110%] of 2.51s - 14.2% [n/a] +4.0% [n/a] - 0.4% [n/a] n/a +0.8% [n/a]
RenamePackagePerfTests1#test_10_10() +5.5% [±15.3] Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 353ms is not within [0%, 110%] of 318ms - 11.0% [±7.0] +0.0% [±7.7] n/a +4.0% [±10.2]
RenamePackagePerfTests2#test_10_10() Performance criteria not met when compared to '{config=eclipseperflnx1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 563ms is not within [0%, 110%] of 464ms - 21.3% [±19.3] - 0.3% [±7.2] - 0.4% [±7.4] n/a - 4.5% [±6.2]
RenamePackagePerfTests2#test_10_100() - 2.1% [n/a] +2.9% [n/a] - 2.2% [n/a] n/a - 4.5% [n/a]
RenamePackagePerfTests2#test_10_1000() +3.4% [n/a] - 5.6% [n/a] - 2.8% [n/a] n/a - 1.8% [n/a]
RenameTypePerfAcceptanceTests#testWarm() +4.4% [n/a] Performance criteria not met when compared to '3.3_200706251500_200806171530': Elapsed Process= 4.1s is not within [0%, 110'%] of 3.6s - 15.8% [n/a] +6.9% [n/a] n/a +4.4% [n/a]
RenameTypePerfTests1#test_1000_10() - 2.8% [n/a] +6.2% [n/a] - 1.4% [n/a] n/a - 5.7% [n/a]
RenameTypePerfTests1#test_100_10() - 1.0% [n/a] Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.3_200706251500_200806171530, jvm=sun}': CPU Time: 1.04s is not within [0%, 110%] of 920ms +24.0% [n/a] - 1.8% [n/a] n/a +1.0% [n/a]
RenameTypePerfTests1#test_10_10() - 2.5% [±3.6] +67.9% [±68.4] - 1.7% [±3.2] n/a Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.3_200706251500_200806171530, jvm=sun}': CPU Time: 240ms is not within [0%, 110%] of 213ms - 9.9% [±4.9]
RenameTypePerfTests2#test_10_10() +0.0% [±4.9] +4.5% [±9.3] - 3.5% [±4.4] n/a - 6.8% [±14.4]
RenameTypePerfTests2#test_10_100() Performance criteria not met when compared to '{config=eclipseperflnx1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 790ms is not within [0%, 110%] of 704ms - 12.2% [n/a] Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 557ms is not within [0%, 110%] of 483ms - 15.3% [n/a] +5.1% [n/a] n/a Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 578ms is not within [0%, 110%] of 485ms - 19.2% [n/a]
RenameTypePerfTests2#test_10_1000() - 1.5% [n/a] Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 2.84s is not within [0%, 110%] of 2.56s - 11.1% [n/a] - 1.3% [n/a] n/a - 4.5% [n/a]
ExtractInterfaceHeapAcceptanceTests#testExtractControl() - 2.3% [n/a] +2.6% [n/a] +0.7% [n/a] n/a Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 28.81s is not within [0%, 110%] of 19.76s - 45.8% [n/a]
ExtractInterfacePerfAcceptanceTests#testExtractControl() - 1.1% [n/a] Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 23.89s is not within [0%, 110%] of 20.73s - 15.2% [n/a] - 1.0% [n/a] n/a Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 24.97s is not within [0%, 110%] of 19.24s - 29.8% [n/a]