Performance of org.eclipse.jdt.debug: I20080617-2000 relative to 3.3 (200806171530)

RHEL 4.0 Sun 1.4.2_10 (3 GHz 2.5 GB)

Win XP Sun 1.4.2_10 (3 GHz 2 GB)

RHEL 3.0 Sun 1.4.2_10 (3 GHz 2 GB)

Win XP Sun 1.4.2_10 (2 GHz 512 MB)

RHEL 3.0 Sun 1.4.2_10 (2 GHz 512 MB)


Scenario Status

The following table gives a complete but compact view of performance results for the component.
Each line of the table shows the results for one scenario on all machines.

The name of the scenario is in bold when its results are also displayed in the fingerprints
and starts with an '*' when the scenario has no results in the last baseline run.

Here are information displayed for each test (ie. in each cell): Hints:

All 11 scenarios

RHEL 3.0 Sun 1.4.2_10 (2 GHz 512 MB)
RHEL 3.0 Sun 1.4.2_10 (3 GHz 2 GB)
RHEL 4.0 Sun 1.4.2_10 (3 GHz 2.5 GB)
Win XP Sun 1.4.2_10 (2 GHz 512 MB)
Win XP Sun 1.4.2_10 (3 GHz 2 GB)
PerfBreakpointTests#testBreakpointRemoval() Performance criteria not met when compared to '{config=eclipseperflnx1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 570ms is not within [0%, 110%] of 464ms - 22.8% [±0.9] Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 357ms is not within [0%, 110%] of 297ms - 20.2% [±1.3] Performance criteria not met when compared to '{config=eclipseperflnx3, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 251ms is not within [0%, 110%] of 203ms - 23.6% [±0.7] Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 756ms is not within [0%, 110%] of 652ms - 16.0% [±2.0] Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 383ms is not within [0%, 110%] of 347ms - 10.4% [±1.3]
PerfBreakpointTests#testLineBreakpointCreation() - 5.9% [±0.4] - 7.0% [±1.6] - 6.5% [±1.4] - 3.3% [±1.5] - 7.1% [±1.7]
PerfBreakpointTests#testMethodEntryBreakpointCreation() - 9.1% [±0.6] - 7.7% [±0.4] - 7.1% [±0.3] Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 1.98s is not within [0%, 110%] of 1.49s - 33.0% [±1.6] - 7.0% [±0.8]
PerfBreakpointTests#testWatchpointCreation() - 4.0% [±0.9] - 6.2% [±0.8] - 6.9% [±0.6] Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 2.55s is not within [0%, 110%] of 1.66s - 54.0% [±1.6] - 5.0% [±0.8]
PerfConditionalBreakpointsTests#testConditionalBreakpoints() - 4.3% [±4.8] Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 382ms is not within [0%, 110%] of 341ms - 12.0% [±5.4] - 3.0% [±5.3] Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 482ms is not within [0%, 110%] of 379ms - 27.2% [±13.5] - 3.3% [±7.9]
PerfConsoleTests#testProcessConsolePlainOutput10000Lines() +7.8% [±1.2] +2.6% [±1.6] - 1.8% [±1.3] - 4.9% [±2.2] +1.9% [±1.2]
PerfConsoleTests#testProcessConsoleStackTraceOutput10000Lines() +13.0% [±0.8] Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 1.11s is not within [0%, 110%] of 1s - 11.3% [±1.1] - 6.6% [±1.5] Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 1.61s is not within [0%, 110%] of 1.44s - 11.6% [±2.0] - 2.6% [±1.2]
PerfConsoleTests#testProcessConsoleWrappedOutput10000Lines() +8.6% [±0.7] +1.3% [±1.6] - 0.3% [±1.3] Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 1.64s is not within [0%, 110%] of 1.48s - 10.5% [±2.5] - 2.1% [±1.2]
PerfContextualLaunchMenu#testContextualLaunchMenu() Performance criteria not met when compared to '{config=eclipseperflnx1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 152ms is not within [0%, 110%] of 66ms - 130.3% [±13.3] Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 106ms is not within [0%, 110%] of 73ms - 45.2% [±12.2] Performance criteria not met when compared to '{config=eclipseperflnx3, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 81ms is not within [0%, 110%] of 64ms - 26.6% [±6.7] Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 43ms is not within [0%, 110%] of 20ms - 115.0% [±32.7] Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 28ms is not within [0%, 110%] of 22ms - 27.3% [±18.1]
PerfSteppingTests#testBareStepOver() - 4.6% [±0.5] Performance criteria not met when compared to '{config=eclipseperflnx2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 964ms is not within [0%, 110%] of 873ms - 10.4% [±0.4] - 2.3% [±0.2] Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 1.7s is not within [0%, 110%] of 1.39s - 21.8% [±1.2] n/a
PerfVariableDetailTests#testToStringDetails() - 0.6% [±0.9] - 0.5% [±0.6] +0.6% [±0.4] Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 534ms is not within [0%, 110%] of 440ms - 21.4% [±1.6] - 0.4% [±0.8]