Performance of org.eclipse.jdt.core: I20080617-2000 relative to 3.3 (200806171530)

RHEL 4.0 Sun 1.4.2_10 (3 GHz 2.5 GB)

Win XP Sun 1.4.2_10 (3 GHz 2 GB)

RHEL 3.0 Sun 1.4.2_10 (3 GHz 2 GB)

Win XP Sun 1.4.2_10 (2 GHz 512 MB)

RHEL 3.0 Sun 1.4.2_10 (2 GHz 512 MB)


Scenario Status

The following table gives a complete but compact view of performance results for the component.
Each line of the table shows the results for one scenario on all machines.

The name of the scenario is in bold when its results are also displayed in the fingerprints
and starts with an '*' when the scenario has no results in the last baseline run.

Here are information displayed for each test (ie. in each cell): Hints:

All 57 scenarios

RHEL 3.0 Sun 1.4.2_10 (2 GHz 512 MB)
RHEL 3.0 Sun 1.4.2_10 (3 GHz 2 GB)
RHEL 4.0 Sun 1.4.2_10 (3 GHz 2.5 GB)
Win XP Sun 1.4.2_10 (2 GHz 512 MB)
Win XP Sun 1.4.2_10 (3 GHz 2 GB)
FullSourceWorkspaceASTTests#testDomAstCreationProjectJLS3() +0.9% [±0.7] +2.1% [±1.1] +1.7% [±0.1] +0.7% [±0.4] - 0.5% [±1.6]
FullSourceWorkspaceASTTests#testPerfDomAstCreationJLS2() +3.2% [±2.9] +2.4% [±2.2] +3.3% [±2.3] +3.3% [±2.5] +1.3% [±2.1]
FullSourceWorkspaceASTTests#testPerfDomAstCreationJLS3() +3.0% [±0.3] +3.0% [±0.5] +3.0% [±0.3] +3.1% [±0.3] +2.9% [±1.3]
FullSourceWorkspaceASTTests#testWkspDomAstCreationJLS2() - 1.5% [n/a] +5.8% [n/a] +1.3% [n/a] Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 2.34m is not within [0%, 110%] of 2.06m - 13.6% [n/a] - 0.3% [n/a]
FullSourceWorkspaceBuildTests#testBatchCompilerNoWarning() - 3.2% [±1.2] - 2.1% [±1.5] +0.0% [±0.3] - 6.2% [±1.2] +8.0% [±1.9]
FullSourceWorkspaceBuildTests#testCompileJDTCoreProjectAllWarnings() - 4.3% [±1.0] +3.7% [±2.5] +4.0% [±0.3] - 5.3% [±1.5] +7.1% [±0.7]
FullSourceWorkspaceBuildTests#testCompileJDTCoreProjectDefault() - 3.3% [±1.6] - 0.2% [±2.3] +0.0% [±0.2] - 5.2% [±2.2] +3.9% [±0.9]
FullSourceWorkspaceBuildTests#testCompileJDTCoreProjectJavadoc() - 2.5% [±1.4] +1.8% [±3.4] +0.8% [±0.1] - 3.1% [±1.0] +5.2% [±0.8]
FullSourceWorkspaceBuildTests#testCompileJDTCoreProjectNoWarning() - 3.7% [±1.2] +1.5% [±2.6] +0.1% [±0.2] - 6.7% [±2.5] +3.8% [±0.6]
FullSourceWorkspaceBuildTests#testCompileSWTProjectDefault() +2.9% [±1.3] +3.8% [±1.3] +3.4% [±0.1] - 5.4% [±3.4] +9.2% [±0.7]
FullSourceWorkspaceBuildTests#testFullBuildDefault() - 7.7% [n/a] +8.5% [n/a] +3.5% [n/a] +5.7% [n/a] +10.8% [n/a]
FullSourceWorkspaceBuildTests#testFullBuildProjectAllWarnings() - 3.7% [±2.4] +4.6% [±0.5] +3.0% [±4.0] - 4.8% [±1.3] +11.7% [±1.0]
FullSourceWorkspaceBuildTests#testFullBuildProjectDefault() - 2.2% [±0.1] +3.6% [±0.6] +3.9% [±0.2] - 1.8% [±0.7] +9.3% [±0.5]
FullSourceWorkspaceBuildTests#testFullBuildProjectNoWarning() - 4.7% [±0.3] +1.6% [±0.4] +1.2% [±0.2] - 4.5% [±1.1] +8.4% [±0.7]
FullSourceWorkspaceBuildTests#testParser() - 2.1% [±0.5] - 4.9% [±0.5] - 0.3% [±0.2] - 3.4% [±1.5] - 4.8% [±1.1]
FullSourceWorkspaceBuildTests#testScanner() +0.5% [±0.3] +5.2% [±0.3] - 1.0% [±0.1] +2.9% [±0.5] +3.2% [±0.6]
FullSourceWorkspaceCompletionTests#testPerfCompleteEmptyName() +1.2% [±0.6] +0.8% [±0.7] +1.9% [±0.4] +0.5% [±1.3] +2.1% [±1.4]
FullSourceWorkspaceCompletionTests#testPerfCompleteEmptyNameWithoutMethods() +1.2% [±0.4] - 0.3% [±0.7] +1.2% [±0.2] +1.7% [±1.5] +3.3% [±2.0]
FullSourceWorkspaceCompletionTests#testPerfCompleteEmptyNameWithoutTypes() +0.8% [±0.4] +0.7% [±0.6] +1.0% [±0.2] +0.0% [±1.5] +0.7% [±5.2]
FullSourceWorkspaceCompletionTests#testPerfCompleteMemberAccess() +2.5% [±0.4] +3.1% [±0.7] +2.5% [±0.4] +0.2% [±1.5] +2.3% [±1.6]
FullSourceWorkspaceCompletionTests#testPerfCompleteMethodDeclaration() +0.3% [±1.6] +0.5% [±1.4] +1.8% [±1.4] - 1.3% [±1.6] - 0.4% [±1.7]
FullSourceWorkspaceCompletionTests#testPerfCompleteName() +0.6% [±1.0] - 1.1% [±0.3] - 0.7% [±0.2] - 0.7% [±0.9] - 0.7% [±0.6]
FullSourceWorkspaceCompletionTests#testPerfCompleteNameWithoutMethods() +0.0% [±0.5] - 1.3% [±0.4] - 1.0% [±0.3] - 0.9% [±0.8] +0.1% [±0.7]
FullSourceWorkspaceCompletionTests#testPerfCompleteNameWithoutTypes() +0.5% [±0.6] +0.0% [±0.8] +1.5% [±5.3] +0.1% [±1.4] +1.4% [±1.6]
FullSourceWorkspaceCompletionTests#testPerfCompleteTypeReference() +1.6% [±4.3] - 0.3% [±0.5] - 0.7% [±0.3] - 0.9% [±0.8] +0.3% [±0.6]
FullSourceWorkspaceFormatterTests#testFormatDefault() +5.0% [±1.4] +1.7% [±1.2] +4.0% [±1.4] +1.6% [±1.3] +0.3% [±1.8]
FullSourceWorkspaceFormatterTests#testFormatDefaultBigFile() +2.1% [±0.7] +3.8% [±0.9] +1.5% [±0.1] +1.4% [±0.3] +2.2% [±0.3]
FullSourceWorkspaceModelTests#testCloseProjects() +3.7% [±9.4] +4.9% [±8.7] +0.5% [±9.0] +19.7% [±5.8] +2.4% [±3.5]
FullSourceWorkspaceModelTests#testCreateJavaElement() - 0.6% [±1.8] +1.6% [±1.1] - 4.9% [±1.9] - 7.4% [±1.0] - 5.9% [±1.0]
FullSourceWorkspaceModelTests#testFindType() +18.3% [±0.6] +17.7% [±2.2] +17.6% [±0.3] +12.2% [±1.8] +7.0% [±1.8]
FullSourceWorkspaceModelTests#testInitJDTPlugin() +5.1% [±0.5] +7.9% [±3.1] +5.6% [±0.4] +7.6% [±1.6] +6.7% [±1.0]
FullSourceWorkspaceModelTests#testNameLookupFindKnownSecondaryType() +1.6% [±0.7] +0.7% [±0.8] - 2.0% [±0.7] +0.4% [±1.2] +1.5% [±2.3]
FullSourceWorkspaceModelTests#testNameLookupFindKnownType() - 0.7% [±2.9] - 0.2% [±1.1] - 1.4% [±1.0] +3.7% [±1.0] +1.5% [±2.0]
FullSourceWorkspaceModelTests#testNameLookupFindUnknownType() +0.6% [±0.9] +0.0% [±0.8] - 1.3% [±0.7] +0.6% [±0.8] +0.8% [±1.0]
FullSourceWorkspaceModelTests#testPerfReconcile() +0.8% [±4.2] +3.2% [±0.6] +1.8% [±0.3] +2.0% [±0.6] +1.2% [±1.4]
FullSourceWorkspaceModelTests#testPerfReconcileBigFileWithSyntaxError() +3.0% [±0.4] +3.5% [±0.8] +3.0% [±0.3] +2.7% [±0.7] +5.8% [±1.7]
FullSourceWorkspaceModelTests#testPerfSearchAllTypeNamesAndReconcile() +1.9% [±0.3] +2.7% [±0.5] +1.5% [±0.2] +2.2% [±0.8] +2.9% [±1.3]
FullSourceWorkspaceModelTests#testPopulateTwoBigJars() +97.5% [±0.3] +97.9% [±11.4] +97.8% [±7.9] +97.2% [±0.6] +97.4% [±2.2]
FullSourceWorkspaceModelTests#testProjectFindKnownMemberType() +1.4% [±1.0] +0.4% [±1.4] +0.0% [±0.6] Performance criteria not met when compared to '{config=eclipseperfwin1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 365ms is not within [0%, 110%] of 329ms - 10.9% [±0.9] +0.0% [±0.8]
FullSourceWorkspaceModelTests#testProjectFindKnownSecondaryType() +9.7% [±1.0] +5.5% [±1.1] +8.6% [±0.5] +5.2% [±0.9] +6.2% [±2.6]
FullSourceWorkspaceModelTests#testProjectFindKnownType() +1.2% [±0.9] - 0.2% [±0.9] +1.6% [±0.8] - 1.5% [±1.3] +1.2% [±1.1]
FullSourceWorkspaceModelTests#testProjectFindUnknownType() +8.3% [±0.3] +7.2% [±0.4] +7.4% [±0.3] +3.9% [±0.9] +7.4% [±1.9]
FullSourceWorkspaceModelTests#testProjectFindUnknownTypeAfterSetClasspath() +7.4% [±0.3] +4.2% [±0.4] +6.4% [±0.2] +5.3% [±0.8] +6.0% [±1.6]
FullSourceWorkspaceModelTests#testSeekPackageFragments() - 1.4% [±1.8] - 1.0% [±1.9] - 1.9% [±1.7] - 2.0% [±2.7] - 1.7% [±4.4]
FullSourceWorkspaceSearchTests#testIndexing() Performance criteria not met when compared to '{config=eclipseperflnx1, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 55.39s is not within [0%, 110%] of 50.09s - 10.6% [n/a] +4.8% [n/a] - 2.1% [n/a] - 1.2% [n/a] - 0.4% [n/a]
FullSourceWorkspaceSearchTests#testIndexingOneProject() - 0.5% [±1.1] - 1.7% [±1.9] - 1.9% [±0.2] - 2.5% [±1.0] - 1.0% [±0.7]
FullSourceWorkspaceSearchTests#testNewSearchAllTypeNames() +2.7% [±0.5] +1.1% [±0.2] +1.2% [±0.2] +12.4% [±0.9] +7.3% [±2.8]
FullSourceWorkspaceSearchTests#testSearchAllTypeNameMatches() +27.3% [±0.3] +31.5% [±1.4] +29.0% [±0.2] +28.4% [±0.8] +30.4% [±0.8]
FullSourceWorkspaceSearchTests#testSearchAllTypeNames() +4.0% [±0.4] +2.7% [±0.6] +2.4% [±0.3] +0.7% [±0.4] +4.6% [±0.7]
FullSourceWorkspaceSearchTests#testSearchBinaryMethod() - 1.3% [±0.2] +0.0% [±2.3] - 2.3% [±0.2] +8.2% [±0.3] +0.4% [±1.7]
FullSourceWorkspaceSearchTests#testSearchConstructor() - 1.6% [±0.4] - 1.6% [±0.2] - 2.1% [±0.2] - 2.5% [±0.1] - 3.3% [±0.8]
FullSourceWorkspaceSearchTests#testSearchField() - 2.1% [±0.3] - 1.9% [±0.7] - 2.0% [±0.2] - 2.8% [±0.4] - 0.9% [±0.8]
FullSourceWorkspaceSearchTests#testSearchMethod() - 3.5% [±0.5] - 7.6% [±1.1] - 3.0% [±0.4] - 8.9% [±0.7] - 4.2% [±1.6]
FullSourceWorkspaceSearchTests#testSearchPackageDeclarationsWorkspace() - 2.3% [±0.4] - 1.8% [±0.8] Performance criteria not met when compared to '{config=eclipseperflnx3, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 306ms is not within [0%, 110%] of 269ms - 13.8% [±0.4] - 1.4% [±1.2] - 3.0% [±2.5]
FullSourceWorkspaceSearchTests#testSearchType() - 1.9% [±0.5] - 2.0% [±0.7] - 2.2% [±0.4] - 2.7% [±0.2] - 4.2% [±0.6]
FullSourceWorkspaceTypeHierarchyTests#testPerfAllTypes() - 0.2% [±0.3] - 1.1% [±0.8] +0.0% [±0.4] +1.3% [±1.0] +0.4% [±1.7]
FullSourceWorkspaceTypeHierarchyTests#testPerfClassWithPotentialSubinterfaces() +0.4% [±0.4] - 0.7% [±2.5] +2.0% [±1.0] +0.0% [±0.1] - 0.7% [±1.9]