Performance of org.eclipse.jdt.core: M20090211-1700 relative to 3.3 (200806171530)

Back to global results

The following fingerprints show results for the most representative tests of the org.eclipse.jdt.core component.
Select which kind of scale you want to use:

RHEL 4.0 Sun 1.4.2_10 (3 GHz 2.5 GB)

Win XP Sun 1.4.2_10 (3 GHz 2 GB)

RHEL 3.0 Sun 1.4.2_10 (3 GHz 2 GB)

RHEL 3.0 Sun 1.4.2_10 (2 GHz 512 MB)


Scenario Status

The following table gives a complete but compact view of performance results for the component.
Each line of the table shows the results for one scenario on all machines.

The name of the scenario is in bold when its results are also displayed in the fingerprints
and starts with an '*' when the scenario has no results in the last baseline run.

Here are information displayed for each test (ie. in each cell): Hints:

All 57 scenarios

RHEL 3.0 Sun 1.4.2_10 (2 GHz 512 MB)
RHEL 3.0 Sun 1.4.2_10 (3 GHz 2 GB)
RHEL 4.0 Sun 1.4.2_10 (3 GHz 2.5 GB)
Win XP Sun 1.4.2_10 (2 GHz 512 MB)
Win XP Sun 1.4.2_10 (3 GHz 2 GB)
FullSourceWorkspaceASTTests#testDomAstCreationProjectJLS3() +0.7% [±0.2] +0.9% [±1.2] +0.8% [±0.1] n/a +0.4% [±1.3]
FullSourceWorkspaceASTTests#testPerfDomAstCreationJLS2() +4.0% [±2.8] +3.3% [±2.1] +2.7% [±2.4] n/a +1.0% [±2.2]
FullSourceWorkspaceASTTests#testPerfDomAstCreationJLS3() +4.4% [±0.2] +3.0% [±0.5] +2.5% [±0.3] n/a +3.0% [±1.2]
FullSourceWorkspaceASTTests#testWkspDomAstCreationJLS2() - 0.2% [n/a] +4.9% [n/a] +0.6% [n/a] n/a Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 1.19m is not within [0%, 110%] of 1m - 18.9% [n/a]
FullSourceWorkspaceBuildTests#testBatchCompilerNoWarning() - 5.1% [±1.5] - 5.0% [±2.7] - 9.7% [±8.6] n/a +7.7% [±1.9]
FullSourceWorkspaceBuildTests#testCompileJDTCoreProjectAllWarnings() - 3.4% [±0.7] +0.5% [±3.6] +3.2% [±0.1] n/a +6.6% [±0.7]
FullSourceWorkspaceBuildTests#testCompileJDTCoreProjectDefault() - 3.5% [±1.6] +1.9% [±1.5] - 1.5% [±0.4] n/a +3.4% [±0.7]
FullSourceWorkspaceBuildTests#testCompileJDTCoreProjectJavadoc() - 2.3% [±1.2] +1.4% [±3.4] - 0.4% [±0.1] n/a +4.3% [±0.8]
FullSourceWorkspaceBuildTests#testCompileJDTCoreProjectNoWarning() - 3.9% [±1.6] +1.5% [±2.4] - 1.0% [±0.1] n/a +3.0% [±0.5]
FullSourceWorkspaceBuildTests#testCompileSWTProjectDefault() +4.4% [±1.1] +3.4% [±1.0] +2.1% [±0.1] n/a +8.2% [±0.7]
FullSourceWorkspaceBuildTests#testFullBuildDefault() - 5.1% [n/a] +5.1% [n/a] +1.9% [n/a] n/a Performance criteria not met when compared to '{config=eclipseperfwin2, build=3.3_200706251500_200806171530, jvm=sun}': Elapsed Process: 2.05m is not within [0%, 110%] of 1.73m - 18.3% [n/a]
FullSourceWorkspaceBuildTests#testFullBuildProjectAllWarnings() - 4.6% [±2.6] +4.3% [±0.4] +2.5% [±4.0] n/a +9.8% [±1.0]
FullSourceWorkspaceBuildTests#testFullBuildProjectDefault() - 2.3% [±0.3] +4.4% [±0.4] +3.5% [±0.1] n/a +7.9% [±0.6]
FullSourceWorkspaceBuildTests#testFullBuildProjectNoWarning() - 3.9% [±0.2] +1.1% [±0.7] +1.1% [±0.3] n/a +6.9% [±0.8]
FullSourceWorkspaceBuildTests#testParser() - 1.1% [±0.7] - 0.5% [±0.5] +0.6% [±0.2] n/a - 3.0% [±1.1]
FullSourceWorkspaceBuildTests#testScanner() - 5.3% [±0.3] +3.3% [±0.4] - 0.4% [±0.1] n/a +3.9% [±0.6]
FullSourceWorkspaceCompletionTests#testPerfCompleteEmptyName() +1.2% [±0.7] - 6.0% [±3.7] +1.1% [±0.4] n/a +1.7% [±1.3]
FullSourceWorkspaceCompletionTests#testPerfCompleteEmptyNameWithoutMethods() +1.8% [±0.4] - 0.9% [±0.6] +1.5% [±0.2] n/a +2.7% [±2.0]
FullSourceWorkspaceCompletionTests#testPerfCompleteEmptyNameWithoutTypes() +1.4% [±0.4] - 0.2% [±0.5] +0.5% [±0.2] n/a +2.6% [±5.1]
FullSourceWorkspaceCompletionTests#testPerfCompleteMemberAccess() +2.6% [±0.4] +0.2% [±0.6] +2.0% [±0.4] n/a +2.5% [±1.4]
FullSourceWorkspaceCompletionTests#testPerfCompleteMethodDeclaration() +0.1% [±1.7] - 1.6% [±1.4] +1.1% [±1.5] n/a +1.0% [±1.5]
FullSourceWorkspaceCompletionTests#testPerfCompleteName() +0.8% [±0.8] - 0.9% [±0.4] - 0.6% [±0.2] n/a - 0.8% [±0.5]
FullSourceWorkspaceCompletionTests#testPerfCompleteNameWithoutMethods() - 0.3% [±0.6] - 0.8% [±0.4] - 0.5% [±0.4] n/a +0.0% [±0.7]
FullSourceWorkspaceCompletionTests#testPerfCompleteNameWithoutTypes() +0.9% [±0.5] - 0.4% [±0.7] +0.9% [±5.3] n/a +1.1% [±1.6]
FullSourceWorkspaceCompletionTests#testPerfCompleteTypeReference() +1.3% [±4.4] - 2.4% [±1.7] - 0.9% [±0.3] n/a - 0.3% [±0.6]
FullSourceWorkspaceFormatterTests#testFormatDefault() +4.8% [±1.4] +2.0% [±1.3] +3.7% [±1.4] n/a - 0.8% [±1.7]
FullSourceWorkspaceFormatterTests#testFormatDefaultBigFile() +3.4% [±0.6] - 3.8% [±0.9] +2.2% [±0.1] n/a +2.0% [±0.2]
FullSourceWorkspaceModelTests#testCloseProjects() +5.8% [±11.1] +8.8% [±8.3] +3.4% [±8.9] n/a +1.0% [±3.2]
FullSourceWorkspaceModelTests#testCreateJavaElement() - 2.9% [±1.3] +1.2% [±1.2] +0.0% [±1.5] n/a +0.5% [±1.2]
FullSourceWorkspaceModelTests#testFindType() +21.7% [±0.4] +16.7% [±2.2] +13.5% [±0.3] n/a +8.8% [±0.1]
FullSourceWorkspaceModelTests#testInitJDTPlugin() +33.4% [±8.2] +0.8% [±4.5] +5.3% [±0.4] n/a +5.0% [±1.0]
FullSourceWorkspaceModelTests#testNameLookupFindKnownSecondaryType() - 2.4% [±0.9] +1.1% [±1.0] - 0.4% [±0.7] n/a +2.5% [±1.8]
FullSourceWorkspaceModelTests#testNameLookupFindKnownType() - 6.0% [±2.3] - 5.5% [±1.3] - 2.2% [±0.9] n/a +5.2% [±2.0]
FullSourceWorkspaceModelTests#testNameLookupFindUnknownType() - 1.3% [±0.7] - 0.2% [±0.9] - 0.4% [±0.7] n/a +3.0% [±1.6]
FullSourceWorkspaceModelTests#testPerfReconcile() +2.1% [±3.4] +2.9% [±0.4] +1.3% [±0.3] n/a +2.2% [±1.7]
FullSourceWorkspaceModelTests#testPerfReconcileBigFileWithSyntaxError() +2.8% [±0.4] +4.8% [±0.7] +2.3% [±0.3] n/a +3.6% [±2.4]
FullSourceWorkspaceModelTests#testPerfSearchAllTypeNamesAndReconcile() +1.0% [±0.4] - 0.3% [±0.5] +0.9% [±0.2] n/a +2.1% [±1.5]
FullSourceWorkspaceModelTests#testPopulateTwoBigJars() +97.5% [±0.3] +97.9% [±11.4] +97.8% [±7.9] n/a +97.1% [±2.2]
FullSourceWorkspaceModelTests#testProjectFindKnownMemberType() - 2.0% [±1.1] +0.0% [±1.4] +0.4% [±0.6] n/a +1.9% [±2.0]
FullSourceWorkspaceModelTests#testProjectFindKnownSecondaryType() +9.4% [±1.1] +4.7% [±1.1] +7.9% [±0.5] n/a +8.4% [±2.0]
FullSourceWorkspaceModelTests#testProjectFindKnownType() - 3.8% [±0.8] +0.5% [±0.9] +1.6% [±0.9] n/a +2.7% [±1.1]
FullSourceWorkspaceModelTests#testProjectFindUnknownType() +8.9% [±0.3] +3.6% [±0.4] +6.9% [±0.3] n/a +6.2% [±2.1]
FullSourceWorkspaceModelTests#testProjectFindUnknownTypeAfterSetClasspath() +10.4% [±0.4] - 2.9% [±0.4] +5.6% [±0.3] n/a +7.2% [±1.8]
FullSourceWorkspaceModelTests#testSeekPackageFragments() - 0.5% [±1.8] - 1.0% [±2.3] - 1.3% [±1.6] n/a +1.1% [±4.7]
FullSourceWorkspaceSearchTests#testIndexing() - 6.1% [n/a] +4.2% [n/a] - 0.9% [n/a] n/a - 0.7% [n/a]
FullSourceWorkspaceSearchTests#testIndexingOneProject() - 1.5% [±1.6] - 1.7% [±1.2] - 2.0% [±0.2] n/a +0.0% [±0.8]
FullSourceWorkspaceSearchTests#testNewSearchAllTypeNames() - 6.7% [±0.5] - 3.9% [±0.2] - 4.8% [±0.6] n/a +1.0% [±3.0]
FullSourceWorkspaceSearchTests#testSearchAllTypeNameMatches() +27.8% [±0.4] +31.7% [±1.6] +29.5% [±0.2] n/a +31.3% [±0.9]
FullSourceWorkspaceSearchTests#testSearchAllTypeNames() +1.8% [±0.5] +2.9% [±0.6] +1.4% [±0.3] n/a +3.6% [±0.7]
FullSourceWorkspaceSearchTests#testSearchBinaryMethod() - 1.1% [±0.2] +0.5% [±2.1] - 2.0% [±0.2] n/a - 0.2% [±1.7]
FullSourceWorkspaceSearchTests#testSearchConstructor() - 1.9% [±0.5] - 2.2% [±0.2] - 1.8% [±0.1] n/a - 2.3% [±0.8]
FullSourceWorkspaceSearchTests#testSearchField() - 1.8% [±0.4] - 3.8% [±1.2] - 1.9% [±0.2] n/a - 0.7% [±0.8]
FullSourceWorkspaceSearchTests#testSearchMethod() - 4.2% [±0.4] - 7.3% [±1.2] - 3.6% [±0.4] n/a - 3.3% [±1.6]
FullSourceWorkspaceSearchTests#testSearchPackageDeclarationsWorkspace() - 2.5% [±0.5] - 6.0% [±1.0] +0.4% [±0.4] n/a - 1.3% [±2.2]
FullSourceWorkspaceSearchTests#testSearchType() - 1.5% [±0.6] - 2.7% [±0.7] - 2.3% [±0.4] n/a - 2.4% [±0.3]
FullSourceWorkspaceTypeHierarchyTests#testPerfAllTypes() - 1.1% [±0.2] - 2.4% [±0.8] - 0.8% [±0.3] n/a +0.4% [±1.7]
FullSourceWorkspaceTypeHierarchyTests#testPerfClassWithPotentialSubinterfaces() +0.4% [±0.2] +2.0% [±1.9] +1.3% [±1.2] n/a - 6.3% [±4.2]