Performance of org.eclipse.jdt.core: 3.2.1 relative to 3.1

RHEL 4.0 Sun 1.4.2_08 (3 GHz 2.5 GB)

Win XP Sun 1.4.2_08 (3 GHz 2 GB)

RHEL 3.0 Sun 1.4.2_08 (3 GHz 2 B)

Win XP Sun 1.4.2_08 (2 GHz 512 MB)

RHEL 3.0 Sun 1.4.2_08 (2 GHz 512 MB)


Scenario Status

The green/red indication is based on the assert condition in the test. Hover over for error message.
Click on or for detailed results.
Grayed images mark explainable degradations.
Yellow images mark results where there is not enough evidence to reject the null hypothesis at the 90%level (Student's t-test).
"n/a" - results not available.

All 46 scenarios

RHEL 3.0 Sun 1.4.2_08 (2 GHz 512 MB)
RHEL 3.0 Sun 1.4.2_08 (3 GHz 2 B)
RHEL 4.0 Sun 1.4.2_08 (3 GHz 2.5 GB)
Win XP Sun 1.4.2_08 (2 GHz 512 MB)
Win XP Sun 1.4.2_08 (3 GHz 2 GB)
performance.FullSourceWorkspaceASTTests#testDomAstCreationJLS2()
performance.FullSourceWorkspaceASTTests#testDomAstCreationJLS3() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test). n/a
performance.FullSourceWorkspaceASTTests#testDomAstCreationProjectJLS3() n/a
performance.FullSourceWorkspaceASTTests#testWkspDomAstCreationJLS2() n/a
performance.FullSourceWorkspaceBuildTests#testBatchCompilerNoWarning()
performance.FullSourceWorkspaceBuildTests#testCompileJDTCoreProjectAllWarnings()
performance.FullSourceWorkspaceBuildTests#testCompileJDTCoreProjectDefault()
performance.FullSourceWorkspaceBuildTests#testCompileJDTCoreProjectJavadoc()
performance.FullSourceWorkspaceBuildTests#testCompileJDTCoreProjectNoWarning()
performance.FullSourceWorkspaceBuildTests#testCompileSWTProjectDefault()
performance.FullSourceWorkspaceBuildTests#testFullBuildDefault()
performance.FullSourceWorkspaceBuildTests#testFullBuildProjectAllWarnings() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 13.76s is not within [0%, 110%] of 12.37s
performance.FullSourceWorkspaceBuildTests#testFullBuildProjectDefault()
performance.FullSourceWorkspaceBuildTests#testFullBuildProjectNoWarning()
performance.FullSourceWorkspaceBuildTests#testParser() There is not enough evidence to reject the null hypothesis at the 90% level (Student's t-test).
performance.FullSourceWorkspaceBuildTests#testScanner() Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 11.79s is not within [0%, 110%] of 5.65s Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 4.38s is not within [0%, 110%] of 3.81s
performance.FullSourceWorkspaceCompletionTests#testCompleteEmptyName() n/a
performance.FullSourceWorkspaceCompletionTests#testCompleteEmptyNameWithoutMethods() n/a
performance.FullSourceWorkspaceCompletionTests#testCompleteEmptyNameWithoutTypes() n/a
performance.FullSourceWorkspaceCompletionTests#testCompleteMemberAccess() n/a
performance.FullSourceWorkspaceCompletionTests#testCompleteMethodDeclaration() n/a
performance.FullSourceWorkspaceCompletionTests#testCompleteName() n/a
performance.FullSourceWorkspaceCompletionTests#testCompleteNameWithoutMethods() n/a
performance.FullSourceWorkspaceCompletionTests#testCompleteNameWithoutTypes() n/a
performance.FullSourceWorkspaceCompletionTests#testCompleteTypeReference() n/a
performance.FullSourceWorkspaceModelTests#testPerfNameLookupFindKnownSecondaryType() n/a
performance.FullSourceWorkspaceModelTests#testPerfNameLookupFindKnownType() n/a
performance.FullSourceWorkspaceModelTests#testPerfNameLookupFindUnknownType() n/a
performance.FullSourceWorkspaceModelTests#testPerfProjectFindKnownMemberType() n/a
performance.FullSourceWorkspaceModelTests#testPerfProjectFindKnownSecondaryType() n/a
performance.FullSourceWorkspaceModelTests#testPerfProjectFindKnownType() n/a
performance.FullSourceWorkspaceModelTests#testPerfProjectFindUnknownType() n/a
performance.FullSourceWorkspaceModelTests#testPerfReconcile() n/a
performance.FullSourceWorkspaceModelTests#testPerfReconcileBigFileWithSyntaxError() n/a
performance.FullSourceWorkspaceModelTests#testPerfSearchAllTypeNamesAndReconcile() n/a
performance.FullSourceWorkspaceModelTests#testPerfSeekPackageFragments() n/a
performance.FullSourceWorkspaceSearchTests#testIndexing()
performance.FullSourceWorkspaceSearchTests#testSearchAllTypeNames()
performance.FullSourceWorkspaceSearchTests#testSearchBinaryMethod()
performance.FullSourceWorkspaceSearchTests#testSearchConstructor()
performance.FullSourceWorkspaceSearchTests#testSearchField()
performance.FullSourceWorkspaceSearchTests#testSearchMethod()
performance.FullSourceWorkspaceSearchTests#testSearchPackageDeclarations()
performance.FullSourceWorkspaceSearchTests#testSearchType()
performance.FullSourceWorkspaceTypeHierarchyTests#testPerfAllTypes() n/a
performance.FullSourceWorkspaceTypeHierarchyTests#testPerfClassWithPotentialSubinterfaces() n/a