Performance of org.eclipse.jdt.ui: 3.2.1 relative to 3.1

RHEL 4.0 Sun 1.4.2_08 (3 GHz 2.5 GB)

Win XP Sun 1.4.2_08 (3 GHz 2 GB)

RHEL 3.0 Sun 1.4.2_08 (3 GHz 2 B)

Win XP Sun 1.4.2_08 (2 GHz 512 MB)

RHEL 3.0 Sun 1.4.2_08 (2 GHz 512 MB)


Scenario Status

The green/red indication is based on the assert condition in the test. Hover over for error message.
Click on or for detailed results.
Grayed images mark explainable degradations.
Yellow images mark results where there is not enough evidence to reject the null hypothesis at the 90%level (Student's t-test).
"n/a" - results not available.

All 56 scenarios

RHEL 3.0 Sun 1.4.2_08 (2 GHz 512 MB)
RHEL 3.0 Sun 1.4.2_08 (3 GHz 2 B)
RHEL 4.0 Sun 1.4.2_08 (3 GHz 2.5 GB)
Win XP Sun 1.4.2_08 (3 GHz 2 GB)
performance.views.CleanUpPerfTest#testAllCleanUps()
performance.views.CleanUpPerfTest#testCodeStyleCleanUp()
performance.views.CleanUpPerfTest#testControlStatementsCleanUp()
performance.views.CleanUpPerfTest#testExpressionsCleanUp()
performance.views.CleanUpPerfTest#testJava50CleanUp()
performance.views.CleanUpPerfTest#testNullCleanUp()
performance.views.CleanUpPerfTest#testStringCleanUp()
performance.views.CleanUpPerfTest#testUnnecessaryCodeCleanUp()
performance.views.CleanUpPerfTest#testUnusedCodeCleanUp()
performance.views.CleanUpPerfTest#testVariableDeclarationCleanUp()
performance.views.OrganizeImportsPerfTest#testOrganizeImport()
performance.views.PackageExplorerColdPerfTest#testOpen() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 20ms is not within [0%, 110%] of 14ms Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 13ms is not within [0%, 110%] of 10ms Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 14ms is not within [0%, 110%] of 9ms
performance.views.PackageExplorerPerfTest#testExpand() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 47ms is not within [0%, 110%] of 24ms Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 30ms is not within [0%, 110%] of 18ms Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 23ms is not within [0%, 110%] of 15ms Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 31ms is not within [0%, 110%] of 15ms
performance.views.PackageExplorerPerfTest#testOpen() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 230ms is not within [0%, 110%] of 197ms Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 150ms is not within [0%, 110%] of 125ms Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 128ms is not within [0%, 110%] of 106ms Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 117ms is not within [0%, 110%] of 102ms
performance.views.PackageExplorerPerfTest#testSelect() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 78ms is not within [0%, 110%] of 54ms Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 53ms is not within [0%, 110%] of 38ms Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 44ms is not within [0%, 110%] of 30ms
performance.views.PackageExplorerWarmPerfTest#testOpen()
performance.views.TypeHierarchyPerfTest#testOpenCollHierarchy()
performance.views.TypeHierarchyPerfTest#testOpenObjectHierarchy() Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 1.19s is not within [0%, 110%] of 1.06s
performance.views.TypeHierarchyPerfTest#testOpenObjectHierarchy2()
refactoring.reorg.IntroduceIndirectionPerfAcceptanceTests#testIntroduceIndirection()
refactoring.reorg.MoveCompilationUnitPerfTests1#test_1000_10()
refactoring.reorg.MoveCompilationUnitPerfTests1#test_100_10()
refactoring.reorg.MoveCompilationUnitPerfTests1#test_10_10()
refactoring.reorg.MoveCompilationUnitPerfTests2#test_10_10()
refactoring.reorg.MoveCompilationUnitPerfTests2#test_10_100() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 1.09s is not within [0%, 110%] of 891ms
refactoring.reorg.MoveCompilationUnitPerfTests2#test_10_1000()
refactoring.reorg.MoveStaticMembersPerfTests1#test_1000_10()
refactoring.reorg.MoveStaticMembersPerfTests1#test_100_10()
refactoring.reorg.MoveStaticMembersPerfTests1#test_10_10()
refactoring.reorg.MoveStaticMembersPerfTests2#test_10_10()
refactoring.reorg.MoveStaticMembersPerfTests2#test_10_100()
refactoring.reorg.MoveStaticMembersPerfTests2#test_10_1000()
refactoring.reorg.RenameMethodPerfTests1#test_1000_10()
refactoring.reorg.RenameMethodPerfTests1#test_100_10() Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 1.82s is not within [0%, 110%] of 1.42s
refactoring.reorg.RenameMethodPerfTests1#test_10_10() Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 232ms is not within [0%, 110%] of 210ms Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 297ms is not within [0%, 110%] of 217ms
refactoring.reorg.RenameMethodPerfTests2#test_10_10()
refactoring.reorg.RenameMethodPerfTests2#test_10_100()
refactoring.reorg.RenameMethodPerfTests2#test_10_1000()
refactoring.reorg.RenameMethodWithOverloadPerfTests#test_1000_10() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': CPU Time: 24.41s is not within [0%, 110%] of 228ms Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': CPU Time: 16.55s is not within [0%, 110%] of 172ms Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': CPU Time: 14.39s is not within [0%, 110%] of 368ms Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': CPU Time: 21.25s is not within [0%, 110%] of 397ms
refactoring.reorg.RenameMethodWithOverloadPerfTests#test_100_10() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': CPU Time: 2.49s is not within [0%, 110%] of 91ms Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': CPU Time: 1.64s is not within [0%, 110%] of 70ms Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': CPU Time: 1.55s is not within [0%, 110%] of 69ms Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': CPU Time: 2.13s is not within [0%, 110%] of 84ms
refactoring.reorg.RenameMethodWithOverloadPerfTests#test_10_10() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': CPU Time: 384ms is not within [0%, 110%] of 90ms Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': CPU Time: 267ms is not within [0%, 110%] of 82ms Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': CPU Time: 250ms is not within [0%, 110%] of 70ms Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': CPU Time: 339ms is not within [0%, 110%] of 90ms
refactoring.reorg.RenamePackagePerfTests1#test_1000_10()
refactoring.reorg.RenamePackagePerfTests1#test_100_10() Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 4.23s is not within [0%, 110%] of 1.9s
refactoring.reorg.RenamePackagePerfTests1#test_10_10()
refactoring.reorg.RenamePackagePerfTests2#test_10_10()
refactoring.reorg.RenamePackagePerfTests2#test_10_100() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 3.69s is not within [0%, 110%] of 2.58s
refactoring.reorg.RenamePackagePerfTests2#test_10_1000()
refactoring.reorg.RenameTypePerfAcceptanceTests#testWarm()
refactoring.reorg.RenameTypePerfTests1#test_1000_10()
refactoring.reorg.RenameTypePerfTests1#test_100_10()
refactoring.reorg.RenameTypePerfTests1#test_10_10() Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': CPU Time: 250ms is not within [0%, 110%] of 218ms
refactoring.reorg.RenameTypePerfTests2#test_10_10()
refactoring.reorg.RenameTypePerfTests2#test_10_100() Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}': Elapsed Process: 1.21s is not within [0%, 110%] of 556ms
refactoring.reorg.RenameTypePerfTests2#test_10_1000()
refactoring.type.ExtractInterfaceHeapAcceptanceTests#testExtractControl()
refactoring.type.ExtractInterfacePerfAcceptanceTests#testExtractControl()