Performance of org.eclipse.jdt.ui: 3.2 relative to 3.1

RHEL 4.0 Sun 1.4.2_08 (3 GHz 2.5 GB)

Win XP Sun 1.4.2_08 (3 Hz 2 GB)

RHEL 3.0 Sun 1.4.2_08 (3 GHz 2 GB)

Win XP Sun 1.4.2_08 (2 GHz 512 MB)

RHEL 3.0 Sun 1.4.2_08 (2 GHz 512 MB)


Scenario Status

The green/red indication is based on the assert condition in the test. Hover over for error message.
Click on or for detailed results.
Grayed images mark explainable degradations.
Yellow images mark results where there is not enough evidence to reject the null hypothesis at the 90%level (Student's t-test).
"n/a" - results not available.

All 53 scenarios

RHEL 3.0 Sun 1.4.2_08 (2 GHz 512 MB)
RHEL 3.0 Sun 1.4.2_08 (3 GHz 2 GB)
RHEL 4.0 Sun 1.4.2_08 (3 GHz 2.5 GB)
Win XP Sun 1.4.2_08 (2 GHz 512 MB)
Win XP Sun 1.4.2_08 (3 Hz 2 GB)
performance.views.CleanUpPerfTest#testAllCleanUps()
performance.views.CleanUpPerfTest#testCodeStyleCleanUp()
performance.views.CleanUpPerfTest#testControlStatementsCleanUp()
performance.views.CleanUpPerfTest#testExpressionsCleanUp()
performance.views.CleanUpPerfTest#testJava50CleanUp()
performance.views.CleanUpPerfTest#testNullCleanUp()
performance.views.CleanUpPerfTest#testStringCleanUp()
performance.views.CleanUpPerfTest#testUnnecessaryCodeCleanUp()
performance.views.CleanUpPerfTest#testUnusedCodeCleanUp()
performance.views.CleanUpPerfTest#testVariableDeclarationCleanUp()
performance.views.OrganizeImportsPerfTest#testOrganizeImport()
performance.views.PackageExplorerColdPerfTest#testOpen() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 23ms is not within [0%, 110%] of 15ms Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 16ms is not within [0%, 110%] of 10ms Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 14ms is not within [0%, 110%] of 9ms
performance.views.PackageExplorerPerfTest#testExpand() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 47ms is not within [0%, 110%] of 23ms Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 26ms is not within [0%, 110%] of 13ms Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 23ms is not within [0%, 110%] of 12ms Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 63ms is not within [0%, 110%] of 16ms Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 31ms is not within [0%, 110%] of 15ms
performance.views.PackageExplorerPerfTest#testOpen() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 217ms is not within [0%, 110%] of 191ms Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 173ms is not within [0%, 110%] of 122ms Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 138ms is not within [0%, 110%] of 113ms Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 164ms is not within [0%, 110%] of 148ms Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 117ms is not within [0%, 110%] of 102ms
performance.views.PackageExplorerPerfTest#testSelect() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 139ms is not within [0%, 110%] of 53ms Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 54ms is not within [0%, 110%] of 36ms Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 45ms is not within [0%, 110%] of 30ms
performance.views.PackageExplorerWarmPerfTest#testOpen()
refactoring.reorg.IntroduceIndirectionPerfAcceptanceTests#testIntroduceIndirection()
refactoring.reorg.MoveCompilationUnitPerfTests1#test_1000_10()
refactoring.reorg.MoveCompilationUnitPerfTests1#test_100_10()
refactoring.reorg.MoveCompilationUnitPerfTests1#test_10_10() Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': CPU Time: 251ms is not within [0%, 110%] of 218ms
refactoring.reorg.MoveCompilationUnitPerfTests2#test_10_10() Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 254ms is not within [0%, 110%] of 227ms
refactoring.reorg.MoveCompilationUnitPerfTests2#test_10_100()
refactoring.reorg.MoveCompilationUnitPerfTests2#test_10_1000()
refactoring.reorg.MoveStaticMembersPerfTests1#test_1000_10()
refactoring.reorg.MoveStaticMembersPerfTests1#test_100_10()
refactoring.reorg.MoveStaticMembersPerfTests1#test_10_10() Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 825ms is not within [0%, 110%] of 705ms
refactoring.reorg.MoveStaticMembersPerfTests2#test_10_10()
refactoring.reorg.MoveStaticMembersPerfTests2#test_10_100()
refactoring.reorg.MoveStaticMembersPerfTests2#test_10_1000()
refactoring.reorg.RenameMethodPerfTests1#test_1000_10()
refactoring.reorg.RenameMethodPerfTests1#test_100_10()
refactoring.reorg.RenameMethodPerfTests1#test_10_10()
refactoring.reorg.RenameMethodPerfTests2#test_10_10() Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 301ms is not within [0%, 110%] of 221ms
refactoring.reorg.RenameMethodPerfTests2#test_10_100()
refactoring.reorg.RenameMethodPerfTests2#test_10_1000() Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 2.53s is not within [0%, 110%] of 2.25s
refactoring.reorg.RenameMethodWithOverloadPerfTests#test_1000_10() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': CPU Time: 24.4s is not within [0%, 110%] of 225ms Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': CPU Time: 16.42s is not within [0%, 110%] of 180ms Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': CPU Time: 14.3s is not within [0%, 110%] of 373ms Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': CPU Time: 31.86s is not within [0%, 110%] of 588ms Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': CPU Time: 21.27s is not within [0%, 110%] of 395ms
refactoring.reorg.RenameMethodWithOverloadPerfTests#test_100_10() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': CPU Time: 2.45s is not within [0%, 110%] of 88ms Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': CPU Time: 1.68s is not within [0%, 110%] of 74ms Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': CPU Time: 1.52s is not within [0%, 110%] of 67ms Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': CPU Time: 3.21s is not within [0%, 110%] of 110ms Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': CPU Time: 2.15s is not within [0%, 110%] of 76ms
refactoring.reorg.RenameMethodWithOverloadPerfTests#test_10_10() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': CPU Time: 380ms is not within [0%, 110%] of 98ms Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': CPU Time: 288ms is not within [0%, 110%] of 86ms Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': CPU Time: 259ms is not within [0%, 110%] of 64ms Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': CPU Time: 462ms is not within [0%, 110%] of 114ms Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': CPU Time: 340ms is not within [0%, 110%] of 82ms
refactoring.reorg.RenamePackagePerfTests1#test_1000_10()
refactoring.reorg.RenamePackagePerfTests1#test_100_10()
refactoring.reorg.RenamePackagePerfTests1#test_10_10()
refactoring.reorg.RenamePackagePerfTests2#test_10_10() Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': Elapsed Process: 684ms is not within [0%, 110%] of 586ms
refactoring.reorg.RenamePackagePerfTests2#test_10_100()
refactoring.reorg.RenamePackagePerfTests2#test_10_1000()
refactoring.reorg.RenameTypePerfAcceptanceTests#testWarm()
refactoring.reorg.RenameTypePerfTests1#test_1000_10()
refactoring.reorg.RenameTypePerfTests1#test_100_10()
refactoring.reorg.RenameTypePerfTests1#test_10_10() Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200606231551, jvm=sun1.4.2_08}': CPU Time: 244ms is not within [0%, 110%] of 214ms
refactoring.reorg.RenameTypePerfTests2#test_10_10()
refactoring.reorg.RenameTypePerfTests2#test_10_100()
refactoring.reorg.RenameTypePerfTests2#test_10_1000()
refactoring.type.ExtractInterfaceHeapAcceptanceTests#testExtractControl()
refactoring.type.ExtractInterfacePerfAcceptanceTests#testExtractControl()