All 67 scenarios |
SLED 10 Sun 1.5.0_10 (2 x 3.00GHz - 3GB RAM)
| RHEL 5.0 Sun 6.0_04 (2 x 3.00GHz - 3GB RAM)
| Win XP Sun 1.5.0_10 (2 x 3.00GHz - 3GB RAM)
|
*CleanUpPerfTest#testAllCleanUps() (vs. R-3.4-200806172000_200911301800)
|
- 0.7% [±2.2]
|
- 4.8% [±1.3]
|
- 2.5% [±7.3]
|
*CleanUpPerfTest#testCodeFormatCleanUp() (vs. R-3.4-200806172000_200911301800)
|
Performance criteria not met when compared to 'R-3.4-200806172000_200911301800': Elapsed Process= 0.74s is not within [0%, 110'%] of 0.65s
- 14.4% [±26.5]
|
Performance criteria not met when compared to 'R-3.4-200806172000_200911301800': Elapsed Process= 0.59s is not within [0%, 110'%] of 0.51s
- 15.5% [±11.2]
|
+22.9% [±24.9]
|
*CleanUpPerfTest#testCodeStyleCleanUp() (vs. R-3.4-200806172000_200911301800)
|
- 8.2% [±5.4]
|
- 2.5% [±3.1]
|
- 7.0% [±20.5]
|
*CleanUpPerfTest#testControlStatementsCleanUp() (vs. R-3.4-200806172000_200911301800)
|
- 4.4% [±0.8]
|
- 5.6% [±0.3]
|
- 6.9% [±29.0]
|
*CleanUpPerfTest#testConvertLoopCleanUp() (vs. R-3.4-200806172000_200911301800)
|
+1.2% [±3.1]
|
- 7.1% [±8.3]
|
- 0.8% [±1.6]
|
*CleanUpPerfTest#testExpressionsCleanUp() (vs. R-3.4-200806172000_200911301800)
|
- 1.2% [±0.5]
|
- 0.3% [±0.3]
|
Performance criteria not met when compared to 'R-3.4-200806172000_201002011800': Elapsed Process= 0.56s is not within [0%, 110'%] of 0.5s
- 12.2% [±40.7]
|
*CleanUpPerfTest#testJava50CleanUp() (vs. R-3.4-200806172000_200911301800)
|
Performance criteria not met when compared to 'R-3.4-200806172000_200911301800': Elapsed Process= 0.68s is not within [0%, 110'%] of 0.59s
- 15.2% [±12.7]
|
- 4.6% [±2.2]
|
Performance criteria not met when compared to 'R-3.4-200806172000_201002011800': Elapsed Process= 1.1s is not within [0%, 110'%] of 1s
- 13.5% [±31.7]
|
*CleanUpPerfTest#testNullCleanUp() (vs. R-3.4-200806172000_200911301800)
|
+12.8% [±14.3]
|
- 0.6% [±4.9]
|
- 1.0% [±6.3]
|
*CleanUpPerfTest#testOrganizeImports() (vs. R-3.4-200806172000_200911301800)
|
- 7.8% [±27.8]
|
- 6.3% [±5.8]
|
- 1.5% [±2.4]
|
*CleanUpPerfTest#testSortMembersCleanUp() (vs. R-3.4-200806172000_200911301800)
|
- 1.9% [±4.9]
|
+0.0% [±6.5]
|
Performance criteria not met when compared to 'R-3.4-200806172000_201002011800': Elapsed Process= 1.2s is not within [0%, 110'%] of 0.98s
- 22.4% [±21.7]
|
*CleanUpPerfTest#testStringCleanUp() (vs. R-3.4-200806172000_200911301800)
|
- 6.3% [±11.1]
|
- 1.7% [±0.2]
|
Performance criteria not met when compared to 'R-3.4-200806172000_201002011800': Elapsed Process= 1.7s is not within [0%, 110'%] of 0.68s
- 147.3% [±49.2]
|
*CleanUpPerfTest#testUnnecessaryCodeCleanUp() (vs. R-3.4-200806172000_200911301800)
|
- 0.8% [±1.1]
|
+0.4% [±0.2]
|
+3.1% [±1.5]
|
*CleanUpPerfTest#testUnusedCodeCleanUp() (vs. R-3.4-200806172000_200911301800)
|
+14.9% [±32.3]
|
Performance criteria not met when compared to 'R-3.4-200806172000_200911301800': Elapsed Process= 0.29s is not within [0%, 110'%] of 0.24s
- 17.2% [±13.4]
|
+22.3% [±22.2]
|
*CleanUpPerfTest#testVariableDeclarationCleanUp() (vs. R-3.4-200806172000_200911301800)
|
- 2.2% [±0.2]
|
+3.7% [±3.4]
|
+2.2% [±21.2]
|
*OpenTypePerfTest#testColdException() (vs. R-3.4-200806172000_200911301800)
|
Performance criteria not met when compared to 'R-3.4-200806172000_200911301800': Elapsed Process= 7.4s is not within [0%, 110'%] of 6.5s
- 13.2% [n/a]
|
+0.0% [n/a]
|
Performance criteria not met when compared to 'R-3.4-200806172000_201002011800': Elapsed Process= 8.6s is not within [0%, 110'%] of 6.9s
- 24.8% [n/a]
|
*OpenTypePerfTest#testWarmException() (vs. R-3.4-200806172000_200911301800)
|
+32.0% [n/a]
|
Performance criteria not met when compared to 'R-3.4-200806172000_200911301800': Elapsed Process= 0.5s is not within [0%, 110'%] of 0.27s
- 87.3% [n/a]
|
+66.8% [n/a]
|
*OpenTypePerfTest#testWarmException10() (vs. R-3.4-200806172000_200911301800)
|
- 7.4% [±2.4]
|
Performance criteria not met when compared to 'R-3.4-200806172000_200911301800': Elapsed Process= 0.38s is not within [0%, 110'%] of 0.25s
- 51.2% [±4.5]
|
- 5.2% [±4.2]
|
*OpenTypePerfTest#testWarmOpenSWT() (vs. R-3.4-200806172000_200911301800)
|
- 3.7% [n/a]
|
Performance criteria not met when compared to 'R-3.4-200806172000_200911301800': Elapsed Process= 0.47s is not within [0%, 110'%] of 0.34s
- 35.5% [n/a]
|
Performance criteria not met when compared to 'R-3.4-200806172000_201002011800': Elapsed Process= 0.27s is not within [0%, 110'%] of 0.2s
- 31.0% [n/a]
|
*OpenTypePerfTest#testWarmOpenSWTHistory10() (vs. R-3.4-200806172000_200911301800)
|
- 5.0% [±1.1]
|
Performance criteria not met when compared to 'R-3.4-200806172000_200911301800': Elapsed Process= 0.41s is not within [0%, 110'%] of 0.27s
- 50.4% [±3.8]
|
- 4.1% [±2.0]
|
*OpenTypePerfTest#testWarmS10() (vs. R-3.4-200806172000_200911301800)
|
- 4.2% [±3.2]
|
Performance criteria not met when compared to 'R-3.4-200806172000_200911301800': Elapsed Process= 0.4s is not within [0%, 110'%] of 0.25s
- 56.1% [±3.8]
|
+1.0% [±3.6]
|
*OrganizeImportsPerfTest#testOrganizeImport() (vs. R-3.4-200806172000_200911301800)
|
Performance criteria not met when compared to 'R-3.4-200806172000_200911301800': Elapsed Process= 0.18s is not within [0%, 110'%] of 0.13s
- 42.2% [±77.2]
|
- 1.4% [±16.0]
|
+30.8% [±30.1]
|
*PackageExplorerColdPerfTest#testOpen() (vs. R-3.4-200806172000_200911301800)
|
+0.0% [n/a]
|
Performance criteria not met when compared to 'R-3.4-200806172000_200911301800': Elapsed Process= 43ms is not within [0%, 110'%] of 19ms
- 126.3% [n/a]
|
Performance criteria not met when compared to 'R-3.4-200806172000_201002011800': Elapsed Process= 47ms is not within [0%, 110'%] of 32ms
- 46.9% [n/a]
|
*PackageExplorerEmptyPerfTest#testOpen() (vs. R-3.4-200806172000_200911301800)
|
- 2.2% [n/a]
|
Performance criteria not met when compared to 'R-3.4-200806172000_200911301800': Elapsed Process= 0.1s is not within [0%, 110'%] of 71ms
- 45.1% [n/a]
|
+0.9% [n/a]
|
*PackageExplorerPerfTest#testExpand() (vs. R-3.4-200806172000_200911301800)
|
Performance criteria not met when compared to 'R-3.4-200806172000_200911301800': Elapsed Process= 22ms is not within [0%, 110'%] of 16ms
- 37.5% [n/a]
|
+0.0% [n/a]
|
+0.0% [n/a]
|
*PackageExplorerPerfTest#testOpen() (vs. R-3.4-200806172000_200911301800)
|
+6.4% [n/a]
|
Performance criteria not met when compared to 'R-3.4-200806172000_200911301800': Elapsed Process= 89ms is not within [0%, 110'%] of 73ms
- 21.9% [n/a]
|
Performance criteria not met when compared to 'R-3.4-200806172000_201002011800': Elapsed Process= 0.12s is not within [0%, 110'%] of 0.11s
- 14.7% [n/a]
|
*PackageExplorerPerfTest#testSelect() (vs. R-3.4-200806172000_200911301800)
|
- 8.3% [n/a]
|
- 4.3% [n/a]
|
+0.0% [n/a]
|
*PackageExplorerWarmPerfTest#testOpen() (vs. R-3.4-200806172000_200911301800)
|
- 9.9% [±6.7]
|
- 6.8% [±4.3]
|
Performance criteria not met when compared to 'R-3.4-200806172000_201002011800': Elapsed Process= 93ms is not within [0%, 110'%] of 81ms
- 14.8% [±5.6]
|
*TypeHierarchyPerfTest#testOpenCollHierarchy() (vs. R-3.4-200806172000_200911301800)
|
- 3.4% [n/a]
|
+1.9% [n/a]
|
- 2.7% [n/a]
|
*TypeHierarchyPerfTest#testOpenObjectHierarchy() (vs. R-3.4-200806172000_200911301800)
|
+39.9% [n/a]
|
+5.2% [n/a]
|
+1.8% [n/a]
|
*TypeHierarchyPerfTest#testOpenObjectHierarchy2() (vs. R-3.4-200806172000_200911301800)
|
Performance criteria not met when compared to 'R-3.4-200806172000_200911301800': Elapsed Process= 0.46s is not within [0%, 110'%] of 0.36s
- 28.4% [±25.8]
|
+3.2% [±6.4]
|
- 4.6% [±5.5]
|
*IntroduceIndirectionPerfAcceptanceTests#testIntroduceIndirection() (vs. R-3.4-200806172000_200911301800)
|
Performance criteria not met when compared to 'R-3.4-200806172000_200911301800': Elapsed Process= 37.5s is not within [0%, 110'%] of 11.4s
- 229.6% [n/a]
|
Performance criteria not met when compared to 'R-3.4-200806172000_200911301800': Elapsed Process= 27.4s is not within [0%, 110'%] of 9.2s
- 196.3% [n/a]
|
Performance criteria not met when compared to 'R-3.4-200806172000_201002011800': Elapsed Process= 36.5s is not within [0%, 110'%] of 11.9s
- 205.6% [n/a]
|
*MoveCompilationUnitPerfTests1#test_1000_10() (vs. R-3.4-200806172000_200911301800)
|
- 3.0% [n/a]
|
- 8.2% [n/a]
|
Performance criteria not met when compared to 'R-3.4-200806172000_201002011800': Elapsed Process= 22s is not within [0%, 110'%] of 14.9s
- 47.8% [n/a]
|
*MoveCompilationUnitPerfTests1#test_100_10() (vs. R-3.4-200806172000_200911301800)
|
- 3.1% [n/a]
|
- 2.6% [n/a]
|
Performance criteria not met when compared to 'R-3.4-200806172000_201002011800': Elapsed Process= 2.6s is not within [0%, 110'%] of 1.6s
- 62.4% [n/a]
|
*MoveCompilationUnitPerfTests1#test_10_10() (vs. R-3.4-200806172000_200911301800)
|
- 1.8% [±3.9]
|
- 2.5% [±3.1]
|
+0.0% [±4.6]
|
*MoveCompilationUnitPerfTests2#test_10_10() (vs. R-3.4-200806172000_200911301800)
|
- 3.7% [±4.2]
|
- 3.3% [±2.8]
|
+3.8% [±6.2]
|
*MoveCompilationUnitPerfTests2#test_10_100() (vs. R-3.4-200806172000_200911301800)
|
+0.4% [n/a]
|
- 2.4% [n/a]
|
Performance criteria not met when compared to 'R-3.4-200806172000_201002011800': Elapsed Process= 0.97s is not within [0%, 110'%] of 0.58s
- 67.4% [n/a]
|
*MoveCompilationUnitPerfTests2#test_10_1000() (vs. R-3.4-200806172000_200911301800)
|
- 1.5% [n/a]
|
- 1.4% [n/a]
|
- 6.8% [n/a]
|
*MoveStaticMembersPerfTests1#test_1000_10() (vs. R-3.4-200806172000_200911301800)
|
- 2.5% [n/a]
|
- 3.4% [n/a]
|
Performance criteria not met when compared to 'R-3.4-200806172000_201002011800': Elapsed Process= 36.4s is not within [0%, 110'%] of 25.2s
- 44.4% [n/a]
|
*MoveStaticMembersPerfTests1#test_100_10() (vs. R-3.4-200806172000_200911301800)
|
- 3.7% [n/a]
|
- 2.7% [n/a]
|
Performance criteria not met when compared to 'R-3.4-200806172000_201002011800': Elapsed Process= 3.7s is not within [0%, 110'%] of 2.9s
- 27.7% [n/a]
|
*MoveStaticMembersPerfTests1#test_10_10() (vs. R-3.4-200806172000_200911301800)
|
- 2.6% [±3.0]
|
+1.9% [±5.5]
|
+0.0% [±1.7]
|
*MoveStaticMembersPerfTests2#test_10_10() (vs. R-3.4-200806172000_200911301800)
|
- 2.0% [±1.5]
|
- 0.8% [±4.9]
|
Performance criteria not met when compared to 'R-3.4-200806172000_201002011800': Elapsed Process= 0.64s is not within [0%, 110'%] of 0.42s
- 51.7% [±51.9]
|
*MoveStaticMembersPerfTests2#test_10_100() (vs. R-3.4-200806172000_200911301800)
|
Performance criteria not met when compared to 'R-3.4-200806172000_200911301800': Elapsed Process= 1.7s is not within [0%, 110'%] of 1.4s
- 14.2% [n/a]
|
+2.0% [n/a]
|
+8.2% [n/a]
|
*MoveStaticMembersPerfTests2#test_10_1000() (vs. R-3.4-200806172000_200911301800)
|
- 1.4% [n/a]
|
- 1.2% [n/a]
|
- 3.4% [n/a]
|
*RenameMethodPerfTests1#test_1000_10() (vs. R-3.4-200806172000_200911301800)
|
- 4.6% [±2.3]
|
- 3.8% [±1.6]
|
Performance criteria not met when compared to 'R-3.4-200806172000_201002011800': Elapsed Process= 20.7s is not within [0%, 110'%] of 14.3s
- 45.0% [±2.8]
|
*RenameMethodPerfTests1#test_100_10() (vs. R-3.4-200806172000_200911301800)
|
+0.7% [±7.3]
|
- 1.7% [±5.0]
|
Performance criteria not met when compared to 'R-3.4-200806172000_201002011800': Elapsed Process= 2s is not within [0%, 110'%] of 1.3s
- 47.4% [±22.5]
|
*RenameMethodPerfTests1#test_10_10() (vs. R-3.4-200806172000_200911301800)
|
+17.6% [±23.4]
|
- 4.6% [±2.5]
|
- 8.3% [±23.7]
|
*RenameMethodPerfTests2#test_10_10() (vs. R-3.4-200806172000_200911301800)
|
+10.4% [±11.5]
|
- 4.6% [±2.6]
|
Performance criteria not met when compared to 'R-3.4-200806172000_201002011800': Elapsed Process= 0.29s is not within [0%, 110'%] of 0.22s
- 30.5% [±27.7]
|
*RenameMethodPerfTests2#test_10_100() (vs. R-3.4-200806172000_200911301800)
|
- 3.8% [±14.2]
|
- 5.2% [±6.4]
|
- 2.9% [±26.9]
|
*RenameMethodPerfTests2#test_10_1000() (vs. R-3.4-200806172000_200911301800)
|
+0.5% [±0.6]
|
+0.0% [±0.3]
|
- 3.5% [±3.8]
|
*RenameMethodWithOverloadPerfTests#test_1000_10() (vs. R-3.4-200806172000_200911301800)
|
Performance criteria not met when compared to 'R-3.4-200806172000_200911301800': Elapsed Process= 13.6s is not within [0%, 110'%] of 12.4s
- 10.2% [±1.4]
|
- 9.9% [±0.6]
|
Performance criteria not met when compared to 'R-3.4-200806172000_201002011800': Elapsed Process= 28.3s is not within [0%, 110'%] of 22.5s
- 26.0% [±1.7]
|
*RenameMethodWithOverloadPerfTests#test_100_10() (vs. R-3.4-200806172000_200911301800)
|
- 8.7% [±4.8]
|
- 9.7% [±3.5]
|
Performance criteria not met when compared to 'R-3.4-200806172000_201002011800': Elapsed Process= 2.4s is not within [0%, 110'%] of 1.9s
- 30.5% [±13.9]
|
*RenameMethodWithOverloadPerfTests#test_10_10() (vs. R-3.4-200806172000_200911301800)
|
Performance criteria not met when compared to 'R-3.4-200806172000_200911301800': Elapsed Process= 0.24s is not within [0%, 110'%] of 0.21s
- 12.8% [±3.1]
|
Performance criteria not met when compared to 'R-3.4-200806172000_200911301800': Elapsed Process= 0.19s is not within [0%, 110'%] of 0.17s
- 16.2% [±3.4]
|
- 1.3% [±10.1]
|
*RenamePackagePerfTests1#test_1000_10() (vs. R-3.4-200806172000_200911301800)
|
- 4.9% [±2.5]
|
- 6.7% [±1.8]
|
Performance criteria not met when compared to 'R-3.4-200806172000_201002011800': Elapsed Process= 21.1s is not within [0%, 110'%] of 15.3s
- 38.2% [±3.2]
|
*RenamePackagePerfTests1#test_100_10() (vs. R-3.4-200806172000_200911301800)
|
- 3.9% [±4.7]
|
- 0.1% [±5.7]
|
Performance criteria not met when compared to 'R-3.4-200806172000_201002011800': Elapsed Process= 2.1s is not within [0%, 110'%] of 1.6s
- 31.8% [±18.5]
|
*RenamePackagePerfTests1#test_10_10() (vs. R-3.4-200806172000_200911301800)
|
- 2.5% [±3.9]
|
Performance criteria not met when compared to 'R-3.4-200806172000_200911301800': Elapsed Process= 0.21s is not within [0%, 110'%] of 0.16s
- 28.2% [±22.1]
|
+1.2% [±3.9]
|
*RenamePackagePerfTests2#test_10_10() (vs. R-3.4-200806172000_200911301800)
|
- 2.4% [±4.3]
|
Performance criteria not met when compared to 'R-3.4-200806172000_200911301800': Elapsed Process= 0.18s is not within [0%, 110'%] of 0.16s
- 11.8% [±6.1]
|
Performance criteria not met when compared to 'R-3.4-200806172000_201002011800': Elapsed Process= 0.43s is not within [0%, 110'%] of 0.34s
- 24.2% [±22.8]
|
*RenamePackagePerfTests2#test_10_100() (vs. R-3.4-200806172000_200911301800)
|
- 2.9% [±7.9]
|
- 5.8% [±4.6]
|
Performance criteria not met when compared to 'R-3.4-200806172000_201002011800': Elapsed Process= 1.9s is not within [0%, 110'%] of 1.5s
- 25.0% [±20.7]
|
*RenamePackagePerfTests2#test_10_1000() (vs. R-3.4-200806172000_200911301800)
|
- 1.4% [±2.0]
|
- 2.5% [±1.0]
|
Performance criteria not met when compared to 'R-3.4-200806172000_201002011800': Elapsed Process= 23.3s is not within [0%, 110'%] of 17.5s
- 32.8% [±2.8]
|
*RenameTypePerfAcceptanceTests#testWarm() (vs. R-3.4-200806172000_200911301800)
|
- 2.5% [n/a]
|
Performance criteria not met when compared to 'R-3.4-200806172000_200911301800': Elapsed Process= 2.3s is not within [0%, 110'%] of 2s
- 15.7% [n/a]
|
+1.1% [n/a]
|
*RenameTypePerfTests1#test_1000_10() (vs. R-3.4-200806172000_200911301800)
|
- 3.2% [±2.6]
|
- 4.4% [±1.4]
|
Performance criteria not met when compared to 'R-3.4-200806172000_201002011800': Elapsed Process= 20.3s is not within [0%, 110'%] of 14s
- 44.8% [±3.8]
|
*RenameTypePerfTests1#test_100_10() (vs. R-3.4-200806172000_200911301800)
|
- 2.0% [±7.5]
|
+6.5% [±6.5]
|
Performance criteria not met when compared to 'R-3.4-200806172000_201002011800': Elapsed Process= 1.5s is not within [0%, 110'%] of 1.3s
- 15.1% [±18.5]
|
*RenameTypePerfTests1#test_10_10() (vs. R-3.4-200806172000_200911301800)
|
- 9.4% [±7.9]
|
- 2.9% [±3.1]
|
Performance criteria not met when compared to 'R-3.4-200806172000_201002011800': Elapsed Process= 0.33s is not within [0%, 110'%] of 0.26s
- 29.2% [±29.7]
|
*RenameTypePerfTests2#test_10_10() (vs. R-3.4-200806172000_200911301800)
|
- 0.7% [±4.4]
|
- 3.9% [±3.2]
|
+3.9% [±3.8]
|
*RenameTypePerfTests2#test_10_100() (vs. R-3.4-200806172000_200911301800)
|
- 4.0% [±14.4]
|
+3.8% [±9.6]
|
- 1.5% [±8.4]
|
*RenameTypePerfTests2#test_10_1000() (vs. R-3.4-200806172000_200911301800)
|
- 3.2% [±1.7]
|
- 1.5% [±0.1]
|
- 1.9% [±0.7]
|
*ExtractInterfaceHeapAcceptanceTests#testExtractControl() (vs. R-3.4-200806172000_200911301800)
|
- 2.7% [n/a]
|
- 1.4% [n/a]
|
- 1.0% [n/a]
|
*ExtractInterfacePerfAcceptanceTests#testExtractControl() (vs. R-3.4-200806172000_200911301800)
|
+3.0% [n/a]
|
- 1.2% [n/a]
|
- 1.4% [n/a]
|