All 67 scenarios |
SLED 10 Sun 1.5.0_10 (2 x 3.00GHz - 3GB RAM)
| RHEL 5.0 Sun 6.0_04 (2 x 3.00GHz - 3GB RAM)
| Win XP Sun 1.5.0_10 (2 x 3.00GHz - 3GB RAM)
| Win XP Sun 6.0_04 (2 x 3.00GHz - 3GB RAM)
|
*CleanUpPerfTest#testAllCleanUps() (vs. R-3.5-200906111540_201006111800)
|
- 4.7% [±3.1]
|
- 8.6% [±1.4]
|
- 2.3% [±8.5]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006111800': Elapsed Process= 4.2s is not within [0%, 110'%] of 3.7s
- 12.6% [±7.6]
|
*CleanUpPerfTest#testCodeFormatCleanUp() (vs. R-3.5-200906111540_201006111800)
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006111800': Elapsed Process= 0.76s is not within [0%, 110'%] of 0.68s
- 11.3% [±29.4]
|
- 9.5% [±13.5]
|
+17.9% [±24.8]
|
- 5.6% [±28.5]
|
*CleanUpPerfTest#testCodeStyleCleanUp() (vs. R-3.5-200906111540_201006111800)
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006111800': Elapsed Process= 1.4s is not within [0%, 110'%] of 1.2s
- 15.4% [±5.0]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006111800': Elapsed Process= 1.2s is not within [0%, 110'%] of 1.1s
- 12.5% [±0.3]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006041800': Elapsed Process= 1.9s is not within [0%, 110'%] of 1.7s
+6.5% [±19.2]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006111800': Elapsed Process= 1.6s is not within [0%, 110'%] of 1.5s
- 10.8% [±18.6]
|
*CleanUpPerfTest#testControlStatementsCleanUp() (vs. R-3.5-200906111540_201006111800)
|
+6.9% [±12.6]
|
+0.4% [±4.6]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006111800': Elapsed Process= 0.98s is not within [0%, 110'%] of 0.84s
- 16.1% [±32.1]
|
+10.3% [±27.8]
|
*CleanUpPerfTest#testConvertLoopCleanUp() (vs. R-3.5-200906111540_201006111800)
|
+0.0% [±3.3]
|
- 6.1% [±0.9]
|
+0.5% [±1.2]
|
- 4.7% [±1.7]
|
*CleanUpPerfTest#testExpressionsCleanUp() (vs. R-3.5-200906111540_201006111800)
|
+2.6% [±4.3]
|
- 6.9% [±0.2]
|
+26.2% [±27.9]
|
+23.3% [±27.1]
|
*CleanUpPerfTest#testJava50CleanUp() (vs. R-3.5-200906111540_201006111800)
|
- 4.8% [±11.2]
|
- 1.8% [±3.7]
|
+2.4% [±27.8]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006111800': Elapsed Process= 1.1s is not within [0%, 110'%] of 0.94s
- 20.8% [±32.4]
|
*CleanUpPerfTest#testNullCleanUp() (vs. R-3.5-200906111540_201006111800)
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006111800': Elapsed Process= 0.44s is not within [0%, 110'%] of 0.4s
- 10.1% [±10.9]
|
- 5.4% [±5.1]
|
- 1.0% [±6.2]
|
- 9.4% [±5.2]
|
*CleanUpPerfTest#testOrganizeImports() (vs. R-3.5-200906111540_201006111800)
|
+16.0% [±17.3]
|
- 4.9% [±6.3]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006111800': Elapsed Process= 1.3s is not within [0%, 110'%] of 1.1s
- 18.9% [±35.5]
|
- 3.6% [±25.3]
|
*CleanUpPerfTest#testSortMembersCleanUp() (vs. R-3.5-200906111540_201006111800)
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006111800': Elapsed Process= 0.99s is not within [0%, 110'%] of 0.82s
- 20.0% [±17.0]
|
+1.0% [±4.0]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006041800': Elapsed Process= 1.5s is not within [0%, 110'%] of 1.3s
+3.4% [±25.9]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006111800': Elapsed Process= 1.5s is not within [0%, 110'%] of 1.3s
- 19.2% [±26.9]
|
*CleanUpPerfTest#testStringCleanUp() (vs. R-3.5-200906111540_201006111800)
|
- 5.1% [±5.6]
|
- 4.0% [±0.2]
|
- 0.7% [±1.9]
|
- 2.8% [±2.2]
|
*CleanUpPerfTest#testUnnecessaryCodeCleanUp() (vs. R-3.5-200906111540_201006111800)
|
+23.3% [±19.4]
|
- 8.0% [±0.3]
|
- 4.3% [±1.3]
|
- 6.9% [±1.4]
|
*CleanUpPerfTest#testUnusedCodeCleanUp() (vs. R-3.5-200906111540_201006111800)
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006111800': Elapsed Process= 0.31s is not within [0%, 110'%] of 0.27s
- 14.7% [±11.8]
|
- 7.7% [±0.5]
|
- 2.7% [±1.3]
|
- 8.0% [±1.0]
|
*CleanUpPerfTest#testVariableDeclarationCleanUp() (vs. R-3.5-200906111540_201006111800)
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006041800': Elapsed Process= 1.3s is not within [0%, 110'%] of 1.1s
- 8.2% [±13.5]
|
- 5.2% [±0.2]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006041800': Elapsed Process= 1.8s is not within [0%, 110'%] of 1.6s
+5.9% [±20.7]
|
+2.6% [±18.9]
|
*OpenTypePerfTest#testColdException() (vs. R-3.5-200906111540_201006111800)
|
+11.6% [n/a]
|
+16.2% [n/a]
|
+13.2% [n/a]
|
+0.0% [n/a]
|
*OpenTypePerfTest#testWarmException() (vs. R-3.5-200906111540_201006111800)
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006111800': Elapsed Process= 0.28s is not within [0%, 110'%] of 0.24s
- 16.8% [n/a]
|
+22.8% [n/a]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006041800': Elapsed Process= 0.12s is not within [0%, 110'%] of 0.11s
+0.0% [n/a]
|
- 6.4% [n/a]
|
*OpenTypePerfTest#testWarmException10() (vs. R-3.5-200906111540_201006111800)
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006111800': Elapsed Process= 0.28s is not within [0%, 110'%] of 0.24s
- 17.8% [±3.1]
|
+21.6% [±2.9]
|
- 8.3% [±4.8]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201005281800': Elapsed Process= 0.27s is not within [0%, 110'%] of 0.24s
- 2.2% [±15.4]
|
*OpenTypePerfTest#testWarmOpenSWT() (vs. R-3.5-200906111540_201006111800)
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006111800': Elapsed Process= 0.58s is not within [0%, 110'%] of 0.3s
- 91.4% [n/a]
|
+10.1% [n/a]
|
+5.3% [n/a]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006111800': Elapsed Process= 0.59s is not within [0%, 110'%] of 0.52s
- 15.3% [n/a]
|
*OpenTypePerfTest#testWarmOpenSWTHistory10() (vs. R-3.5-200906111540_201006111800)
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006111800': Elapsed Process= 0.28s is not within [0%, 110'%] of 0.25s
- 11.6% [±1.3]
|
+20.6% [±2.5]
|
- 4.6% [±2.2]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006111800': Elapsed Process= 0.44s is not within [0%, 110'%] of 0.39s
- 12.5% [±2.5]
|
*OpenTypePerfTest#testWarmS10() (vs. R-3.5-200906111540_201006111800)
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006111800': Elapsed Process= 0.28s is not within [0%, 110'%] of 0.25s
- 12.3% [±2.2]
|
+18.9% [±3.1]
|
- 3.0% [±6.2]
|
- 2.9% [±1.4]
|
*OrganizeImportsPerfTest#testOrganizeImport() (vs. R-3.5-200906111540_201006111800)
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006111800': Elapsed Process= 0.13s is not within [0%, 110'%] of 96ms
- 37.5% [±9.1]
|
+13.8% [±9.9]
|
+9.4% [±9.1]
|
+13.0% [±8.9]
|
*PackageExplorerColdPerfTest#testOpen() (vs. R-3.5-200906111540_201006111800)
|
+4.3% [n/a]
|
+4.8% [n/a]
|
+48.4% [n/a]
|
+48.4% [n/a]
|
*PackageExplorerEmptyPerfTest#testOpen() (vs. R-3.5-200906111540_201006111800)
|
+5.0% [n/a]
|
+27.0% [n/a]
|
+12.0% [n/a]
|
+0.0% [n/a]
|
*PackageExplorerPerfTest#testExpand() (vs. R-3.5-200906111540_201006111800)
|
- 4.5% [n/a]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006041800': Elapsed Process= 19ms is not within [0%, 110'%] of 17ms
+0.0% [n/a]
|
+48.4% [n/a]
|
+0.0% [n/a]
|
*PackageExplorerPerfTest#testOpen() (vs. R-3.5-200906111540_201006111800)
|
+0.0% [n/a]
|
+8.1% [n/a]
|
+12.8% [n/a]
|
+0.6% [n/a]
|
*PackageExplorerPerfTest#testSelect() (vs. R-3.5-200906111540_201006111800)
|
+3.8% [n/a]
|
+7.4% [n/a]
|
+0.0% [n/a]
|
+0.0% [n/a]
|
*PackageExplorerWarmPerfTest#testOpen() (vs. R-3.5-200906111540_201006111800)
|
+3.9% [±5.3]
|
+5.9% [±4.5]
|
+1.1% [±5.2]
|
+0.9% [±3.3]
|
*TypeHierarchyPerfTest#testOpenCollHierarchy() (vs. R-3.5-200906111540_201006111800)
|
+95.5% [n/a]
|
+86.2% [n/a]
|
+86.1% [n/a]
|
+81.3% [n/a]
|
*TypeHierarchyPerfTest#testOpenObjectHierarchy() (vs. R-3.5-200906111540_201006111800)
|
+68.4% [n/a]
|
+64.9% [n/a]
|
+65.5% [n/a]
|
+43.8% [n/a]
|
*TypeHierarchyPerfTest#testOpenObjectHierarchy2() (vs. R-3.5-200906111540_201006111800)
|
+60.9% [±4.5]
|
+52.1% [±6.7]
|
+61.0% [±4.2]
|
+28.0% [±2.2]
|
*IntroduceIndirectionPerfAcceptanceTests#testIntroduceIndirection() (vs. R-3.5-200906111540_201006111800)
|
+3.8% [n/a]
|
- 7.0% [n/a]
|
- 1.8% [n/a]
|
- 1.0% [n/a]
|
*MoveCompilationUnitPerfTests1#test_1000_10() (vs. R-3.5-200906111540_201006111800)
|
+1.9% [n/a]
|
- 1.2% [n/a]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006111800': Elapsed Process= 22.9s is not within [0%, 110'%] of 15.4s
- 48.9% [n/a]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006111800': Elapsed Process= 14.2s is not within [0%, 110'%] of 12.4s
- 14.4% [n/a]
|
*MoveCompilationUnitPerfTests1#test_100_10() (vs. R-3.5-200906111540_201006111800)
|
+1.4% [n/a]
|
- 6.9% [n/a]
|
- 1.9% [n/a]
|
+23.1% [n/a]
|
*MoveCompilationUnitPerfTests1#test_10_10() (vs. R-3.5-200906111540_201006111800)
|
+1.8% [±4.3]
|
- 1.6% [±3.9]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006041800': Elapsed Process= 0.26s is not within [0%, 110'%] of 0.22s
+35.6% [±34.9]
|
- 3.1% [±4.7]
|
*MoveCompilationUnitPerfTests2#test_10_10() (vs. R-3.5-200906111540_201006111800)
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006111800': Elapsed Process= 0.49s is not within [0%, 110'%] of 0.18s
- 175.8% [±184.0]
|
- 0.8% [±3.3]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006041800': Elapsed Process= 0.24s is not within [0%, 110'%] of 0.22s
+7.9% [±5.3]
|
+0.0% [±4.3]
|
*MoveCompilationUnitPerfTests2#test_10_100() (vs. R-3.5-200906111540_201006111800)
|
- 3.8% [n/a]
|
- 1.0% [n/a]
|
+5.4% [n/a]
|
+44.8% [n/a]
|
*MoveCompilationUnitPerfTests2#test_10_1000() (vs. R-3.5-200906111540_201006111800)
|
+1.8% [n/a]
|
- 1.2% [n/a]
|
- 0.5% [n/a]
|
+0.5% [n/a]
|
*MoveStaticMembersPerfTests1#test_1000_10() (vs. R-3.5-200906111540_201006111800)
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006041800': Elapsed Process= 18.2s is not within [0%, 110'%] of 16.3s
- 7.9% [n/a]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006111800': Elapsed Process= 15.8s is not within [0%, 110'%] of 14.2s
- 11.2% [n/a]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006111800': Elapsed Process= 34.5s is not within [0%, 110'%] of 25.9s
- 33.0% [n/a]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006111800': Elapsed Process= 24.6s is not within [0%, 110'%] of 21.6s
- 14.1% [n/a]
|
*MoveStaticMembersPerfTests1#test_100_10() (vs. R-3.5-200906111540_201006111800)
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006111800': Elapsed Process= 2.6s is not within [0%, 110'%] of 2.4s
- 12.4% [n/a]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006111800': Elapsed Process= 2.1s is not within [0%, 110'%] of 1.8s
- 11.3% [n/a]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006111800': Elapsed Process= 3.2s is not within [0%, 110'%] of 2.9s
- 10.3% [n/a]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006111800': Elapsed Process= 2.3s is not within [0%, 110'%] of 2.1s
- 11.3% [n/a]
|
*MoveStaticMembersPerfTests1#test_10_10() (vs. R-3.5-200906111540_201006111800)
|
- 6.6% [±1.2]
|
- 9.1% [±4.3]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006041800': Elapsed Process= 0.46s is not within [0%, 110'%] of 0.39s
+15.3% [±23.7]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006111800': Elapsed Process= 0.43s is not within [0%, 110'%] of 0.3s
- 43.8% [±36.2]
|
*MoveStaticMembersPerfTests2#test_10_10() (vs. R-3.5-200906111540_201006111800)
|
- 6.3% [±2.7]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006041800': Elapsed Process= 0.29s is not within [0%, 110'%] of 0.26s
- 9.9% [±4.4]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006041800': Elapsed Process= 0.44s is not within [0%, 110'%] of 0.38s
+28.8% [±30.2]
|
- 5.1% [±4.4]
|
*MoveStaticMembersPerfTests2#test_10_100() (vs. R-3.5-200906111540_201006111800)
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006111800': Elapsed Process= 2.2s is not within [0%, 110'%] of 1.7s
- 26.5% [n/a]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006111800': Elapsed Process= 1.6s is not within [0%, 110'%] of 1.1s
- 47.7% [n/a]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006111800': Elapsed Process= 2.2s is not within [0%, 110'%] of 1.7s
- 27.0% [n/a]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006111800': Elapsed Process= 1.6s is not within [0%, 110'%] of 1.3s
- 20.5% [n/a]
|
*MoveStaticMembersPerfTests2#test_10_1000() (vs. R-3.5-200906111540_201006111800)
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006111800': Elapsed Process= 1mn 7s is not within [0%, 110'%] of 8.6s
- 691.5% [n/a]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006111800': Elapsed Process= 57.8s is not within [0%, 110'%] of 7.8s
- 640.0% [n/a]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006111800': Elapsed Process= 1mn 11s is not within [0%, 110'%] of 8.8s
- 711.3% [n/a]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006111800': Elapsed Process= 58.1s is not within [0%, 110'%] of 7.2s
- 701.3% [n/a]
|
*RenameMethodPerfTests1#test_1000_10() (vs. R-3.5-200906111540_201006111800)
|
- 1.2% [±2.7]
|
- 1.5% [±1.3]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006111800': Elapsed Process= 22s is not within [0%, 110'%] of 15.1s
- 45.9% [±4.3]
|
- 0.5% [±2.6]
|
*RenameMethodPerfTests1#test_100_10() (vs. R-3.5-200906111540_201006111800)
|
+7.5% [±11.8]
|
+2.9% [±6.5]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006111800': Elapsed Process= 1.6s is not within [0%, 110'%] of 1.4s
- 16.5% [±18.8]
|
- 1.2% [±15.9]
|
*RenameMethodPerfTests1#test_10_10() (vs. R-3.5-200906111540_201006111800)
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006111800': Elapsed Process= 0.25s is not within [0%, 110'%] of 0.15s
- 64.0% [±63.7]
|
- 0.9% [±2.8]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006041800': Elapsed Process= 0.26s is not within [0%, 110'%] of 0.19s
- 3.9% [±23.3]
|
+18.1% [±18.5]
|
*RenameMethodPerfTests2#test_10_10() (vs. R-3.5-200906111540_201006111800)
|
+0.7% [±4.4]
|
+1.7% [±3.6]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006041800': Elapsed Process= 0.23s is not within [0%, 110'%] of 0.19s
+0.9% [±3.8]
|
+24.5% [±17.9]
|
*RenameMethodPerfTests2#test_10_100() (vs. R-3.5-200906111540_201006111800)
|
+0.0% [±14.7]
|
- 2.1% [±6.9]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006041800': Elapsed Process= 0.34s is not within [0%, 110'%] of 0.26s
- 2.4% [±26.6]
|
+7.1% [±13.2]
|
*RenameMethodPerfTests2#test_10_1000() (vs. R-3.5-200906111540_201006111800)
|
- 0.4% [±0.3]
|
- 0.6% [±0.1]
|
+2.0% [±2.6]
|
- 3.0% [±2.2]
|
*RenameMethodWithOverloadPerfTests#test_1000_10() (vs. R-3.5-200906111540_201006111800)
|
- 1.2% [±1.5]
|
- 2.9% [±0.5]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006111800': Elapsed Process= 30.3s is not within [0%, 110'%] of 24.3s
- 24.7% [±1.9]
|
- 1.1% [±1.8]
|
*RenameMethodWithOverloadPerfTests#test_100_10() (vs. R-3.5-200906111540_201006111800)
|
- 2.0% [±5.5]
|
- 1.3% [±4.5]
|
- 2.5% [±11.0]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006111800': Elapsed Process= 2s is not within [0%, 110'%] of 1.8s
- 10.0% [±11.0]
|
*RenameMethodWithOverloadPerfTests#test_10_10() (vs. R-3.5-200906111540_201006111800)
|
+0.8% [±3.2]
|
- 3.7% [±3.6]
|
+2.2% [±3.4]
|
- 3.1% [±2.1]
|
*RenamePackagePerfTests1#test_1000_10() (vs. R-3.5-200906111540_201006111800)
|
- 3.0% [±2.4]
|
- 3.4% [±1.4]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006111800': Elapsed Process= 23.6s is not within [0%, 110'%] of 16.6s
- 42.3% [±3.1]
|
- 2.9% [±2.8]
|
*RenamePackagePerfTests1#test_100_10() (vs. R-3.5-200906111540_201006111800)
|
- 2.6% [±4.9]
|
- 2.7% [±4.8]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006111800': Elapsed Process= 2s is not within [0%, 110'%] of 1.7s
- 17.5% [±17.9]
|
- 9.7% [±16.0]
|
*RenamePackagePerfTests1#test_10_10() (vs. R-3.5-200906111540_201006111800)
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006111800': Elapsed Process= 0.26s is not within [0%, 110'%] of 0.21s
- 25.1% [±24.3]
|
- 6.0% [±3.5]
|
- 6.9% [±17.6]
|
+8.2% [±10.7]
|
*RenamePackagePerfTests2#test_10_10() (vs. R-3.5-200906111540_201006111800)
|
- 1.9% [±4.5]
|
- 4.8% [±3.8]
|
+6.0% [±10.1]
|
+3.6% [±10.2]
|
*RenamePackagePerfTests2#test_10_100() (vs. R-3.5-200906111540_201006111800)
|
- 3.9% [±5.7]
|
- 4.8% [±4.9]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006111800': Elapsed Process= 1.8s is not within [0%, 110'%] of 1.5s
- 22.8% [±21.6]
|
- 6.3% [±16.1]
|
*RenamePackagePerfTests2#test_10_1000() (vs. R-3.5-200906111540_201006111800)
|
+0.3% [±1.6]
|
- 1.9% [±1.1]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006111800': Elapsed Process= 24.6s is not within [0%, 110'%] of 19.2s
- 28.0% [±2.9]
|
- 2.5% [±2.3]
|
*RenameTypePerfAcceptanceTests#testWarm() (vs. R-3.5-200906111540_201006111800)
|
+2.7% [n/a]
|
- 0.2% [n/a]
|
- 2.3% [n/a]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006111800': Elapsed Process= 3s is not within [0%, 110'%] of 2.2s
- 40.5% [n/a]
|
*RenameTypePerfTests1#test_1000_10() (vs. R-3.5-200906111540_201006111800)
|
+0.0% [±2.7]
|
- 1.5% [±1.2]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006111800': Elapsed Process= 22s is not within [0%, 110'%] of 15s
- 47.4% [±3.6]
|
- 0.8% [±3.2]
|
*RenameTypePerfTests1#test_100_10() (vs. R-3.5-200906111540_201006111800)
|
+0.6% [±7.3]
|
+2.5% [±5.8]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006111800': Elapsed Process= 1.6s is not within [0%, 110'%] of 1.3s
- 18.4% [±19.6]
|
+0.0% [±16.5]
|
*RenameTypePerfTests1#test_10_10() (vs. R-3.5-200906111540_201006111800)
|
- 0.7% [±4.0]
|
+11.4% [±9.1]
|
+18.4% [±17.1]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006111800': Elapsed Process= 0.17s is not within [0%, 110'%] of 0.14s
- 16.8% [±16.4]
|
*RenameTypePerfTests2#test_10_10() (vs. R-3.5-200906111540_201006111800)
|
+1.4% [±4.3]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006041800': Elapsed Process= 0.12s is not within [0%, 110'%] of 0.11s
- 8.0% [±12.3]
|
- 1.9% [±22.5]
|
- 2.1% [±3.0]
|
*RenameTypePerfTests2#test_10_100() (vs. R-3.5-200906111540_201006111800)
|
+12.1% [±16.6]
|
- 2.6% [±6.3]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006111800': Elapsed Process= 0.32s is not within [0%, 110'%] of 0.26s
- 20.2% [±21.0]
|
+22.4% [±18.3]
|
*RenameTypePerfTests2#test_10_1000() (vs. R-3.5-200906111540_201006111800)
|
- 0.7% [±1.3]
|
- 0.8% [±0.3]
|
+3.7% [±2.7]
|
- 3.1% [±1.7]
|
*ExtractInterfaceHeapAcceptanceTests#testExtractControl() (vs. R-3.5-200906111540_201006111800)
|
+6.2% [n/a]
|
- 2.1% [n/a]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201006111800': Elapsed Process= 18.9s is not within [0%, 110'%] of 16.4s
- 15.1% [n/a]
|
+0.8% [n/a]
|
*ExtractInterfacePerfAcceptanceTests#testExtractControl() (vs. R-3.5-200906111540_201006111800)
|
+6.3% [n/a]
|
- 8.8% [n/a]
|
- 0.8% [n/a]
|
- 3.2% [n/a]
|