All 52 scenarios |
SLED 10 Sun 1.5.0_10 (2 x 3.00GHz - 3GB RAM)
| RHEL 5.0 Sun 6.0_04 (2 x 3.00GHz - 3GB RAM)
| Win XP Sun 1.5.0_10 (2 x 3.00GHz - 3GB RAM)
|
BenchFileStore#testStoreExists()
|
+1.2% [±1.5]
|
- 1.5% [±1.9]
|
- 1.1% [±2.3]
|
BenchFileStore#testStoreIsReadOnly()
|
+2.4% [±0.5]
|
- 1.5% [±1.1]
|
+1.3% [±0.4]
|
BenchFileStore#testStoreLastModified()
|
+2.4% [±0.5]
|
+0.0% [±0.9]
|
+0.0% [±0.4]
|
BenchMiscWorkspace#testGetProject()
|
- 5.3% [±0.9]
|
- 0.4% [±0.9]
|
+0.5% [±0.7]
|
BenchMiscWorkspace#testNoOp()
|
- 1.3% [±2.1]
|
+0.0% [±1.5]
|
+0.2% [±2.1]
|
BenchWorkspace#testCountResources()
|
+6.8% [±2.0]
|
+17.4% [±13.1]
|
Performance criteria not met when compared to 'R-3.4-200806172000_200906121800': Elapsed Process= 0.1s is not within [0%, 110'%] of 90ms
- 12.2% [±5.1]
|
BenchWorkspace#testCountResourcesDuringOperation()
|
- 0.5% [±0.7]
|
- 1.2% [±0.4]
|
- 1.9% [±0.7]
|
BenchWorkspace#testFindMaxProblemSeverity()
|
- 0.3% [±0.4]
|
+3.5% [±0.4]
|
- 0.5% [±0.1]
|
BuilderPerformanceTest#testManualBuildWithAutobuildOn()
|
Performance criteria not met when compared to 'R-3.4-200806172000_200906121800': Elapsed Process= 7.9s is not within [0%, 110'%] of 0.32s
- 2,368.0% [±8.1]
|
Performance criteria not met when compared to 'R-3.4-200806172000_200906121800': Elapsed Process= 9.6s is not within [0%, 110'%] of 0.3s
- 3,112.7% [±0.9]
|
Performance criteria not met when compared to 'R-3.4-200806172000_200906121800': Elapsed Process= 7.8s is not within [0%, 110'%] of 0.42s
- 1,747.4% [±27.1]
|
LocalHistoryPerformanceTest#testAddState()
|
- 2.6% [±5.6]
|
+6.5% [±6.5]
|
- 3.4% [±16.4]
|
LocalHistoryPerformanceTest#testBug28603()
|
Performance criteria not met when compared to 'R-3.4-200806172000_200906121800': Elapsed Process= 49ms is not within [0%, 110'%] of 27ms
- 81.5% [±81.2]
|
+0.0% [±8.5]
|
+1.2% [±7.0]
|
LocalHistoryPerformanceTest#testClearHistory100x4()
|
+13.3% [±19.4]
|
Performance criteria not met when compared to 'R-3.4-200806172000_200906121800': Elapsed Process= 11ms is not within [0%, 110'%] of 10ms
- 10.0% [±33.2]
|
+3.7% [±16.5]
|
LocalHistoryPerformanceTest#testClearHistory20x20()
|
Performance criteria not met when compared to 'R-3.4-200806172000_200906121800': Elapsed Process= 7ms is not within [0%, 110'%] of 6ms
- 16.7% [±6.4]
|
Performance criteria not met when compared to 'R-3.4-200806172000_200906121800': Elapsed Process= 6ms is not within [0%, 110'%] of 5ms
- 20.0% [±15.8]
|
+5.7% [±12.5]
|
LocalHistoryPerformanceTest#testClearHistory4x100()
|
+12.5% [±31.8]
|
+0.0% [±7.1]
|
+0.0% [±0.6]
|
LocalHistoryPerformanceTest#testCopyHistory100x4()
|
+1.9% [±1.9]
|
+6.6% [±3.9]
|
- 1.0% [±10.4]
|
LocalHistoryPerformanceTest#testCopyHistory20x20()
|
+0.0% [±1.2]
|
+14.1% [±4.8]
|
Performance criteria not met when compared to 'R-3.4-200806172000_200906121800': Elapsed Process= 0.73s is not within [0%, 110'%] of 0.58s
- 26.3% [±37.6]
|
LocalHistoryPerformanceTest#testCopyHistory4x100()
|
+2.6% [±3.6]
|
+8.0% [±9.1]
|
+31.8% [±27.5]
|
LocalHistoryPerformanceTest#testGetDeletedMembers100x4()
|
+4.2% [±16.3]
|
- 5.6% [±11.5]
|
Performance criteria not met when compared to 'R-3.4-200806172000_200906121800': Elapsed Process= 39ms is not within [0%, 110'%] of 31ms
- 25.8% [±25.8]
|
LocalHistoryPerformanceTest#testGetDeletedMembers20x20()
|
Performance criteria not met when compared to 'R-3.4-200806172000_200906121800': Elapsed Process= 13ms is not within [0%, 110'%] of 11ms
- 18.2% [±22.7]
|
Performance criteria not met when compared to 'R-3.4-200806172000_200906121800': Elapsed Process= 9ms is not within [0%, 110'%] of 8ms
- 12.5% [±31.2]
|
+0.0% [±46.1]
|
LocalHistoryPerformanceTest#testGetDeletedMembers4x100()
|
Performance criteria not met when compared to 'R-3.4-200806172000_200906121800': Elapsed Process= 10ms is not within [0%, 110'%] of 8ms
- 25.0% [±25.8]
|
Performance criteria not met when compared to 'R-3.4-200806172000_200906121800': Elapsed Process= 8ms is not within [0%, 110'%] of 6ms
- 33.3% [±26.4]
|
+6.2% [±3.1]
|
LocalHistoryPerformanceTest#testGetHistory()
|
+0.0% [n/a]
|
+22.2% [n/a]
|
[n/a]
|
LocalHistoryPerformanceTest#testHistoryCleanUp100x4()
|
+1.4% [±8.1]
|
+4.7% [±7.1]
|
+20.3% [±16.5]
|
LocalHistoryPerformanceTest#testHistoryCleanUp20x20()
|
+0.9% [±1.9]
|
+4.7% [±1.5]
|
+12.6% [±18.2]
|
MarkerPerformanceTest#testSetAttributes1()
|
- 9.6% [n/a]
|
- 7.8% [n/a]
|
+1.8% [n/a]
|
MarkerPerformanceTest#testSetAttributes2()
|
+1.3% [n/a]
|
- 7.2% [n/a]
|
+0.7% [n/a]
|
PropertyManagerPerformanceTest#testGetProperty100x4()
|
- 0.5% [±1.5]
|
- 1.2% [±1.7]
|
+0.0% [±2.5]
|
PropertyManagerPerformanceTest#testGetProperty20x20()
|
- 0.7% [±0.3]
|
- 0.3% [±0.2]
|
- 0.4% [±0.5]
|
PropertyManagerPerformanceTest#testGetProperty4x100()
|
+0.2% [±0.1]
|
- 0.5% [±0.1]
|
- 0.5% [±0.6]
|
PropertyManagerPerformanceTest#testSetProperty100x4()
|
+0.5% [±1.1]
|
+0.4% [±2.3]
|
- 6.3% [±9.3]
|
PropertyManagerPerformanceTest#testSetProperty20x20()
|
- 0.6% [±1.5]
|
+0.0% [±1.5]
|
Performance criteria not met when compared to 'R-3.4-200806172000_200906121800': Elapsed Process= 0.53s is not within [0%, 110'%] of 0.48s
- 11.2% [±15.6]
|
PropertyManagerPerformanceTest#testSetProperty4x100()
|
- 2.0% [±1.2]
|
+1.1% [±1.8]
|
Performance criteria not met when compared to 'R-3.4-200806172000_200906121800': Elapsed Process= 0.44s is not within [0%, 110'%] of 0.4s
- 12.4% [±16.6]
|
WorkspacePerformanceTest#testCreateResources()
|
- 1.4% [±0.8]
|
+10.9% [±11.2]
|
- 0.2% [±1.6]
|
WorkspacePerformanceTest#testDeleteProject()
|
+4.3% [±9.4]
|
- 0.9% [±7.7]
|
- 4.5% [±2.1]
|
WorkspacePerformanceTest#testFolderCopy()
|
+10.3% [±13.8]
|
- 1.8% [±3.9]
|
- 1.3% [±0.8]
|
WorkspacePerformanceTest#testFolderMove()
|
- 1.1% [±1.4]
|
+0.2% [±2.4]
|
+7.2% [±6.5]
|
WorkspacePerformanceTest#testRefreshProject()
|
- 0.5% [±0.3]
|
- 0.3% [±0.6]
|
+0.7% [±0.5]
|
BenchPath#testHash()
|
- 2.9% [±0.3]
|
+1.2% [±0.2]
|
- 0.7% [±0.4]
|
BenchPath#testPathCreation()
|
+1.9% [±0.2]
|
+0.8% [±0.5]
|
+2.0% [±0.3]
|
BenchPath#testToOSString()
|
+2.3% [±0.6]
|
+0.7% [±0.6]
|
+1.8% [±1.0]
|
BenchPath#testToString()
|
+0.0% [±0.6]
|
+2.1% [±0.8]
|
+3.2% [±0.8]
|
*ContentTypePerformanceTest#testContentMatching() (vs. I20090407-1430)
|
+0.5% [±1.2]
|
- 0.7% [±1.1]
|
- 0.5% [±1.5]
|
*ContentTypePerformanceTest#testIsKindOf() (vs. I20090407-1430)
|
+0.6% [±1.7]
|
- 4.5% [±0.7]
|
- 9.1% [±1.4]
|
ContentTypePerformanceTest#testLoadCatalog()
|
Performance criteria not met when compared to 'R-3.4-200806172000_200906121800': Elapsed Process= 49ms is not within [0%, 110'%] of 35ms
- 40.0% [n/a]
|
Performance criteria not met when compared to 'R-3.4-200806172000_200906121800': Elapsed Process= 73ms is not within [0%, 110'%] of 33ms
- 121.2% [n/a]
|
Performance criteria not met when compared to 'R-3.4-200806172000_200906121800': Elapsed Process= 54ms is not within [0%, 110'%] of 31ms
- 74.2% [n/a]
|
ContentTypePerformanceTest#testNameMatching()
|
+29.2% [±1.0]
|
+28.7% [±1.1]
|
+33.8% [±0.9]
|
PreferencePerformanceTest#testGetStringCommonPrefixKeys()
|
+9.2% [±0.8]
|
- 4.1% [±1.8]
|
+3.9% [±0.9]
|
PreferencePerformanceTest#testGetStringMisses()
|
+16.5% [±0.3]
|
+3.8% [±0.2]
|
+11.3% [±2.1]
|
PreferencePerformanceTest#testGetStringSequentialKeys()
|
+7.2% [±0.2]
|
+0.2% [±0.3]
|
+8.1% [±2.2]
|
PreferencePerformanceTest#testGetStringUniqueKeys()
|
+7.3% [±1.0]
|
+1.8% [±1.2]
|
+11.1% [±1.8]
|
PreferencePerformanceTest#testPutStringKeys()
|
+9.0% [±0.5]
|
- 4.5% [±1.0]
|
+1.3% [±1.5]
|
PreferencePerformanceTest#testRemoveStringKeys()
|
+0.0% [±0.5]
|
+0.0% [±0.4]
|
- 3.8% [±3.0]
|
StartupTest.testApplicationStartup
|
- 4.4% [±8.7]
|
Performance criteria not met when compared to 'R-3.4-200806172000_200906121800': Elapsed Process= 1s is not within [0%, 110'%] of 0.86s
- 17.3% [±1.7]
|
Performance criteria not met when compared to 'R-3.4-200806172000_200906121800': Elapsed Process= 1.6s is not within [0%, 110'%] of 1.3s
- 15.8% [±0.5]
|
UIStartupTest.testUIApplicationStartup
|
- 2.9% [±7.9]
|
- 8.8% [±10.6]
|
- 2.8% [±9.6]
|