All 55 scenarios |
SLED 10 Sun 1.6.0_17 (2 x 3.00GHz - 3GB RAM)
| RHEL 5.0 Sun 6.0_04 (2 x 3.00GHz - 3GB RAM)
| Win XP Sun 1.6.0_17 (2 x 3.00GHz - 3GB RAM)
| Win XP Sun 1.6.0_17 (2 x 3.00GHz - 3GB RAM)
|
BenchFileStore#testStoreExists()
|
+3.3% [±2.2]
|
+8.1% [±2.1]
| n/a | n/a |
BenchFileStore#testStoreIsReadOnly()
|
+4.8% [±1.1]
|
+12.3% [±1.3]
| n/a | n/a |
BenchFileStore#testStoreLastModified()
|
+3.3% [±0.7]
|
+12.3% [±0.7]
| n/a | n/a |
BenchMiscWorkspace#testGetProject()
|
- 4.2% [±1.2]
|
- 3.0% [±1.2]
| n/a | n/a |
BenchMiscWorkspace#testNoOp()
|
+0.8% [±2.1]
|
+0.0% [±1.4]
| n/a | n/a |
BenchWorkspace#testCountResources()
|
- 9.5% [±11.1]
|
+2.1% [±0.3]
| n/a | n/a |
BenchWorkspace#testCountResourcesDuringOperation()
|
- 0.7% [±0.4]
|
+9.1% [±0.5]
| n/a | n/a |
BenchWorkspace#testFindMaxProblemSeverity()
|
+0.8% [±0.5]
|
- 2.1% [±0.5]
| n/a | n/a |
BuilderPerformanceTest#testManualBuildWithAutobuildOn()
|
Performance criteria not met when compared to 'R-3.6-201006080911_201109021800': Elapsed Process= 0.56s is not within [0%, 110'%] of 0.4s
- 40.4% [±34.7]
|
- 3.1% [±2.0]
| n/a | n/a |
FileSystemPerformanceTest#testPutFileInfo()
|
+2.8% [±14.2]
|
+8.5% [±4.8]
| n/a | n/a |
LocalHistoryPerformanceTest#testAddState()
|
+0.0% [±5.3]
|
- 3.2% [±5.5]
| n/a | n/a |
LocalHistoryPerformanceTest#testBug28603()
|
- 4.2% [±4.4]
|
+0.0% [±2.4]
| n/a | n/a |
LocalHistoryPerformanceTest#testClearHistory100x4()
|
+0.0% [±27.2]
|
+0.0% [±19.1]
| n/a | n/a |
LocalHistoryPerformanceTest#testClearHistory20x20()
|
Performance criteria not met when compared to 'R-3.6-201006080911_201109021800': Elapsed Process= 6ms is not within [0%, 110'%] of 5ms
- 20.0% [±9.6]
|
+16.7% [±5.9]
| n/a | n/a |
LocalHistoryPerformanceTest#testClearHistory4x100()
|
+0.0% [±7.1]
|
Performance criteria not met when compared to 'R-3.6-201006080911_201109021800': Elapsed Process= 7ms is not within [0%, 110'%] of 5ms
- 40.0% [±32.5]
| n/a | n/a |
LocalHistoryPerformanceTest#testCopyHistory100x4()
|
+1.3% [±1.5]
|
+20.2% [±7.7]
| n/a | n/a |
LocalHistoryPerformanceTest#testCopyHistory20x20()
|
+1.9% [±1.1]
|
+3.3% [±1.5]
| n/a | n/a |
LocalHistoryPerformanceTest#testCopyHistory4x100()
|
+0.0% [±4.6]
|
+3.2% [±3.3]
| n/a | n/a |
LocalHistoryPerformanceTest#testGetDeletedMembers100x4()
|
+0.0% [±16.2]
|
Performance criteria not met when compared to 'R-3.6-201006080911_201109021800': Elapsed Process= 19ms is not within [0%, 110'%] of 17ms
- 11.8% [±9.3]
| n/a | n/a |
LocalHistoryPerformanceTest#testGetDeletedMembers20x20()
|
+0.0% [±0.0]
|
+0.0% [±6.2]
| n/a | n/a |
LocalHistoryPerformanceTest#testGetDeletedMembers4x100()
|
+25.0% [±19.8]
|
+12.5% [±18.7]
| n/a | n/a |
LocalHistoryPerformanceTest#testGetHistory()
|
+0.0% [n/a]
|
Performance criteria not met when compared to 'R-3.6-201006080911_201109021800': Elapsed Process= 8ms is not within [0%, 110'%] of 7ms
- 14.3% [n/a]
| n/a | n/a |
LocalHistoryPerformanceTest#testHistoryCleanUp100x4()
|
+2.0% [±7.2]
|
- 1.0% [±7.8]
| n/a | n/a |
LocalHistoryPerformanceTest#testHistoryCleanUp20x20()
|
+1.0% [±1.6]
|
+2.8% [±1.7]
| n/a | n/a |
MarkerPerformanceTest#testSetAttributes1()
|
- 8.2% [n/a]
|
- 1.3% [n/a]
| n/a | n/a |
MarkerPerformanceTest#testSetAttributes2()
|
- 5.1% [n/a]
|
- 2.5% [n/a]
| n/a | n/a |
PropertyManagerPerformanceTest#testGetProperty100x4()
|
- 0.6% [±1.5]
|
+1.7% [±1.5]
| n/a | n/a |
PropertyManagerPerformanceTest#testGetProperty20x20()
|
- 0.3% [±0.2]
|
+1.3% [±0.2]
| n/a | n/a |
PropertyManagerPerformanceTest#testGetProperty4x100()
|
- 0.9% [±0.1]
|
+0.7% [±0.1]
| n/a | n/a |
PropertyManagerPerformanceTest#testSetProperty100x4()
|
+2.4% [±0.6]
|
+0.4% [±0.4]
| n/a | n/a |
PropertyManagerPerformanceTest#testSetProperty20x20()
|
- 0.7% [±1.4]
|
+0.9% [±1.1]
| n/a | n/a |
PropertyManagerPerformanceTest#testSetProperty4x100()
|
+2.2% [±1.3]
|
+2.1% [±1.7]
| n/a | n/a |
WorkspacePerformanceTest#testCloseOpenProject()
|
+47.7% [±48.0]
|
- 0.9% [±2.4]
| n/a | n/a |
WorkspacePerformanceTest#testCreateResources()
|
+8.1% [±6.5]
|
- 5.8% [±9.2]
| n/a | n/a |
WorkspacePerformanceTest#testDeleteProject()
|
- 1.1% [±13.5]
|
Performance criteria not met when compared to 'R-3.6-201006080911_201109021800': Elapsed Process= 1.4s is not within [0%, 110'%] of 1.2s
- 16.7% [±14.3]
| n/a | n/a |
WorkspacePerformanceTest#testFolderCopy()
|
- 0.4% [±15.4]
|
+7.4% [±7.3]
| n/a | n/a |
WorkspacePerformanceTest#testFolderMove()
|
+0.5% [±1.0]
|
+2.2% [±1.0]
| n/a | n/a |
WorkspacePerformanceTest#testLoadSnapshot()
|
+0.3% [±2.7]
|
+0.6% [±2.4]
| n/a | n/a |
WorkspacePerformanceTest#testRefreshProject()
|
+48.4% [±48.5]
|
+7.3% [±1.3]
| n/a | n/a |
BenchPath#testHash()
|
- 0.6% [±0.2]
|
+0.0% [±0.2]
| n/a | n/a |
BenchPath#testPathCreation()
|
+1.6% [±0.5]
|
+0.1% [±0.6]
| n/a | n/a |
BenchPath#testToOSString()
|
+0.7% [±0.7]
|
+18.3% [±0.5]
| n/a | n/a |
BenchPath#testToString()
|
+0.4% [±0.8]
|
- 0.7% [±0.7]
| n/a | n/a |
ContentTypePerformanceTest#testContentMatching()
|
- 2.4% [±1.5]
|
+0.9% [±1.0]
| n/a | n/a |
ContentTypePerformanceTest#testIsKindOf()
|
+0.0% [±1.0]
|
+2.0% [±0.8]
| n/a | n/a |
ContentTypePerformanceTest#testLoadCatalog()
|
+56.7% [±14.9]
|
+0.0% [±1.3]
| n/a | n/a |
ContentTypePerformanceTest#testNameMatching()
|
+7.7% [±0.9]
|
+0.9% [±1.1]
| n/a | n/a |
PreferencePerformanceTest#testGetStringCommonPrefixKeys()
|
- 2.4% [±2.4]
|
+4.9% [±2.3]
| n/a | n/a |
PreferencePerformanceTest#testGetStringMisses()
|
- 0.9% [±0.4]
|
+2.7% [±0.2]
| n/a | n/a |
PreferencePerformanceTest#testGetStringSequentialKeys()
|
- 2.7% [±2.1]
|
+0.4% [±0.2]
| n/a | n/a |
PreferencePerformanceTest#testGetStringUniqueKeys()
|
+0.9% [±2.7]
|
+2.5% [±2.7]
| n/a | n/a |
PreferencePerformanceTest#testPutStringKeys()
|
+10.6% [±0.5]
|
- 0.4% [±0.9]
| n/a | n/a |
PreferencePerformanceTest#testRemoveStringKeys()
|
- 6.4% [±0.3]
|
- 6.4% [±0.3]
| n/a | n/a |
StartupTest.testApplicationStartup
|
Performance criteria not met when compared to 'R-3.6-201006080911_201109021800': Elapsed Process= 1.5s is not within [0%, 110'%] of 1.4s
- 10.3% [±2.8]
|
Performance criteria not met when compared to 'R-3.6-201006080911_201109021800': Elapsed Process= 1.5s is not within [0%, 110'%] of 1.3s
- 11.4% [±1.1]
| n/a | n/a |
UIStartupTest.testUIApplicationStartup
|
+2.1% [±3.5]
|
- 2.3% [±5.0]
| n/a | n/a |