All 49 scenarios 
RHEL 3.0 Sun 1.4.2_08 (2 GHz 512 MB)  RHEL 3.0 Sun 1.4.2_08 (3 GHz 2 B)  RHEL 4.0 Sun 1.4.2_08 (3 GHz 2.5 GB)  Win XP Sun 1.4.2_08 (2 GHz 512 MB)  Win XP Sun 1.4.2_08 (3 GHz 2 GB) 
resources.perf.BenchFileStore#testStoreExists() 





resources.perf.BenchFileStore#testStoreIsReadOnly() 





resources.perf.BenchFileStore#testStoreLastModified() 





resources.perf.BenchMiscWorkspace#testNoOp() 




There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest). 
resources.perf.BenchWorkspace#testCountResources() 



Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 237ms is not within [0%, 110%] of 212ms 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest). 
resources.perf.BenchWorkspace#testCountResourcesDuringOperation() 

There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest). 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest). 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest). 

resources.perf.LocalHistoryPerformanceTest#testAddState() 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest).Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 187ms is not within [0%, 110%] of 106ms 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest). 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest). 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest).Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 259ms is not within [0%, 110%] of 201ms 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest). 
resources.perf.LocalHistoryPerformanceTest#testBug28603() 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest). 
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 30ms is not within [0%, 110%] of 27ms 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest).Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 51ms is not within [0%, 110%] of 23ms 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest).Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 150ms is not within [0%, 110%] of 111ms 
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 60ms is not within [0%, 110%] of 48ms 
resources.perf.LocalHistoryPerformanceTest#testClearHistory100x4() 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest).Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 41ms is not within [0%, 110%] of 25ms 
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 217ms is not within [0%, 110%] of 17ms 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest). 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest).Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 35ms is not within [0%, 110%] of 23ms 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest).Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 23ms is not within [0%, 110%] of 19ms 
resources.perf.LocalHistoryPerformanceTest#testClearHistory20x20() 
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 13ms is not within [0%, 110%] of 10ms 
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 8ms is not within [0%, 110%] of 7ms 

Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 16ms is not within [0%, 110%] of 7ms 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest). 
resources.perf.LocalHistoryPerformanceTest#testClearHistory4x100() 
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 10ms is not within [0%, 110%] of 9ms 
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 7ms is not within [0%, 110%] of 6ms 

Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 19ms is not within [0%, 110%] of 15ms 

resources.perf.LocalHistoryPerformanceTest#testCopyHistory100x4() 





resources.perf.LocalHistoryPerformanceTest#testCopyHistory20x20() 





resources.perf.LocalHistoryPerformanceTest#testCopyHistory4x100() 

There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest). 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest). 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest).Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 189ms is not within [0%, 110%] of 168ms 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest). 
resources.perf.LocalHistoryPerformanceTest#testGetDeletedMembers100x4() 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest). 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest). 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest). 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest). 
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 62ms is not within [0%, 110%] of 46ms 
resources.perf.LocalHistoryPerformanceTest#testGetDeletedMembers20x20() 


There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest).Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 18ms is not within [0%, 110%] of 16ms 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest).Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 31ms is not within [0%, 110%] of 23ms 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest). 
resources.perf.LocalHistoryPerformanceTest#testGetDeletedMembers4x100() 



Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 23ms is not within [0%, 110%] of 16ms 

resources.perf.LocalHistoryPerformanceTest#testGetHistory() 





resources.perf.LocalHistoryPerformanceTest#testHistoryCleanUp100x4() 
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 1.32s is not within [0%, 110%] of 249ms 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest).Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 1.36s is not within [0%, 110%] of 245ms 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest).Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 312ms is not within [0%, 110%] of 216ms 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest).Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 2.78s is not within [0%, 110%] of 1.31s 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest).Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 2.04s is not within [0%, 110%] of 1.2s 
resources.perf.LocalHistoryPerformanceTest#testHistoryCleanUp20x20() 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest).Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 704ms is not within [0%, 110%] of 512ms 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest). 
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 256ms is not within [0%, 110%] of 222ms 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest). 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest). 
resources.perf.LocalHistoryPerformanceTest#testHistoryCleanUp4x100() 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest). 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest).Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 1.18s is not within [0%, 110%] of 251ms 
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 262ms is not within [0%, 110%] of 222ms 

There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest). 
resources.perf.MarkerPerformanceTest#testSetAttributes1() 





resources.perf.MarkerPerformanceTest#testSetAttributes2() 





resources.perf.PropertyManagerPerformanceTest#testGetProperty100x4() 





resources.perf.PropertyManagerPerformanceTest#testGetProperty20x20() 

There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest). 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest). 


resources.perf.PropertyManagerPerformanceTest#testGetProperty4x100() 

There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest). 



resources.perf.PropertyManagerPerformanceTest#testSetProperty100x4() 


There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest). 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest). 

resources.perf.PropertyManagerPerformanceTest#testSetProperty20x20() 

Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 246ms is not within [0%, 110%] of 223ms 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest). 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest). 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest). 
resources.perf.PropertyManagerPerformanceTest#testSetProperty4x100() 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest). 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest). 

There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest). 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest). 
resources.perf.WorkspacePerformanceTest#testCreateResources() 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest).Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 17.26s is not within [0%, 110%] of 15.48s 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest). 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest).Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 6.94s is not within [0%, 110%] of 4.77s 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest). 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest). 
resources.perf.WorkspacePerformanceTest#testDeleteProject() 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest). 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest).Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 14.72s is not within [0%, 110%] of 13.07s 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest).Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 6.42s is not within [0%, 110%] of 5.65s 


resources.perf.WorkspacePerformanceTest#testFolderCopy() 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest).Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 43s is not within [0%, 110%] of 35.58s 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest). 
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 12s is not within [0%, 110%] of 7.65s 
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 1.56m is not within [0%, 110%] of 1.27m 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest).Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 36.03s is not within [0%, 110%] of 31.9s 
resources.perf.WorkspacePerformanceTest#testFolderMove() 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest). 




runtime.perf.BenchPath#testHash() 





runtime.perf.BenchPath#testPathCreation() 


There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest). 


runtime.perf.BenchPath#testToOSString() 


There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest). 


runtime.perf.BenchPath#testToString() 


There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest). 


runtime.perf.ContentTypePerformanceTest#testContentMatching() 


There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest). 


runtime.perf.ContentTypePerformanceTest#testIsKindOf() 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest). 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest). 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest). 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest). 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest). 
runtime.perf.ContentTypePerformanceTest#testLoadCatalog() 
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 248ms is not within [0%, 110%] of 184ms 
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 178ms is not within [0%, 110%] of 129ms 

Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 198ms is not within [0%, 110%] of 155ms 
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 141ms is not within [0%, 110%] of 113ms 
runtime.perf.ContentTypePerformanceTest#testNameMatching() 
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 1.98s is not within [0%, 110%] of 1.7s 



There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest). 
runtime.perf.PreferencePerformanceTest#testGetStringCommonPrefixKeys() 



There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest). 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest). 
runtime.perf.PreferencePerformanceTest#testGetStringMisses() 
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 1.24s is not within [0%, 110%] of 1.06s 
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 869ms is not within [0%, 110%] of 671ms 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest). 


runtime.perf.PreferencePerformanceTest#testGetStringSequentialKeys() 



Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 1.63s is not within [0%, 110%] of 1.37s 
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 1.05s is not within [0%, 110%] of 935ms 
runtime.perf.PreferencePerformanceTest#testGetStringUniqueKeys() 



Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 1.46s is not within [0%, 110%] of 1.25s 
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 985ms is not within [0%, 110%] of 850ms 
runtime.perf.PreferencePerformanceTest#testPutStringKeys() 





runtime.perf.PreferencePerformanceTest#testRemoveStringKeys() 



There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest). 
There is not enough evidence to reject the null hypothesis at the 90% level (Student's ttest). 
runtime.perf.StartupTest.testApplicationStartup 
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 2.2s is not within [0%, 105%] of 1.86s 
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 1.51s is not within [0%, 105%] of 1.23s 
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 1.34s is not within [0%, 105%] of 1.07s 
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 2s is not within [0%, 105%] of 1.69s 
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 1.38s is not within [0%, 105%] of 1.16s 
runtime.perf.UIStartupTest.testUIApplicationStartup 
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 15.31s is not within [50%, 105%] of 12.32s 
Performance criteria not met when compared to '{config=eclipseperflnx2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 10.18s is not within [50%, 105%] of 8.1s 
Performance criteria not met when compared to '{config=eclipseperflnx3_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 8.4s is not within [50%, 105%] of 6.95s 
Performance criteria not met when compared to '{config=eclipseperfwin1_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 10.22s is not within [50%, 105%] of 7.73s 
Performance criteria not met when compared to '{config=eclipseperfwin2_R3.2, build=3.1_200506271435_200609141254, jvm=sun1.4.2_08}':
Elapsed Process: 6.6s is not within [50%, 105%] of 5.28s 