All 62 scenarios |
SLED 10 Sun 1.5.0_10 (2 x 3.00GHz - 3GB RAM)
| RHEL 5.0 Sun 6.0_04 (2 x 3.00GHz - 3GB RAM)
| Win XP Sun 1.5.0_10 (2 x 3.00GHz - 3GB RAM)
| Win XP Sun 1.6.0_04 (2 x 3.00GHz - 3GB RAM)
|
FullSourceWorkspaceASTTests#testDomAstCreationProjectJLS3()
|
+1.3% [±2.5]
|
- 0.8% [±0.1]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201102071800': Elapsed Process= 0.82s is not within [0%, 110'%] of 0.38s
- 118.9% [±3.0]
|
+0.0% [±0.0]
|
FullSourceWorkspaceASTTests#testPerfDomAstCreationJLS2()
|
+1.6% [±3.0]
|
- 0.4% [±1.2]
|
+1.4% [±2.9]
|
- 2.6% [±1.2]
|
FullSourceWorkspaceASTTests#testPerfDomAstCreationJLS3()
|
+1.4% [±0.3]
|
- 0.4% [±0.1]
|
+3.1% [±0.4]
|
- 2.6% [±0.3]
|
FullSourceWorkspaceASTTests#testWkspDomAstCreationJLS2()
|
+0.0% [n/a]
|
- 1.9% [n/a]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201102071800': Elapsed Process= 1mn 52s is not within [0%, 110'%] of 42.8s
- 162.8% [n/a]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201102071800': Elapsed Process= 50.4s is not within [0%, 110'%] of 40.9s
- 23.1% [n/a]
|
FullSourceWorkspaceBuildTests#testBatchCompilerNoWarning()
|
+6.0% [±3.7]
|
- 4.7% [±1.2]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201102071800': Elapsed Process= 24.2s is not within [0%, 110'%] of 6.2s
- 287.8% [±4.6]
|
- 0.4% [±3.0]
|
FullSourceWorkspaceBuildTests#testBuildGenericType()
|
Performance criteria not met when compared to 'R-3.5-200906111540_201102071800': Elapsed Process= 0.47s is not within [0%, 110'%] of 0.41s
- 16.2% [±5.0]
|
+1.6% [±0.9]
|
+12.1% [±10.6]
|
- 4.6% [±15.2]
|
FullSourceWorkspaceBuildTests#testCompileJDTCoreProjectAllWarnings()
|
+0.3% [±5.4]
|
- 0.1% [±1.3]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201102071800': Elapsed Process= 23.5s is not within [0%, 110'%] of 7s
- 233.9% [±2.8]
|
+0.9% [±2.1]
|
FullSourceWorkspaceBuildTests#testCompileJDTCoreProjectDefault()
|
- 5.6% [±4.2]
|
- 3.2% [±1.0]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201102071800': Elapsed Process= 23.1s is not within [0%, 110'%] of 6.2s
- 275.3% [±3.4]
|
- 0.6% [±2.6]
|
FullSourceWorkspaceBuildTests#testCompileJDTCoreProjectJavadoc()
|
- 4.5% [±4.5]
|
- 3.1% [±1.2]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201102071800': Elapsed Process= 23.5s is not within [0%, 110'%] of 6.3s
- 272.0% [±2.7]
|
- 0.2% [±2.4]
|
FullSourceWorkspaceBuildTests#testCompileJDTCoreProjectNoWarning()
|
+2.4% [±3.0]
|
- 3.9% [±0.4]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201102071800': Elapsed Process= 23.3s is not within [0%, 110'%] of 6s
- 286.4% [±3.0]
|
+0.9% [±2.1]
|
FullSourceWorkspaceBuildTests#testCompileSWTProjectDefault()
|
Performance criteria not met when compared to 'R-3.5-200906111540_201102071800': Elapsed Process= 3.5s is not within [0%, 110'%] of 2.8s
- 25.7% [±25.5]
|
- 6.1% [±1.3]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201102071800': Elapsed Process= 8.5s is not within [0%, 110'%] of 2.7s
- 219.4% [±5.1]
|
- 2.1% [±4.6]
|
FullSourceWorkspaceBuildTests#testFullBuildDefault()
|
- 2.9% [n/a]
|
- 3.9% [n/a]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201102071800': Elapsed Process= 5mn 26s is not within [0%, 110'%] of 2mn 46s
- 95.7% [n/a]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201102071800': Elapsed Process= 2mn 15s is not within [0%, 110'%] of 1mn 43s
- 30.9% [n/a]
|
FullSourceWorkspaceBuildTests#testFullBuildProjectAllWarnings()
|
+3.7% [±1.8]
|
- 2.6% [±0.5]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201102071800': Elapsed Process= 30.6s is not within [0%, 110'%] of 14.4s
- 111.7% [±3.0]
|
+2.8% [±1.2]
|
FullSourceWorkspaceBuildTests#testFullBuildProjectDefault()
|
+3.3% [±1.1]
|
+5.2% [±0.7]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201102071800': Elapsed Process= 30.2s is not within [0%, 110'%] of 13.5s
- 123.2% [±2.3]
|
+4.3% [±1.4]
|
FullSourceWorkspaceBuildTests#testFullBuildProjectNoWarning()
|
+0.0% [±1.6]
|
+1.4% [±1.3]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201102071800': Elapsed Process= 29.9s is not within [0%, 110'%] of 13.1s
- 128.7% [±3.3]
|
+5.3% [±1.8]
|
FullSourceWorkspaceBuildTests#testParser()
|
+2.8% [±0.2]
|
- 0.6% [±0.5]
|
- 1.4% [±0.2]
|
- 2.4% [±0.3]
|
FullSourceWorkspaceBuildTests#testScanner()
|
+11.2% [±0.1]
|
- 4.9% [±0.5]
|
- 5.0% [±0.3]
|
- 0.7% [±0.1]
|
FullSourceWorkspaceCompletionTests#testPerfCompleteEmptyName()
|
+0.0% [±0.5]
|
+1.3% [±0.2]
|
- 2.7% [±0.5]
|
- 0.1% [±0.6]
|
FullSourceWorkspaceCompletionTests#testPerfCompleteEmptyNameWithoutMethods()
|
+0.6% [±0.5]
|
+1.0% [±0.2]
|
- 4.0% [±0.9]
|
- 0.2% [±0.7]
|
FullSourceWorkspaceCompletionTests#testPerfCompleteEmptyNameWithoutTypes()
|
- 0.7% [±0.3]
|
+0.4% [±0.3]
|
- 3.7% [±0.5]
|
- 0.2% [±0.5]
|
FullSourceWorkspaceCompletionTests#testPerfCompleteMemberAccess()
|
- 0.1% [±0.6]
|
+1.6% [±0.3]
|
- 2.3% [±0.7]
|
- 0.3% [±0.5]
|
FullSourceWorkspaceCompletionTests#testPerfCompleteMethodDeclaration()
|
+1.7% [±2.4]
|
- 1.4% [±2.1]
|
- 2.0% [±2.3]
|
- 1.2% [±1.4]
|
FullSourceWorkspaceCompletionTests#testPerfCompleteName()
|
+2.3% [±0.6]
|
- 5.3% [±2.1]
|
- 1.4% [±0.2]
|
- 2.1% [±0.2]
|
FullSourceWorkspaceCompletionTests#testPerfCompleteNameWithoutMethods()
|
+0.4% [±0.2]
|
- 0.6% [±0.3]
|
- 1.0% [±0.2]
|
- 0.6% [±0.3]
|
FullSourceWorkspaceCompletionTests#testPerfCompleteNameWithoutTypes()
|
- 0.1% [±0.5]
|
+0.0% [±0.3]
|
- 3.8% [±0.4]
|
+0.0% [±0.7]
|
FullSourceWorkspaceCompletionTests#testPerfCompleteTypeReference()
|
- 2.1% [±0.3]
|
+0.4% [±2.7]
|
- 3.2% [±0.3]
|
- 3.4% [±2.0]
|
FullSourceWorkspaceFormatterTests#testFormatDefault()
|
- 4.9% [±2.6]
|
- 2.7% [±2.4]
|
- 7.3% [±2.5]
|
- 2.2% [±1.6]
|
FullSourceWorkspaceFormatterTests#testFormatDefaultBigFile()
|
- 9.6% [±0.1]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201102071800': Elapsed Process= 3.9s is not within [0%, 110'%] of 3.5s
- 13.0% [±0.2]
|
- 9.0% [±0.3]
|
- 8.4% [±0.2]
|
FullSourceWorkspaceModelTests#testCloseProjects()
|
+3.7% [±7.7]
|
- 0.5% [±10.2]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201102071800': Elapsed Process= 3s is not within [0%, 110'%] of 2.2s
- 39.1% [±12.2]
|
+1.5% [±14.2]
|
FullSourceWorkspaceModelTests#testCreateJavaElement()
|
- 2.9% [±1.3]
|
- 3.6% [±0.6]
|
- 9.6% [±1.7]
|
+0.0% [±0.2]
|
FullSourceWorkspaceModelTests#testFindType()
|
+2.0% [±0.2]
|
- 6.0% [±0.2]
|
+7.9% [±0.1]
|
- 3.3% [±2.3]
|
FullSourceWorkspaceModelTests#testGetSourceBigJarNoAttachment()
|
+2.7% [±0.2]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201102071800': Elapsed Process= 0.48s is not within [0%, 110'%] of 0.43s
- 12.1% [±0.3]
|
+2.0% [±0.3]
|
+0.0% [±0.0]
|
FullSourceWorkspaceModelTests#testInitJDTPlugin()
|
+1.1% [±0.7]
|
- 2.4% [±0.2]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201102071800': Elapsed Process= 3.8s is not within [0%, 110'%] of 0.86s
- 344.8% [±16.4]
|
+9.3% [±12.0]
|
FullSourceWorkspaceModelTests#testNameLookupFindKnownSecondaryType()
|
- 2.2% [±0.7]
|
+1.7% [±0.8]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201102071800': Elapsed Process= 0.39s is not within [0%, 110'%] of 0.32s
- 20.6% [±0.8]
|
+5.0% [±0.8]
|
FullSourceWorkspaceModelTests#testNameLookupFindKnownType()
|
- 5.2% [±1.0]
|
- 3.8% [±1.2]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201102071800': Elapsed Process= 0.3s is not within [0%, 110'%] of 0.23s
- 30.7% [±1.7]
|
+5.9% [±1.7]
|
FullSourceWorkspaceModelTests#testNameLookupFindUnknownType()
|
- 1.6% [±0.6]
|
+0.7% [±0.8]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201102071800': Elapsed Process= 0.39s is not within [0%, 110'%] of 0.31s
- 24.8% [±0.7]
|
+5.9% [±1.5]
|
FullSourceWorkspaceModelTests#testPerfBatchCreatePackageAndReconcile()
|
- 8.3% [±1.1]
|
+0.0% [±1.9]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201102071800': Elapsed Process= 14ms is not within [0%, 110'%] of 10ms
- 40.0% [±28.1]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201102071800': Elapsed Process= 14ms is not within [0%, 110'%] of 12ms
- 16.7% [±21.7]
|
FullSourceWorkspaceModelTests#testPerfReconcile()
|
+0.8% [±0.2]
|
- 2.3% [±0.2]
|
- 2.4% [±0.5]
|
- 2.0% [±0.6]
|
FullSourceWorkspaceModelTests#testPerfReconcileBigFileWithSyntaxError()
|
- 1.1% [±0.2]
|
+0.9% [±0.2]
|
+10.9% [±0.5]
|
- 0.3% [±0.0]
|
FullSourceWorkspaceModelTests#testPerfSearchAllTypeNamesAndReconcile()
|
+4.6% [±0.9]
|
+0.9% [±0.1]
|
+1.7% [±0.5]
|
+2.3% [±0.0]
|
FullSourceWorkspaceModelTests#testPopulateTwoBigJars()
|
+1.7% [±38.9]
|
+1.6% [±38.7]
|
- 4.3% [±37.6]
|
+4.0% [±38.5]
|
FullSourceWorkspaceModelTests#testProjectFindKnownMemberType()
|
- 0.5% [±0.3]
|
+2.0% [±0.3]
|
- 7.4% [±0.1]
|
- 3.2% [±1.4]
|
FullSourceWorkspaceModelTests#testProjectFindKnownSecondaryType()
|
- 2.7% [±0.1]
|
- 0.9% [±0.1]
|
- 7.3% [±0.1]
|
+0.0% [±0.1]
|
FullSourceWorkspaceModelTests#testProjectFindKnownType()
|
- 1.7% [±0.9]
|
- 3.6% [±0.7]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201102071800': Elapsed Process= 0.31s is not within [0%, 110'%] of 0.24s
- 32.5% [±1.1]
|
+0.0% [±1.0]
|
FullSourceWorkspaceModelTests#testProjectFindUnknownType()
|
- 2.2% [±0.5]
|
- 0.4% [±0.2]
|
- 6.8% [±0.0]
|
+0.7% [±0.5]
|
FullSourceWorkspaceModelTests#testProjectFindUnknownTypeAfterSetClasspath()
|
+0.0% [±0.2]
|
- 3.5% [±0.1]
|
- 6.8% [±0.0]
|
+0.0% [±0.1]
|
FullSourceWorkspaceModelTests#testReconcileDuplicates()
|
- 1.5% [±0.3]
|
- 2.3% [±0.2]
|
+1.6% [±0.6]
|
+2.4% [±0.5]
|
FullSourceWorkspaceModelTests#testSeekPackageFragments()
|
- 2.3% [±2.6]
|
- 4.8% [±2.3]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201102071800': Elapsed Process= 0.18s is not within [0%, 110'%] of 0.13s
- 43.7% [±3.9]
|
+5.0% [±4.5]
|
FullSourceWorkspaceSearchTests#testIndexing()
|
+0.0% [n/a]
|
+0.2% [n/a]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201102071800': Elapsed Process= 1mn 41s is not within [0%, 110'%] of 20.4s
- 399.0% [n/a]
|
+1.3% [n/a]
|
FullSourceWorkspaceSearchTests#testIndexingOneProject()
|
+1.3% [±2.9]
|
+1.8% [±0.2]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201102071800': Elapsed Process= 11.9s is not within [0%, 110'%] of 2.9s
- 313.9% [±2.8]
|
+0.0% [±0.0]
|
FullSourceWorkspaceSearchTests#testNewSearchAllTypeNames()
|
+13.6% [±0.3]
|
+6.0% [±0.4]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201102071800': Elapsed Process= 1.7s is not within [0%, 110'%] of 0.18s
- 848.9% [±2.4]
|
+8.8% [±0.1]
|
FullSourceWorkspaceSearchTests#testSearchAllTypeNameMatches()
|
+10.2% [±0.1]
|
+4.8% [±0.1]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201102071800': Elapsed Process= 1.8s is not within [0%, 110'%] of 0.3s
- 524.7% [±1.2]
|
+5.7% [±0.1]
|
FullSourceWorkspaceSearchTests#testSearchAllTypeNames()
|
+13.5% [±0.2]
|
+8.1% [±0.2]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201102071800': Elapsed Process= 3.2s is not within [0%, 110'%] of 1.3s
- 149.1% [±2.6]
|
+7.8% [±0.1]
|
FullSourceWorkspaceSearchTests#testSearchBinaryMethod()
|
+7.0% [±0.2]
|
- 0.7% [±0.1]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201102071800': Elapsed Process= 2.2s is not within [0%, 110'%] of 0.38s
- 486.1% [±1.3]
|
+0.3% [±0.5]
|
FullSourceWorkspaceSearchTests#testSearchConstructor()
|
+4.9% [±0.2]
|
- 1.4% [±0.1]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201102071800': Elapsed Process= 8.5s is not within [0%, 110'%] of 1.9s
- 358.7% [±1.5]
|
- 2.1% [±0.3]
|
FullSourceWorkspaceSearchTests#testSearchField()
|
+5.8% [±0.3]
|
- 1.1% [±0.2]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201102071800': Elapsed Process= 6.3s is not within [0%, 110'%] of 1.3s
- 399.4% [±3.1]
|
+1.3% [±0.2]
|
FullSourceWorkspaceSearchTests#testSearchMethod()
|
+10.3% [±2.2]
|
- 0.3% [±0.2]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201102071800': Elapsed Process= 3.2s is not within [0%, 110'%] of 0.91s
- 252.4% [±0.6]
|
+2.5% [±0.3]
|
FullSourceWorkspaceSearchTests#testSearchPackageDeclarationsWorkspace()
|
+0.6% [±0.3]
|
- 1.2% [±0.2]
|
+9.1% [±0.0]
|
- 3.1% [±0.4]
|
FullSourceWorkspaceSearchTests#testSearchType()
|
+5.4% [±3.2]
|
- 1.3% [±0.3]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201102071800': Elapsed Process= 7.4s is not within [0%, 110'%] of 1.5s
- 382.9% [±1.8]
|
- 1.1% [±0.3]
|
FullSourceWorkspaceTypeHierarchyTests#testPerSuperTypes()
|
- 0.5% [±0.4]
|
- 1.2% [±0.3]
|
- 8.7% [±0.1]
|
+0.0% [±0.1]
|
FullSourceWorkspaceTypeHierarchyTests#testPerfAllTypes()
|
+0.9% [±0.3]
|
- 1.9% [±0.2]
|
Performance criteria not met when compared to 'R-3.5-200906111540_201102071800': Elapsed Process= 2.3s is not within [0%, 110'%] of 0.88s
- 165.5% [±0.7]
|
- 1.1% [±0.3]
|
FullSourceWorkspaceTypeHierarchyTests#testPerfClassWithPotentialSubinterfaces()
|
+6.9% [±6.0]
|
+0.0% [±0.1]
|
- 1.3% [±1.8]
|
+0.0% [±0.1]
|