): mark a successful result, which means this test has neither significant performance regression nor significant standard error
): mark a failing result, which means this test shows a significant performance regression (more than 10%)
): mark a failing result (see above) with a comment explaining this degradation.
or
): mark a failing or successful result with a significant standard error (more than 3%)
): mark an undefined result, which means that deviation on this test is not a number (NaN) or is infinite (happens when the reference value is equals to 0!)(build_test_time - baseline_test_time) / baseline_test_time)sqrt(build_test_stddev^2 / N + baseline_test_stddev^2 / N) / baseline_test_time)All 7 scenarios |
RHEL 3.0 Sun 1.4.2_10 (2 GHz 512 MB) | RHEL 3.0 Sun 1.4.2_10 (3 GHz 2 GB) | RHEL 4.0 Sun 1.4.2_10 (3 GHz 2.5 GB) | Win XP Sun 1.4.2_10 (2 GHz 512 MB) | Win XP Sun 1.4.2_10 (3 GHz 2 GB) |
| Create composites |
Performance criteria not met when compared to '{config=eclipseperflnx1_R3.3, build=3.2_200606291905_200801281721, jvm=sun}':
Elapsed Process: 2.05s is not within [0%, 110%] of 1.85s
- 11.2% [±0.3]
|
- 6.3% [±0.2]
|
- 3.9% [±0.7]
|
- 0.3% [±0.9]
|
- 3.1% [±0.8]
|
| Create composites and widgets |
- 6.7% [±1.2]
|
- 2.8% [±0.5]
|
- 2.3% [±1.1]
|
- 1.7% [±0.7]
|
- 1.8% [±0.3]
|
| Draw on a window |
+4.4% [±0.2]
|
+0.5% [±0.7]
|
+2.5% [±0.4]
|
+24.8% [±4.8]
|
+5.1% [±1.3]
|
| Draw on an image |
+2.1% [±0.5]
|
+1.1% [±0.8]
|
+2.2% [±1.0]
|
+1.6% [±0.6]
|
+2.6% [±0.8]
|
| Draw strings using GC.drawString() |
+0.0% [±0.7]
|
- 3.1% [±1.1]
|
+5.2% [±0.1]
|
+16.5% [±1.3]
|
+3.2% [±0.7]
|
| Draw strings using GC.drawText |
+0.0% [±0.1]
|
- 1.5% [±0.2]
|
+0.4% [±0.2]
|
+16.4% [±3.2]
|
+0.8% [±0.5]
|
| Layout Composites |
- 1.8% [±2.2]
|
- 3.3% [±1.7]
|
+1.2% [±1.7]
|
+43.9% [±2.2]
|
+38.4% [±1.3]
|