On Thu, Apr 25, 2013 at 9:56 AM, Johan Tibell <johan.tibell@gmail.com> wrote:

Run the nofib suite, which now includes some code with strict fields from the language shootout suite, as a sanity check.

Here are the nofib results (using the benchmarks that are enabled by default):

Min -0.1% -0.0% -1.4% -2.7% -5.7%

Max +0.0% +0.3% +1.8% +2.4% +0.0%

Geometric Mean -0.0% +0.0% +0.2% +0.1% -0.1%

I looked at the outliers and none of them have strict fields so this is just measuring noise.

Aside: This is another reminder that we who promised to be performance czars need to look into more reliable benchmarks (with confidence intervals).