Re: nofib comparisons between 7.0.4, 7.4.2, 7.6.1, and 7.6.2

On 5 February 2013 09:34, Johan Tibell wrote:

On Tue, Feb 5, 2013 at 3:19 AM, David Terei wrote:

...

On 5 February 2013 02:13, Simon Peyton-Jones wrote:

...

I believe fibon/ was helpfully added by someone, but never integrated into the nofib build system. Just needs doing, I think

No I spent a fair amount of effort fixing this up about 9 months back. At that stage it worked fine, I haven't run for 6 months so not sure any more but they should be close to working at the least.

Instead of trying to get fibon to work I'll try to get some of the shootout benchmarks into nofib. These are small micro benchmarks that shouldn't require anything special to run.

Agreed. The issue with the fibon folder as a whole is a lot of the benchmarks have substantial dependencies as they are taken from Hackage to represent real world programs. This is handled in a very ugly fashion right now by just including a copy of the source of all dependencies. So overtime it will always break as GHC and base changes. Shootout and some of them though don't have dependencies, so we should look at moving them out of the fibon folder and enabling them by default. After that we can look at better ways to handle the dependencies of the remaining fibon benchmarks. Why are you creating new shootout benchmarks though rather than simply move the exiting Shootout folder from fibon/Shootout to the top level and fixing the makefile? Some of this discussion going forward may make more sense on trac. There is trac ticket for improving nofib in general here: http://hackage.haskell.org/trac/ghc/ticket/5793 Cheers, David

-- Johan