I think that Iavor is facing the same problems that I reported on this list on May 15th. I also see ghcpkg01 failing (when run during the validation) and passing (when run separately). This sometimes happens with other tests as well. Iavor, are you getting 'cahce is out of date' error when the test fails? Actual stderr output differs from expected: --- /dev/null 2013-05-14 15:38:10.771000000 +0200 +++ ../../libraries/base/tests/IO/T3307.run.stderr 2013-05-15 09:21:45.695049002 +0200 @@ -0,0 +1,2 @@ +WARNING: cache is out of date: /dane/uczelnia/projekty/ghc-validate/bindisttest/install dir/lib/ghc-7.7.20130514/package.conf.d/package.cache + use 'ghc-pkg recache' to fix. *** unexpected failure for T3307(normal) I think that these problems are likely to be caused be build artifacts left from previous validation - package.cache files (and many others) are not removed by `make maintainer-clean`. I created a patch that fixes this, but it has not been reviewed yet: http://hackage.haskell.org/trac/ghc/ticket/7941 Perhaps it would resolve these problems. Janek
There are no dependencies in the testsuite. You're either seeing: * a bug in a test, which means it is affecting something outside of the test * a bug in a test, which causes it to inconsistently fail * some problem with your machine, e.g. dodgy RAM (from most to least likely).
Note that in the first case it is not necessarily the failing test that is broken.
The testlog may give more clues as to what is going wrong.
Thanks Ian