Ben I'm getting these unexpected failures on my Linux box (64 bit) Unexpected failures: /tmp/ghctest-g01j3x6z/test spaces/./cabal/ghcpkg05.run ghcpkg05 [bad stderr] (normal) Unexpected stat failures: /tmp/ghctest-g01j3x6z/test spaces/./perf/compiler/T5837.run T5837 [stat too good] (normal) /tmp/ghctest-g01j3x6z/test spaces/./perf/compiler/T5321FD.run T5321FD [stat too good] (normal) I would LOVE it if the testsuite framework didn't print those long prefix paths! I'd prefer Unexpected failures: cabal/ghcpkg05.run ghcpkg05 [bad stderr] (normal) Unexpected stat failures: perf/compiler/T5837.run T5837 [stat too good] (normal) perf/compiler/T5321FD.run T5321FD [stat too good] (normal) The stat failures look like this: =====> T5321FD(normal) 1 of 1 [0, 0, 0] cd "./T5321FD.run" && "/5playpen/simonpj/HEAD-1/inplace/test spaces/ghc-stage2" -c T5321FD.hs -no-user-package-db -rtsopts -fno-warn-missed-specialisations -fshow-warning-groups -fdiagnostics-color=never -fno-diagnostics-show-caret -dno-debug-output +RTS -V0 -tT5321FD.comp.stats --machine-readable -RTS bytes allocated value is too low: (If this is because you have improved GHC, please update the test so that GHC doesn't regress again) Expected T5321FD(normal) bytes allocated: 415136648 +/-10% Lower bound T5321FD(normal) bytes allocated: 373622983 Upper bound T5321FD(normal) bytes allocated: 456650313 Actual T5321FD(normal) bytes allocated: 373272448 Deviation T5321FD(normal) bytes allocated: -10.1 % *** unexpected stat test failure for T5321FD(normal) =====> T5837(normal) 1 of 1 [0, 0, 0] cd "./T5837.run" && "/5playpen/simonpj/HEAD-1/inplace/test spaces/ghc-stage2" -c T5837.hs -no-user-package-db -rtsopts -fno-warn-missed-specialisations -fshow-warning-groups -fdiagnostics-color=never -fno-diagnostics-show-caret -dno-debug-output -freduction-depth=50 +RTS -V0 -tT5837.comp.stats --machine-readable -RTS bytes allocated value is too low: (If this is because you have improved GHC, please update the test so that GHC doesn't regress again) Expected T5837(normal) bytes allocated: 55813608 +/-7% Lower bound T5837(normal) bytes allocated: 51906655 Upper bound T5837(normal) bytes allocated: 59720561 Actual T5837(normal) bytes allocated: 51558808 Deviation T5837(normal) bytes allocated: -7.6 % *** unexpected stat test failure for T5837(normal) In both cases, just a bit past the threshold. What is odd is that the latter doesn't fail on our CI system (I asked you this before). The former is new, maybe to do with Richard's recent patches. Question: are the numbers 'centred' for the CI infrastructure. Maybe they are just under 10% and 7% resp, and something local pushes them a tiny bit lower? The ghcpkg05 failure is quite consistent, despite from-clean rebuild. =====> ghcpkg05(normal) 1 of 1 [0, 0, 0] cd "./ghcpkg05.run" && $MAKE -s --no-print-directory ghcpkg05 Actual stderr output differs from expected: diff -uw "./ghcpkg05.run/ghcpkg05.stderr.normalised" "./ghcpkg05.run/ghcpkg05.run.stderr.normalised" --- ./ghcpkg05.run/ghcpkg05.stderr.normalised 2018-04-02 11:52:51.407023104 +0100 +++ ./ghcpkg05.run/ghcpkg05.run.stderr.normalised 2018-04-02 11:52:51.407023104 +0100 @@ -10,6 +10,13 @@ cannot find any of ["C/D.hi","C/D.p_hi","C/D.dyn_hi"] cannot find any of ["C/E.hi","C/E.p_hi","C/E.dyn_hi"] cannot find any of ["libtestpkg-2.0-XXX.a","libtestpkg-2.0-XXX.p_a","libtestpkg-2.0-XXX-ghc<VERSION>.so","libtestpkg-2.0-XXX-ghc<VERSION>.dylib","testpkg-2.0-XXX-ghc<VERSION>.dll"] on library path +Warning: include-dirs: /5playpen/simonpj/HEAD-1/compiler/stage2/build/utils doesn't exist or isn't a directory +Warning: include-dirs: /5playpen/simonpj/HEAD-1/compiler/stage2/build/../rts/dist/build doesn't exist or isn't a directory +Warning: include-dirs: /5playpen/simonpj/HEAD-1/compiler/stage2/build/stage2 doesn't exist or isn't a directory +Warning: include-dirs: /5playpen/simonpj/HEAD-1/libraries/haskeline/dist-install/build/includes doesn't exist or isn't a directory +Warning: include-dirs: /5playpen/simonpj/HEAD-1/libraries/text/dist-install/build/include doesn't exist or isn't a directory +Warning: include-dirs: /5playpen/simonpj/HEAD-1/libraries/containers/dist-install/build/include doesn't exist or isn't a directory +Warning: include-dirs: /5playpen/simonpj/HEAD-1/libraries/bytestring/dist-install/build/include doesn't exist or isn't a directory The following packages are broken, either because they have a problem listed above, or because they depend on a broken package. *** unexpected failure for ghcpkg05(normal) Any ideas? Thanks SImon