#15736: Testsuite failures from validate --slow -------------------------------------+------------------------------------- Reporter: jrp | Owner: (none) Type: bug | Status: new Priority: normal | Milestone: Component: Test Suite | Version: 8.6.1 Resolution: | Keywords: Operating System: Linux | Architecture: x86_64 | (amd64) Type of failure: Incorrect result | Test Case: at runtime | EtaExpandLevPoly T14936 T15349 | T2783 T4334 T7919 haddock.Cabal | haddock.base haddock.compiler | hpc_fork plugin-recomp-change | plugin-recomp-change-prof recomp007 | space_leak_001 Blocked By: | Blocking: Related Tickets: | Differential Rev(s): Wiki Page: | -------------------------------------+------------------------------------- Comment (by jrp): I've applied the Phab:D5298 patch, and now get a bit further. The tests below fail on `validate -slow` but most of them run OK if I just `make TEST="..."` I'll leave the full trace of the latter below: {{{ ====> T15859(normal) 1 of 27 [0, 0, 0] cd "dependent/should_fail/T15859.run" && "/home/jrp/Projects/ghc/inplace/test spaces/ghc-stage2" -c T15859.hs -dcore-lint -dcmm-lint -no-user-package-db -rtsopts -fno-warn-missed- specialisations -fshow-warning-groups -fdiagnostics-color=never -fno- diagnostics-show-caret -Werror=compat -dno-debug-output Actual stderr output differs from expected: diff -uw "dependent/should_fail/T15859.run/T15859.stderr.normalised" "dependent/should_fail/T15859.run/T15859.comp.stderr.normalised" --- dependent/should_fail/T15859.run/T15859.stderr.normalised 2018-11-05 21:16:05.108636964 +0000 +++ dependent/should_fail/T15859.run/T15859.comp.stderr.normalised 2018-11-05 21:16:05.108636964 +0000 @@ -1,6 +1 @@ - -T15859.hs:13:5: - Cannot apply expression of type ‘forall k -> k -> *’ - to a visible type argument ‘Int’ - In the expression: (undefined :: KindOf A) @Int - In an equation for ‘a’: a = (undefined :: KindOf A) @Int +<command line>: does not exist: T15859.hs *** unexpected failure for T15859(normal) =====> PrimFFIInt8(normal) 2 of 27 [0, 1, 0] cd "ffi/should_run/PrimFFIInt8.run" && "/home/jrp/Projects/ghc/inplace/test spaces/ghc-stage2" -o PrimFFIInt8 PrimFFIInt8.hs -dcore-lint -dcmm-lint -no-user-package-db -rtsopts -fno- warn-missed-specialisations -fshow-warning-groups -fdiagnostics- color=never -fno-diagnostics-show-caret -Werror=compat -dno-debug-output PrimFFIInt8_c.c cd "ffi/should_run/PrimFFIInt8.run" && ./PrimFFIInt8 =====> PrimFFIWord8(normal) 3 of 27 [0, 1, 0] cd "ffi/should_run/PrimFFIWord8.run" && "/home/jrp/Projects/ghc/inplace/test spaces/ghc-stage2" -o PrimFFIWord8 PrimFFIWord8.hs -dcore-lint -dcmm-lint -no-user-package-db -rtsopts -fno- warn-missed-specialisations -fshow-warning-groups -fdiagnostics- color=never -fno-diagnostics-show-caret -Werror=compat -dno-debug-output PrimFFIWord8_c.c cd "ffi/should_run/PrimFFIWord8.run" && ./PrimFFIWord8 =====> T12707(normal) 4 of 27 [0, 1, 0] cd "perf/compiler/T12707.run" && "/home/jrp/Projects/ghc/inplace/test spaces/ghc-stage2" -c T12707.hs -no-user-package-db -rtsopts -fno-warn- missed-specialisations -fshow-warning-groups -fdiagnostics-color=never -fno-diagnostics-show-caret -Werror=compat -dno-debug-output +RTS -V0 -tT12707.comp.stats --machine-readable -RTS =====> T13379(normal) 5 of 27 [0, 1, 0] cd "perf/compiler/T13379.run" && "/home/jrp/Projects/ghc/inplace/test spaces/ghc-stage2" -c T13379.hs -no-user-package-db -rtsopts -fno-warn- missed-specialisations -fshow-warning-groups -fdiagnostics-color=never -fno-diagnostics-show-caret -Werror=compat -dno-debug-output +RTS -V0 -tT13379.comp.stats --machine-readable -RTS =====> MultiLayerModules(normal) 6 of 27 [0, 1, 0] cd "perf/compiler/MultiLayerModules.run" && ./genMultiLayerModules cd "perf/compiler/MultiLayerModules.run" && "/home/jrp/Projects/ghc/inplace/test spaces/ghc-stage2" --make MultiLayerModules -no-user-package-db -rtsopts -fno-warn-missed- specialisations -fshow-warning-groups -fdiagnostics-color=never -fno- diagnostics-show-caret -Werror=compat -dno-debug-output -v0 +RTS -V0 -tMultiLayerModules.comp.stats --machine-readable -RTS =====> ManyConstructors(normal) 7 of 27 [0, 1, 0] cd "perf/compiler/ManyConstructors.run" && ./genManyConstructors cd "perf/compiler/ManyConstructors.run" && "/home/jrp/Projects/ghc/inplace/test spaces/ghc-stage2" --make ManyConstructors -no-user-package-db -rtsopts -fno-warn-missed- specialisations -fshow-warning-groups -fdiagnostics-color=never -fno- diagnostics-show-caret -Werror=compat -dno-debug-output -v0 +RTS -V0 -tManyConstructors.comp.stats --machine-readable -RTS =====> ManyAlternatives(normal) 8 of 27 [0, 1, 0] cd "perf/compiler/ManyAlternatives.run" && ./genManyAlternatives cd "perf/compiler/ManyAlternatives.run" && "/home/jrp/Projects/ghc/inplace/test spaces/ghc-stage2" --make ManyAlternatives -no-user-package-db -rtsopts -fno-warn-missed- specialisations -fshow-warning-groups -fdiagnostics-color=never -fno- diagnostics-show-caret -Werror=compat -dno-debug-output -v0 +RTS -V0 -tManyAlternatives.comp.stats --machine-readable -RTS =====> T13701(normal) 9 of 27 [0, 1, 0] cd "perf/compiler/T13701.run" && ./genT13701 cd "perf/compiler/T13701.run" && "/home/jrp/Projects/ghc/inplace/test spaces/ghc-stage2" --make T13701 -no-user-package-db -rtsopts -fno-warn- missed-specialisations -fshow-warning-groups -fdiagnostics-color=never -fno-diagnostics-show-caret -Werror=compat -dno-debug-output -v0 +RTS -V0 -tT13701.comp.stats --machine-readable -RTS =====> T13719(normal) 10 of 27 [0, 1, 0] cd "perf/compiler/T13719.run" && ./genT13719 cd "perf/compiler/T13719.run" && "/home/jrp/Projects/ghc/inplace/test spaces/ghc-stage2" --make T13719 -no-user-package-db -rtsopts -fno-warn- missed-specialisations -fshow-warning-groups -fdiagnostics-color=never -fno-diagnostics-show-caret -Werror=compat -dno-debug-output -v0 +RTS -V0 -tT13719.comp.stats --machine-readable -RTS =====> T14697(normal) 11 of 27 [0, 1, 0] cd "perf/compiler/T14697.run" && ./genT14697 cd "perf/compiler/T14697.run" && "/home/jrp/Projects/ghc/inplace/test spaces/ghc-stage2" --make T14697 -no-user-package-db -rtsopts -fno-warn- missed-specialisations -fshow-warning-groups -fdiagnostics-color=never -fno-diagnostics-show-caret -Werror=compat -dno-debug-output $(cat T14697-flags) -v0 +RTS -V0 -tT14697.comp.stats --machine-readable -RTS =====> T14683(normal) 12 of 27 [0, 1, 0] cd "perf/compiler/T14683.run" && "/home/jrp/Projects/ghc/inplace/test spaces/ghc-stage2" --make T14683 -no-user-package-db -rtsopts -fno-warn- missed-specialisations -fshow-warning-groups -fdiagnostics-color=never -fno-diagnostics-show-caret -Werror=compat -dno-debug-output -v0 +RTS -V0 -tT14683.comp.stats --machine-readable -RTS =====> T9630(normal) 13 of 27 [0, 1, 0] cd "perf/compiler/T9630.run" && "/home/jrp/Projects/ghc/inplace/test spaces/ghc-stage2" --make T9630 -no-user-package-db -rtsopts -fno-warn- missed-specialisations -fshow-warning-groups -fdiagnostics-color=never -fno-diagnostics-show-caret -Werror=compat -dno-debug-output -v0 -O +RTS -V0 -tT9630.comp.stats --machine-readable -RTS =====> T15164(normal) 14 of 27 [0, 1, 0] cd "perf/compiler/T15164.run" && "/home/jrp/Projects/ghc/inplace/test spaces/ghc-stage2" -c T15164.hs -no-user-package-db -rtsopts -fno-warn- missed-specialisations -fshow-warning-groups -fdiagnostics-color=never -fno-diagnostics-show-caret -Werror=compat -dno-debug-output -v0 -O +RTS -V0 -tT15164.comp.stats --machine-readable -RTS =====> T14936(normal) 15 of 27 [0, 1, 0] cd "perf/should_run/T14936.run" && "/home/jrp/Projects/ghc/inplace/test spaces/ghc-stage2" -o T14936 T14936.hs -dcore-lint -dcmm-lint -no-user- package-db -rtsopts -fno-warn-missed-specialisations -fshow-warning-groups -fdiagnostics-color=never -fno-diagnostics-show-caret -Werror=compat -dno- debug-output -O2 cd "perf/should_run/T14936.run" && ./T14936 +RTS -V0 -tT14936.stats --machine-readable -RTS =====> space_leak_001(normal) 16 of 27 [0, 1, 0] cd "perf/space_leaks/space_leak_001.run" && "/home/jrp/Projects/ghc/inplace/test spaces/ghc-stage2" -o space_leak_001 space_leak_001.hs -dcore-lint -dcmm-lint -no-user-package- db -rtsopts -fno-warn-missed-specialisations -fshow-warning-groups -fdiagnostics-color=never -fno-diagnostics-show-caret -Werror=compat -dno- debug-output cd "perf/space_leaks/space_leak_001.run" && ./space_leak_001 +RTS -V0 -tspace_leak_001.stats --machine-readable -RTS =====> T4334(normal) 17 of 27 [0, 1, 0] cd "perf/space_leaks/T4334.run" && "/home/jrp/Projects/ghc/inplace/test spaces/ghc-stage2" -o T4334 T4334.hs -dcore-lint -dcmm-lint -no-user- package-db -rtsopts -fno-warn-missed-specialisations -fshow-warning-groups -fdiagnostics-color=never -fno-diagnostics-show-caret -Werror=compat -dno- debug-output cd "perf/space_leaks/T4334.run" && ./T4334 +RTS -V0 -tT4334.stats --machine-readable -RTS 1000000 2 t =====> ArithInt8(normal) 18 of 27 [0, 1, 0] cd "primops/should_run/ArithInt8.run" && "/home/jrp/Projects/ghc/inplace/test spaces/ghc-stage2" -o ArithInt8 ArithInt8.hs -dcore-lint -dcmm-lint -no-user-package-db -rtsopts -fno- warn-missed-specialisations -fshow-warning-groups -fdiagnostics- color=never -fno-diagnostics-show-caret -Werror=compat -dno-debug-output cd "primops/should_run/ArithInt8.run" && ./ArithInt8 =====> ArithWord8(normal) 19 of 27 [0, 1, 0] cd "primops/should_run/ArithWord8.run" && "/home/jrp/Projects/ghc/inplace/test spaces/ghc-stage2" -o ArithWord8 ArithWord8.hs -dcore-lint -dcmm-lint -no-user-package-db -rtsopts -fno- warn-missed-specialisations -fshow-warning-groups -fdiagnostics- color=never -fno-diagnostics-show-caret -Werror=compat -dno-debug-output cd "primops/should_run/ArithWord8.run" && ./ArithWord8 =====> CmpInt8(normal) 20 of 27 [0, 1, 0] cd "primops/should_run/CmpInt8.run" && "/home/jrp/Projects/ghc/inplace/test spaces/ghc-stage2" -o CmpInt8 CmpInt8.hs -dcore-lint -dcmm-lint -no-user-package-db -rtsopts -fno-warn- missed-specialisations -fshow-warning-groups -fdiagnostics-color=never -fno-diagnostics-show-caret -Werror=compat -dno-debug-output cd "primops/should_run/CmpInt8.run" && ./CmpInt8 =====> CmpWord8(normal) 21 of 27 [0, 1, 0] cd "primops/should_run/CmpWord8.run" && "/home/jrp/Projects/ghc/inplace/test spaces/ghc-stage2" -o CmpWord8 CmpWord8.hs -dcore-lint -dcmm-lint -no-user-package-db -rtsopts -fno-warn- missed-specialisations -fshow-warning-groups -fdiagnostics-color=never -fno-diagnostics-show-caret -Werror=compat -dno-debug-output cd "primops/should_run/CmpWord8.run" && ./CmpWord8 =====> ShowPrim(normal) 22 of 27 [0, 1, 0] cd "primops/should_run/ShowPrim.run" && "/home/jrp/Projects/ghc/inplace/test spaces/ghc-stage2" -o ShowPrim ShowPrim.hs -dcore-lint -dcmm-lint -no-user-package-db -rtsopts -fno-warn- missed-specialisations -fshow-warning-groups -fdiagnostics-color=never -fno-diagnostics-show-caret -Werror=compat -dno-debug-output cd "primops/should_run/ShowPrim.run" && ./ShowPrim =====> T2783(normal) 23 of 27 [0, 1, 0] cd "rts/T2783.run" && "/home/jrp/Projects/ghc/inplace/test spaces/ghc- stage2" -o T2783 T2783.hs -dcore-lint -dcmm-lint -no-user-package-db -rtsopts -fno-warn-missed-specialisations -fshow-warning-groups -fdiagnostics-color=never -fno-diagnostics-show-caret -Werror=compat -dno- debug-output cd "rts/T2783.run" && ./T2783 =====> T7919(normal) 24 of 27 [0, 1, 0] cd "rts/T7919.run" && "/home/jrp/Projects/ghc/inplace/test spaces/ghc- stage2" -o T7919 T7919.hs -dcore-lint -dcmm-lint -no-user-package-db -rtsopts -fno-warn-missed-specialisations -fshow-warning-groups -fdiagnostics-color=never -fno-diagnostics-show-caret -Werror=compat -dno- debug-output -dynamic cd "rts/T7919.run" && ./T7919 =====> T14761c(normal) 25 of 27 [0, 1, 0] cd "typecheck/should_compile/T14761c.run" && "/home/jrp/Projects/ghc/inplace/test spaces/ghc-stage2" -c T14761c.hs -dcore-lint -dcmm-lint -no-user-package-db -rtsopts -fno-warn-missed- specialisations -fshow-warning-groups -fdiagnostics-color=never -fno- diagnostics-show-caret -Werror=compat -dno-debug-output -fno-warn- incomplete-patterns =====> user001(normal) 26 of 27 [0, 1, 0] cd "libraries/unix/tests/user001.run" && "/home/jrp/Projects/ghc/inplace/test spaces/ghc-stage2" -o user001 user001.hs -dcore-lint -dcmm-lint -no-user-package-db -rtsopts -fno-warn- missed-specialisations -fshow-warning-groups -fdiagnostics-color=never -fno-diagnostics-show-caret -Werror=compat -dno-debug-output -package unix cd "libraries/unix/tests/user001.run" && ./user001 Actual stdout output differs from expected: diff -uw "libraries/unix/tests/user001.run/user001.stdout.normalised" "libraries/unix/tests/user001.run/user001.run.stdout.normalised" --- libraries/unix/tests/user001.run/user001.stdout.normalised 2018-11-05 21:18:01.037442648 +0000 +++ libraries/unix/tests/user001.run/user001.run.stdout.normalised 2018-11-05 21:18:01.037442648 +0000 @@ -6,6 +6,6 @@ getEffectiveUserName: OK getGroupEntryForID: OK getGroupEntryForName: OK -getAllGroupEntries: OK +getAllGroupEntries: ERROR: getAllGroupEntries: does not exist (No such file or directory) getUserEntryForID: OK -getAllUserEntries: OK +getAllUserEntries: ERROR: getAllUserEntries: does not exist (No such file or directory) *** unexpected failure for user001(normal) =====> T3816(normal) 27 of 27 [0, 2, 0] cd "libraries/unix/tests/T3816.run" && "/home/jrp/Projects/ghc/inplace/test spaces/ghc-stage2" -o T3816 T3816.hs -dcore-lint -dcmm-lint -no-user-package-db -rtsopts -fno-warn- missed-specialisations -fshow-warning-groups -fdiagnostics-color=never -fno-diagnostics-show-caret -Werror=compat -dno-debug-output -package unix cd "libraries/unix/tests/T3816.run" && ./T3816 Wrong exit code for T3816(normal)(expected 0 , actual 1 ) Stderr ( T3816 ): T3816: getAllGroupEntries: does not exist (No such file or directory) *** unexpected failure for T3816(normal) Unexpected results from: TEST="T15859 T3816 user001" SUMMARY for test run started at Mon Nov 5 21:16:04 2018 GMT 0:01:58 spent to go through 27 total tests, which gave rise to 161 test cases, of which 134 were skipped 0 had missing libraries 24 expected passes 0 expected failures 0 caused framework failures 0 caused framework warnings 0 unexpected passes 3 unexpected failures 0 unexpected stat failures Unexpected failures: dependent/should_fail/T15859.run T15859 [stderr mismatch] (normal) libraries/unix/tests/user001.run user001 [bad stdout] (normal) libraries/unix/tests/T3816.run T3816 [bad exit code] (normal) make[1]: *** [../mk/test.mk:330: test] Error 1 make[1]: Leaving directory '/home/jrp/Projects/ghc/testsuite/tests' make: *** [Makefile:224: test] Error 2 }}} -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/15736#comment:10 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler