[GHC] #16153: ghc 8.6.3 fails to build on macOS Sierra, High Sierra and Mojave (10.12 to 10.14)

#16153: ghc 8.6.3 fails to build on macOS Sierra, High Sierra and Mojave (10.12 to 10.14) -------------------------------------+------------------------------------- Reporter: fxcoudert | Owner: (none) Type: bug | Status: new Priority: normal | Milestone: Component: Compiler | Version: 8.6.3 Keywords: | Operating System: MacOS X Architecture: x86_64 | Type of failure: GHC doesn't work (amd64) | at all Test Case: | Blocked By: Blocking: | Related Tickets: Differential Rev(s): | Wiki Page: -------------------------------------+------------------------------------- We at Homebrew are trying to upgrade the ghc version we ship to 8.6.3. However, many test failures are occurring: https://github.com/Homebrew /homebrew-core/pull/35773 {{{ SUMMARY for test run started at Tue Jan 8 18:16:47 2019 GMT 0:55:14 spent to go through 6521 total tests, which gave rise to 25300 test cases, of which 18851 were skipped 28 had missing libraries 5900 expected passes 90 expected failures 0 caused framework failures 0 caused framework warnings 1 unexpected passes 422 unexpected failures 8 unexpected stat failures }}} I am attaching the full build output. -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/16153 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler

#16153: ghc 8.6.3 fails to build on macOS Sierra, High Sierra and Mojave (10.12 to 10.14) -------------------------------------+------------------------------------- Reporter: fxcoudert | Owner: (none) Type: bug | Status: new Priority: normal | Milestone: Component: Compiler | Version: 8.6.3 Resolution: | Keywords: Operating System: MacOS X | Architecture: x86_64 Type of failure: GHC doesn't work | (amd64) at all | Test Case: Blocked By: | Blocking: Related Tickets: | Differential Rev(s): Wiki Page: | -------------------------------------+------------------------------------- Comment (by fxcoudert): Build output is here: https://gist.github.com/fxcoudert/7d5552ed3d5eb936938a16b3747e4117 -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/16153#comment:1 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler

#16153: ghc 8.6.3 fails to build on macOS Sierra, High Sierra and Mojave (10.12 to 10.14) -------------------------------------+------------------------------------- Reporter: fxcoudert | Owner: (none) Type: bug | Status: infoneeded Priority: normal | Milestone: Component: Compiler | Version: 8.6.3 Resolution: | Keywords: Operating System: MacOS X | Architecture: x86_64 Type of failure: GHC doesn't work | (amd64) at all | Test Case: Blocked By: | Blocking: Related Tickets: | Differential Rev(s): Wiki Page: | -------------------------------------+------------------------------------- Changes (by bgamari): * status: new => infoneeded Comment: Most of the test failures I see in that log are of the form: {{{ =====> T9776(normal) 1124 of 6521 [0, 129, 0] cd "./driver/T9776.run" && "/private/tmp/ghc-20190108-10122-1a2rxgx/ghc-8.6.3/inplace/bin/ghc-stage2" -c T9776.hs -dcore-lint -dcmm-lint -no-user-package-db -rtsopts -fno-warn- missed-specialisations -fshow-warning-groups -fdiagnostics-color=never -fno-diagnostics-show-caret -dno-debug-output -drule-check--- /dev/null 2019-01-08 18:24:33.000000000 +0000 +++ ./driver/write_interface_oneshot.run/write_interface_oneshot.run.stderr.normalised 2019-01-08 18:24:33.000000000 +0000 @@ -0,0 +1 @@ +make[3]: warning: jobserver unavailable: using -j1. Add `+' to parent make rule. }}} This is because `-j` was passed to `make test`. Try removing `-j` from the `make test` invocation. -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/16153#comment:2 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler

#16153: ghc 8.6.3 fails to build on macOS Sierra, High Sierra and Mojave (10.12 to 10.14) -------------------------------------+------------------------------------- Reporter: fxcoudert | Owner: (none) Type: bug | Status: infoneeded Priority: normal | Milestone: Component: Compiler | Version: 8.6.3 Resolution: | Keywords: Operating System: MacOS X | Architecture: x86_64 Type of failure: GHC doesn't work | (amd64) at all | Test Case: Blocked By: | Blocking: Related Tickets: | Differential Rev(s): Wiki Page: | -------------------------------------+------------------------------------- Comment (by fxcoudert): Does the testsuite not support parallel build? It used to work without issue in previous versions, such 8.4.4. If not, it is really disappointing given it takes such a long time to run already… if it needs to be run without parallel execution, we probably will disable it in Homebrew, which will sadly lower the quality of our checks. -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/16153#comment:3 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler

#16153: ghc 8.6.3 fails to build on macOS Sierra, High Sierra and Mojave (10.12 to 10.14) -------------------------------------+------------------------------------- Reporter: fxcoudert | Owner: (none) Type: bug | Status: infoneeded Priority: normal | Milestone: Component: Compiler | Version: 8.6.3 Resolution: | Keywords: Operating System: MacOS X | Architecture: x86_64 Type of failure: GHC doesn't work | (amd64) at all | Test Case: Blocked By: | Blocking: Related Tickets: | Differential Rev(s): Wiki Page: | -------------------------------------+------------------------------------- Comment (by fxcoudert): Without parallel build, the testsuite still fails: {{{ SUMMARY for test run started at Thu Jan 17 10:51:28 2019 GMT 2:38:00 spent to go through 6521 total tests, which gave rise to 25300 test cases, of which 18851 were skipped 28 had missing libraries 6321 expected passes 90 expected failures 0 caused framework failures 0 caused framework warnings 1 unexpected passes 1 unexpected failures 8 unexpected stat failures Unexpected passes: driver/should_fail/T12752.run T12752 [unexpected] (normal) Unexpected failures: ghci/scripts/ghci063.run ghci063 [bad stderr] (ghci) Unexpected stat failures: perf/compiler/T5631.run T5631 [stat too good] (normal) perf/compiler/parsing001.run parsing001 [stat too good] (normal) perf/compiler/T10370.run T10370 [stat not good enough] (optasm) perf/compiler/T9630.run T9630 [stat not good enough] (normal) perf/haddock/haddock.base.run haddock.base [stat too good] (normal) perf/haddock/haddock.Cabal.run haddock.Cabal [stat too good] (normal) perf/should_run/T9203.run T9203 [stat too good] (normal) perf/space_leaks/T4029.run T4029 [stat not good enough] (ghci) }}} Full output here: https://gist.github.com/fxcoudert/7fe4950fec822a65be59563100655658 -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/16153#comment:4 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler

#16153: ghc 8.6.3 fails to build on macOS Sierra, High Sierra and Mojave (10.12 to 10.14) -------------------------------------+------------------------------------- Reporter: fxcoudert | Owner: (none) Type: bug | Status: infoneeded Priority: normal | Milestone: Component: Compiler | Version: 8.6.3 Resolution: | Keywords: Operating System: MacOS X | Architecture: x86_64 Type of failure: GHC doesn't work | (amd64) at all | Test Case: Blocked By: | Blocking: Related Tickets: | Differential Rev(s): Wiki Page: | -------------------------------------+------------------------------------- Comment (by bgamari):
Does the testsuite not support parallel build? The testsuite does support parallel execution. However, to enable parallel execution you must use the `THREADS` variable.
For instance, {{{ make test THREADS=9 }}} For details see wiki:Building/RunningTests/Running.
It used to work without issue in previous versions, such 8.4.4.
I'll admit I'm a bit skeptical; GHC's testsuite driver has never supported parallel execution using `make -j` as far as I know. Perhaps it didn't break as violently, but it certainly never worked. -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/16153#comment:5 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler

#16153: ghc 8.6.3 fails to build on macOS Sierra, High Sierra and Mojave (10.12 to 10.14) -------------------------------------+------------------------------------- Reporter: fxcoudert | Owner: (none) Type: bug | Status: infoneeded Priority: normal | Milestone: Component: Compiler | Version: 8.6.3 Resolution: | Keywords: Operating System: MacOS X | Architecture: x86_64 Type of failure: GHC doesn't work | (amd64) at all | Test Case: Blocked By: | Blocking: Related Tickets: | Differential Rev(s): Wiki Page: | -------------------------------------+------------------------------------- Comment (by bgamari):
Without parallel build, the testsuite still fails:
Indeed `ghci063` is a known issue. See #16201. As far as the others are concerned: `T12752` is odd but smells of a broken toolchain (CPP is expected to throw an error on this test due to `-Wcpp- undef`). The rest are performance tests which indeed may vary from machine to machine (see #12758 which improves this situation in `master`). -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/16153#comment:6 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler

#16153: ghc 8.6.3 fails to build on macOS Sierra, High Sierra and Mojave (10.12 to 10.14) -------------------------------------+------------------------------------- Reporter: fxcoudert | Owner: (none) Type: bug | Status: infoneeded Priority: normal | Milestone: Component: Compiler | Version: 8.6.3 Resolution: | Keywords: Operating System: MacOS X | Architecture: x86_64 Type of failure: GHC doesn't work | (amd64) at all | Test Case: Blocked By: | Blocking: Related Tickets: | Differential Rev(s): Wiki Page: | -------------------------------------+------------------------------------- Comment (by fxcoudert): Until now, the testsuite used to pass cleanly on all releases we shipped. Given that it's not the case any more, I am removing the testsuite entirely from the Homebrew build and test process. We'll just hope that the checks performed during your QC cycles on macOS are sufficient. -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/16153#comment:7 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler

#16153: ghc 8.6.3 fails to build on macOS Sierra, High Sierra and Mojave (10.12 to 10.14) -------------------------------------+------------------------------------- Reporter: fxcoudert | Owner: (none) Type: bug | Status: infoneeded Priority: normal | Milestone: Component: Compiler | Version: 8.6.3 Resolution: | Keywords: Operating System: MacOS X | Architecture: x86_64 Type of failure: GHC doesn't work | (amd64) at all | Test Case: Blocked By: | Blocking: Related Tickets: | Differential Rev(s): Wiki Page: | -------------------------------------+------------------------------------- Comment (by bgamari): fxcoudert, to be clear, I would love to understand `T12752` better but cannot reproduce it on our intrastructure. Can you describe your environment? -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/16153#comment:8 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler
participants (1)
-
GHC