ghc 8.6.x release clearly fails validate or even make test, some help please!

Hey Everyone ... I'm concerned, it looks like ghc 8.6.2 on OSX doens't pass validate or even a rudimentary `make test` I'm not sure how to make heads or tails of all these errors, and it looks like a huge amount of dev work over time has accumulated some failures .... could the code owners on these sub systems at least help me make heads or tails of these errors? SUMMARY for test run started at Mon Nov 19 19:48:18 2018 EST 0:28:32 spent to go through 6516 total tests, which gave rise to 25425 test cases, of which 18538 were skipped 41 had missing libraries 6380 expected passes 92 expected failures 2 caused framework failures 0 caused framework warnings 0 unexpected passes 365 unexpected failures 7 unexpected stat failures Unexpected failures: backpack/cabal/bkpcabal05/bkpcabal05.run bkpcabal05 [bad stderr] (normal) backpack/cabal/bkpcabal02/bkpcabal02.run bkpcabal02 [bad stderr] (normal) backpack/cabal/bkpcabal06/bkpcabal06.run bkpcabal06 [bad stderr] (normal) backpack/cabal/bkpcabal04/bkpcabal04.run bkpcabal04 [bad stderr] (normal) backpack/cabal/bkpcabal07/bkpcabal07.run bkpcabal07 [bad stderr] (normal) backpack/cabal/bkpcabal03/bkpcabal03.run bkpcabal03 [bad stderr] (normal) backpack/cabal/T14304/T14304.run T14304 [bad stderr] (normal) cabal/T12485/T12485.run T12485 [bad stderr] (normal) backpack/cabal/bkpcabal01/bkpcabal01.run bkpcabal01 [bad stderr] (normal) cabal/cabal04/cabal04.run cabal04 [bad stderr] (normal) cabal/T12733/T12733.run T12733 [bad stderr] (normal) cabal/cabal01/cabal01.run cabal01 [bad stderr] (normal) cabal/cabal09/cabal09.run cabal09 [bad stderr] (normal) cabal/cabal03/cabal03.run cabal03 [bad stderr] (normal) codeGen/should_compile/T2578.run T2578 [bad stderr] (normal) cabal/cabal08/cabal08.run cabal08 [bad stderr] (normal) codeGen/should_compile/debug.run debug [bad stderr] (normal) cabal/cabal05/cabal05.run cabal05 [bad stderr] (normal) cabal/cabal06/cabal06.run cabal06 [bad stderr] (normal) deSugar/should_run/T5522.run T5522 [stderr mismatch] (optasm) driver/driver062a.run driver062a [bad stderr] (normal) driver/driver062b.run driver062b [bad stderr] (normal) driver/driver062c.run driver062c [bad stderr] (normal) driver/driver062d.run driver062d [bad stderr] (normal) driver/driver062e.run driver062e [bad stderr] (normal) driver/driver081a.run driver081a [bad stderr] (normal) driver/driver081b.run driver081b [bad stderr] (normal) driver/rtsopts002.run rtsopts002 [bad stderr] (normal) driver/T3674.run T3674 [bad stderr] (normal) driver/rtsopts001.run rtsopts001 [bad stderr] (normal) driver/withRtsOpts.run withRtsOpts [bad stderr] (normal) driver/T703.run T703 [bad stderr] (normal) driver/T5313.run T5313 [bad exit code] (normal) driver/T9938.run T9938 [bad stderr] (normal) driver/T9938B.run T9938B [bad stderr] (normal) driver/T12971.run T12971 [bad stderr] (normal) driver/T10320.run T10320 [bad stderr] (normal) driver/T7835/T7835.run T7835 [bad stderr] (normal) driver/T437/T437.run T437 [bad stderr] (normal) driver/T13914/T13914.run T13914 [bad stderr] (normal) driver/T1959/T1959.run T1959 [bad stderr] (normal) driver/dynamic_flags_001/dynamic_flags_001.run dynamic_flags_001 [bad stderr] (normal) driver/dynamicToo/dynamicToo001/dynamicToo001.run dynamicToo001 [bad stderr] (normal) driver/recomp001/recomp001.run recomp001 [bad stderr] (normal) driver/linkwhole/linkwhole.run linkwhole [bad stderr] (normal) driver/T3007/T3007.run T3007 [bad stderr] (normal) driver/recomp004/recomp004.run recomp004 [bad stderr] (normal) driver/T1372/T1372.run T1372 [bad stderr] (normal) driver/recomp010/recomp010.run recomp010 [bad stderr] (normal) driver/recomp008/recomp008.run recomp008 [bad stderr] (normal) driver/recomp012/recomp012.run recomp012 [bad stderr] (normal) driver/recomp011/recomp011.run recomp011 [bad stderr] (normal) driver/recomp007/recomp007.run recomp007 [bad stderr] (normal) ffi/should_run/Capi_Ctype_002.run Capi_Ctype_002 [bad stderr] (normal) ffi/should_run/Capi_Ctype_001.run Capi_Ctype_001 [bad stderr] (normal) gadt/gadt23.run gadt23 [bad stderr] (normal) ghc-api/T10508_api.run T10508_api [bad exit code] (normal) ghc-api/T8628.run T8628 [bad exit code] (normal) ghc-api/T6145.run T6145 [bad stderr] (normal) ghc-api/T8639_api.run T8639_api [bad exit code] (normal) ghc-api/T10052/T10052.run T10052 [bad exit code] (normal) ghc-api/T4891/T4891.run T4891 [bad stderr] (normal) ghc-api/T7478/T7478.run T7478 [bad stderr] (normal) ghc-api/dynCompileExpr/dynCompileExpr.run dynCompileExpr [bad exit code] (normal) ghc-api/show-srcspan/showsrcspan.run showsrcspan [bad stderr] (normal) ghc-api/annotations-literals/literals.run literals [bad stderr] (normal) ghc-api/annotations-literals/parsed.run parsed [bad stderr] (normal) ghci/linking/dyn/T10955dyn.run T10955dyn [bad stderr] (normal) ghci/prog001/prog001.run prog001 [bad exit code] (ghci-ext) ghci/scripts/ghci063.run ghci063 [bad stderr] (ghci) ghci/scripts/ghci062.run ghci062 [bad exit code] (ghci-ext) hsc2hs/hsc2hs003.run hsc2hs003 [bad stderr] (normal) hsc2hs/hsc2hs004.run hsc2hs004 [bad stderr] (normal) hsc2hs/T4340.run T4340 [bad stderr] (normal) hsc2hs/T10272.run T10272 [bad stderr] (normal) lib/integer/integerConstantFolding.run integerConstantFolding [bad stderr] (normal) module/mod179.run mod179 [stderr mismatch] (normal) numeric/should_compile/T7116.run T7116 [bad stdout] (normal) numeric/should_compile/T14170.run T14170 [bad stdout] (normal) numeric/should_compile/T14465.run T14465 [bad stdout] (normal) module/mod175/mod175.run mod175 [bad stderr] (normal) numeric/should_run/T7014.run T7014 [bad stderr] (normal) parser/should_compile/T5243.run T5243 [stderr mismatch] (normal) parser/should_compile/T7476/T7476.run T7476 [bad stderr] (normal) patsyn/should_compile/T13350/T13350.run T13350 [bad stderr] (normal) perf/should_run/T3736.run T3736 [bad stderr] (normal) perf/should_run/T149.run T149 [bad stderr] (normal) perf/should_run/T2902.run T2902 [bad stderr] (normal) plugins/plugin-recomp-change.run plugin-recomp-change [bad stderr] (normal) plugins/plugin-recomp-change-prof.run plugin-recomp-change-prof [bad stderr] (normal) programs/hs-boot/hs-boot.run hs-boot [stderr mismatch] (normal) rename/prog006/rn.prog006.run rn.prog006 [bad stderr] (normal) rename/should_compile/T15149.run T15149 [stderr mismatch] (normal) rts/outofmem2.run outofmem2 [bad stderr] (normal) rts/T4059.run T4059 [bad stderr] (normal) rts/T4850.run T4850 [bad stderr] (normal) rts/T5423.run T5423 [bad stderr] (normal) rts/T5435_v_asm_a.run T5435_v_asm_a [bad stderr] (normal) rts/T5435_v_gcc.run T5435_v_gcc [bad stderr] (normal) rts/T5435_dyn_asm.run T5435_dyn_asm [bad stderr] (normal) rts/T5435_dyn_gcc.run T5435_dyn_gcc [bad stderr] (normal) rts/T7037.run T7037 [bad stderr] (normal) rts/linker_unload.run linker_unload [bad exit code] (normal) rts/T9405.run T9405 [bad stderr] (normal) rts/T10296a.run T10296a [bad stderr] (normal) rts/T1791/T1791.run T1791 [bad stderr] (normal) rts/T8308/T8308.run T8308 [bad stderr] (normal) rts/T9579/T9579_stackoverflow_rtsnone.run T9579_stackoverflow_rtsnone [bad stderr] (normal) rts/T9579/T9579_stackoverflow_rtssome.run T9579_stackoverflow_rtssome [bad stderr] (normal) rts/T9579/T9579_stackoverflow_rtsall.run T9579_stackoverflow_rtsall [bad stderr] (normal) rts/T9579/T9579_stackoverflow_rtsall_no_suggestions.run T9579_stackoverflow_rtsall_no_suggestions [bad stderr] (normal) rts/T9579/T9579_outofheap_rtsnone.run T9579_outofheap_rtsnone [bad stderr] (normal) rts/T9579/T9579_outofheap_rtssome.run T9579_outofheap_rtssome [bad stderr] (normal) rts/T9579/T9579_outofheap_rtsall.run T9579_outofheap_rtsall [bad stderr] (normal) rts/T9579/T9579_outofheap_rtsall_no_suggestions.run T9579_outofheap_rtsall_no_suggestions [bad stderr] (normal) safeHaskell/check/Check04.run Check04 [stderr mismatch] (normal) safeHaskell/check/pkg01/safePkg01.run safePkg01 [bad stderr] (normal) simplCore/should_compile/T3717.run T3717 [stderr mismatch] (optasm) simplCore/should_compile/spec-inline.run spec-inline [stderr mismatch] (optasm) simplCore/should_compile/T4908.run T4908 [stderr mismatch] (optasm) simplCore/should_compile/T4930.run T4930 [stderr mismatch] (optasm) simplCore/should_compile/T3772.run T3772 [bad stdout] (normal) simplCore/should_compile/T4918.run T4918 [bad stdout] (normal) simplCore/should_compile/T7360.run T7360 [stderr mismatch] (optasm) simplCore/should_compile/T8832.run T8832 [bad stdout] (normal) simplCore/should_compile/T12076.run T12076 [stderr mismatch] (normal) simplCore/should_compile/par01.run par01 [stderr mismatch] (optasm) simplCore/should_compile/T13143.run T13143 [stderr mismatch] (optasm) simplCore/should_compile/T12603.run T12603 [bad stdout] (normal) simplCore/should_compile/str-rules.run str-rules [bad stdout] (normal) simplCore/should_compile/T14186.run T14186 [stderr mismatch] (optasm) th/TH_overloadedlabels.run TH_overloadedlabels [exit code non-0] (ext-interp) th/TH_mkName.run TH_mkName [exit code non-0] (ext-interp) th/TH_1tuple.run TH_1tuple [stderr mismatch] (ext-interp) th/TH_repPrim.run TH_repPrim [exit code non-0] (ext-interp) th/TH_repPrim2.run TH_repPrim2 [exit code non-0] (ext-interp) th/TH_repUnboxedTuples.run TH_repUnboxedTuples [exit code non-0] (ext-interp) th/TH_repE2.run TH_repE2 [exit code non-0] (ext-interp) th/TH_spliceGuard.run TH_spliceGuard [exit code non-0] (ext-interp) th/TH_repGuard.run TH_repGuard [exit code non-0] (ext-interp) th/TH_repPrimOutput.run TH_repPrimOutput [exit code non-0] (ext-interp) th/TH_repPrimOutput2.run TH_repPrimOutput2 [exit code non-0] (ext-interp) th/TH_repGuardOutput.run TH_repGuardOutput [exit code non-0] (ext-interp) th/TH_overlaps.run TH_overlaps [exit code non-0] (ext-interp) th/TH_spliceE6.run TH_spliceE6 [exit code non-0] (ext-interp) th/TH_spliceD2.run TH_spliceD2 [exit code non-0] (ext-interp) th/TH_reifyDecl1.run TH_reifyDecl1 [exit code non-0] (ext-interp) th/TH_reifyDecl2.run TH_reifyDecl2 [exit code non-0] (ext-interp) th/TH_reifyLocalDefs.run TH_reifyLocalDefs [exit code non-0] (ext-interp) th/TH_reifyLocalDefs2.run TH_reifyLocalDefs2 [exit code non-0] (ext-interp) th/TH_reifyMkName.run TH_reifyMkName [exit code non-0] (ext-interp) th/TH_reifyInstances.run TH_reifyInstances [exit code non-0] (ext-interp) th/TH_spliceDecl1.run TH_spliceDecl1 [exit code non-0] (ext-interp) th/TH_spliceDecl2.run TH_spliceDecl2 [exit code non-0] (ext-interp) th/TH_spliceE1.run TH_spliceE1 [exit code non-0] (ext-interp) th/TH_spliceExpr1.run TH_spliceExpr1 [exit code non-0] (ext-interp) th/TH_class1.run TH_class1 [exit code non-0] (ext-interp) th/TH_spliceE3.run TH_spliceE3 [exit code non-0] (ext-interp) th/TH_tuple1.run TH_tuple1 [exit code non-0] (ext-interp) th/TH_spliceE4.run TH_spliceE4 [exit code non-0] (ext-interp) th/TH_spliceInst.run TH_spliceInst [exit code non-0] (ext-interp) th/TH_exn1.run TH_exn1 [stderr mismatch] (ext-interp) th/TH_dupdecl.run TH_dupdecl [stderr mismatch] (ext-interp) th/TH_exn2.run TH_exn2 [stderr mismatch] (ext-interp) th/TH_fail.run TH_fail [stderr mismatch] (ext-interp) th/TH_scopedTvs.run TH_scopedTvs [exit code non-0] (ext-interp) th/TH_recover.run TH_recover [exit code non-0] (ext-interp) th/TH_runIO.run TH_runIO [stderr mismatch] (ext-interp) th/TH_linePragma.run TH_linePragma [stderr mismatch] (ext-interp) th/T2700.run T2700 [exit code non-0] (ext-interp) th/T2817.run T2817 [exit code non-0] (ext-interp) th/T2713.run T2713 [stderr mismatch] (ext-interp) th/T2674.run T2674 [stderr mismatch] (ext-interp) th/TH_emptycase.run TH_emptycase [exit code non-0] (ext-interp) th/TH_sections.run TH_sections [exit code non-0] (ext-interp) th/TH_tf1.run TH_tf1 [exit code non-0] (ext-interp) th/TH_tf3.run TH_tf3 [exit code non-0] (ext-interp) th/TH_pragma.run TH_pragma [exit code non-0] (ext-interp) th/T3177.run T3177 [exit code non-0] (ext-interp) th/T3177a.run T3177a [stderr mismatch] (ext-interp) th/T3319.run T3319 [exit code non-0] (ext-interp) th/TH_foreignInterruptible.run TH_foreignInterruptible [exit code non-0] (ext-interp) th/TH_foreignCallingConventions.run TH_foreignCallingConventions [exit code non-0] (ext-interp) th/T3395.run T3395 [stderr mismatch] (ext-interp) th/T3100.run T3100 [exit code non-0] (ext-interp) th/T3920.run T3920 [exit code non-0] (ext-interp) th/T4188.run T4188 [exit code non-0] (ext-interp) th/T4436.run T4436 [exit code non-0] (ext-interp) th/T1835.run T1835 [exit code non-0] (ext-interp) th/T5217.run T5217 [exit code non-0] (ext-interp) th/T5037.run T5037 [exit code non-0] (ext-interp) th/TH_unboxedSingleton.run TH_unboxedSingleton [exit code non-0] (ext-interp) th/T5290.run T5290 [exit code non-0] (ext-interp) th/T5362.run T5362 [exit code non-0] (ext-interp) th/TH_unresolvedInfix2.run TH_unresolvedInfix2 [stderr mismatch] (ext-interp) th/T5358.run T5358 [stderr mismatch] (ext-interp) th/T5404.run T5404 [exit code non-0] (ext-interp) th/T5452.run T5452 [exit code non-0] (ext-interp) th/T5379.run T5379 [exit code non-0] (ext-interp) th/T5410.run T5410 [exit code non-0] (ext-interp) th/T5508.run T5508 [exit code non-0] (ext-interp) th/TH_PromotedTuple.run TH_PromotedTuple [exit code non-0] (ext-interp) th/TH_PromotedList.run TH_PromotedList [exit code non-0] (ext-interp) th/TH_Promoted1Tuple.run TH_Promoted1Tuple [stderr mismatch] (ext-interp) th/TH_RichKinds2.run TH_RichKinds2 [exit code non-0] (ext-interp) th/TH_RichKinds.run TH_RichKinds [exit code non-0] (ext-interp) th/T5882.run T5882 [exit code non-0] (ext-interp) th/T5883.run T5883 [exit code non-0] (ext-interp) th/T1541.run T1541 [exit code non-0] (ext-interp) th/T4135.run T4135 [exit code non-0] (ext-interp) th/T5968.run T5968 [exit code non-0] (ext-interp) th/T5971.run T5971 [stderr mismatch] (ext-interp) th/T5976.run T5976 [stderr mismatch] (ext-interp) th/T6005.run T6005 [exit code non-0] (ext-interp) th/T6005a.run T6005a [exit code non-0] (ext-interp) th/T6114.run T6114 [exit code non-0] (ext-interp) th/TH_TyInstWhere1.run TH_TyInstWhere1 [exit code non-0] (ext-interp) th/TH_StringPrimL.run TH_StringPrimL [exit code non-0] (ext-interp) th/TH_TyInstWhere2.run TH_TyInstWhere2 [exit code non-0] (ext-interp) th/T2222.run T2222 [exit code non-0] (ext-interp) th/T7681.run T7681 [exit code non-0] (ext-interp) th/ClosedFam1TH.run ClosedFam1TH [exit code non-0] (ext-interp) th/ClosedFam2TH.run ClosedFam2TH [exit code non-0] (ext-interp) th/T7910.run T7910 [exit code non-0] (ext-interp) th/TH_Roles1.run TH_Roles1 [stderr mismatch] (ext-interp) th/TH_Roles2.run TH_Roles2 [exit code non-0] (ext-interp) th/TH_Roles3.run TH_Roles3 [exit code non-0] (ext-interp) th/TH_Roles4.run TH_Roles4 [exit code non-0] (ext-interp) th/T4124.run T4124 [exit code non-0] (ext-interp) th/T4128.run T4128 [exit code non-0] (ext-interp) th/T4364.run T4364 [exit code non-0] (ext-interp) th/T8412.run T8412 [stderr mismatch] (ext-interp) th/T8186.run T8186 [exit code non-0] (ext-interp) th/T7667.run T7667 [exit code non-0] (ext-interp) th/T7667a.run T7667a [stderr mismatch] (ext-interp) th/T8499.run T8499 [exit code non-0] (ext-interp) th/T7477.run T7477 [exit code non-0] (ext-interp) th/T8507.run T8507 [exit code non-0] (ext-interp) th/T8759.run T8759 [exit code non-0] (ext-interp) th/TH_StaticPointers.run TH_StaticPointers [exit code non-0] (ext-interp) th/T8807.run T8807 [exit code non-0] (ext-interp) th/T8884.run T8884 [exit code non-0] (ext-interp) th/T8954.run T8954 [exit code non-0] (ext-interp) th/T8932.run T8932 [stderr mismatch] (ext-interp) th/T8987.run T8987 [stderr mismatch] (ext-interp) th/T7241.run T7241 [stderr mismatch] (ext-interp) th/T9199.run T9199 [exit code non-0] (ext-interp) th/T9262.run T9262 [exit code non-0] (ext-interp) th/T9692.run T9692 [exit code non-0] (ext-interp) th/T8953.run T8953 [exit code non-0] (ext-interp) th/T9738.run T9738 [exit code non-0] (ext-interp) th/T9081.run T9081 [exit code non-0] (ext-interp) th/T9066.run T9066 [exit code non-0] (ext-interp) th/T8100.run T8100 [exit code non-0] (ext-interp) th/T9064.run T9064 [exit code non-0] (ext-interp) th/T7484.run T7484 [stderr mismatch] (ext-interp) th/T1476.run T1476 [exit code non-0] (ext-interp) th/T8031.run T8031 [exit code non-0] (ext-interp) th/TH_Lift.run TH_Lift [exit code non-0] (ext-interp) th/T10279.run T10279 [stderr mismatch] (ext-interp) th/T10306.run T10306 [exit code non-0] (ext-interp) th/T10596.run T10596 [exit code non-0] (ext-interp) th/T10598_TH.run T10598_TH [exit code non-0] (ext-interp) th/T10638.run T10638 [stderr mismatch] (ext-interp) th/T10620.run T10620 [exit code non-0] (ext-interp) th/T10697_decided_1.run T10697_decided_1 [exit code non-0] (ext-interp) th/T10697_decided_2.run T10697_decided_2 [exit code non-0] (ext-interp) th/T10697_decided_3.run T10697_decided_3 [exit code non-0] (ext-interp) th/T6018th.run T6018th [stderr mismatch] (ext-interp) th/T10811.run T10811 [exit code non-0] (ext-interp) th/T10796a.run T10796a [exit code non-0] (ext-interp) th/T10796b.run T10796b [stderr mismatch] (ext-interp) th/T10810.run T10810 [exit code non-0] (ext-interp) th/T10828.run T10828 [exit code non-0] (ext-interp) th/T10828a.run T10828a [stderr mismatch] (ext-interp) th/T10828b.run T10828b [stderr mismatch] (ext-interp) th/T10891.run T10891 [exit code non-0] (ext-interp) th/T11341.run T11341 [exit code non-0] (ext-interp) th/TH_finalizer.run TH_finalizer [exit code non-0] (ext-interp) th/T10820.run T10820 [exit code non-0] (ext-interp) th/T11345.run T11345 [exit code non-0] (ext-interp) th/T10603.run T10603 [exit code non-0] (ext-interp) th/T11145.run T11145 [stderr mismatch] (ext-interp) th/T11721_TH.run T11721_TH [exit code non-0] (ext-interp) th/T11680.run T11680 [stderr mismatch] (ext-interp) th/T11809.run T11809 [exit code non-0] (ext-interp) th/T11463.run T11463 [exit code non-0] (ext-interp) th/T11797.run T11797 [exit code non-0] (ext-interp) th/T11484.run T11484 [exit code non-0] (ext-interp) th/T11629.run T11629 [exit code non-0] (ext-interp) th/T12387.run T12387 [stderr mismatch] (ext-interp) th/T8761.run T8761 [exit code non-0] (ext-interp) th/T12407.run T12407 [exit code non-0] (ext-interp) th/T12403.run T12403 [exit code non-0] (ext-interp) th/T12478_3.run T12478_3 [exit code non-0] (ext-interp) th/T12478_4.run T12478_4 [stderr mismatch] (ext-interp) th/T12478_5.run T12478_5 [exit code non-0] (ext-interp) th/T12503.run T12503 [exit code non-0] (ext-interp) th/T12478_1.run T12478_1 [exit code non-0] (ext-interp) th/T12478_2.run T12478_2 [exit code non-0] (ext-interp) th/T12513.run T12513 [stderr mismatch] (ext-interp) th/T12646.run T12646 [exit code non-0] (ext-interp) th/T12530.run T12530 [exit code non-0] (ext-interp) th/T12977.run T12977 [exit code non-0] (ext-interp) th/T13018.run T13018 [exit code non-0] (ext-interp) th/T12993.run T12993 [exit code non-0] (ext-interp) th/T13123.run T13123 [exit code non-0] (ext-interp) th/T13098.run T13098 [exit code non-0] (ext-interp) th/T11046.run T11046 [exit code non-0] (ext-interp) th/T13642.run T13642 [exit code non-0] (ext-interp) th/T13618.run T13618 [exit code non-0] (ext-interp) th/T13781.run T13781 [exit code non-0] (ext-interp) th/T13366.run T13366 [exit code non-0] (ext-interp) th/T13782.run T13782 [exit code non-0] (ext-interp) th/T13837.run T13837 [stderr mismatch] (ext-interp) th/T13856.run T13856 [exit code non-0] (ext-interp) th/T13968.run T13968 [stderr mismatch] (ext-interp) th/T13885.run T13885 [exit code non-0] (ext-interp) th/T14204.run T14204 [stderr mismatch] (ext-interp) th/T14646.run T14646 [exit code non-0] (ext-interp) th/T13887.run T13887 [exit code non-0] (ext-interp) th/T14681.run T14681 [exit code non-0] (ext-interp) th/T14060.run T14060 [exit code non-0] (ext-interp) th/T14817.run T14817 [exit code non-0] (ext-interp) th/T14843.run T14843 [exit code non-0] (ext-interp) th/T13776.run T13776 [exit code non-0] (ext-interp) th/T14875.run T14875 [exit code non-0] (ext-interp) th/T14885a.run T14885a [exit code non-0] (ext-interp) th/T14298.run T14298 [exit code non-0] (ext-interp) th/T14885b.run T14885b [exit code non-0] (ext-interp) th/T14885c.run T14885c [exit code non-0] (ext-interp) th/T15243.run T15243 [exit code non-0] (ext-interp) th/T15331.run T15331 [exit code non-0] (ext-interp) th/T15324.run T15324 [exit code non-0] (ext-interp) th/T15365.run T15365 [exit code non-0] (ext-interp) th/T15518.run T15518 [exit code non-0] (ext-interp) th/T15502.run T15502 [exit code non-0] (ext-interp) th/T15550.run T15550 [exit code non-0] (ext-interp) th/T15572.run T15572 [exit code non-0] (ext-interp) th/T15481.run T15481 [exit code non-0] (ext-interp) th/TH_recover_warns.run TH_recover_warns [exit code non-0] (ext-interp) typecheck/T13168/T13168.run T13168 [bad stderr] (normal) typecheck/bug1465/bug1465.run bug1465 [bad stderr] (normal) typecheck/should_compile/tc263.run tc263 [stderr mismatch] (normal) typecheck/should_fail/T13292.run T13292 [stderr mismatch] (normal) unboxedsums/T14051.run T14051 [stderr mismatch] (normal) unboxedsums/module/sum_mod.run sum_mod [bad stderr] (normal) warnings/should_compile/T10890/T10890.run T10890 [stderr mismatch] (normal) warnings/should_compile/T10890/T10890_1.run T10890_1 [stderr mismatch] (normal) warnings/should_compile/T13727/T13727a.run T13727a [stderr mismatch] (normal) warnings/should_compile/T13727/T13727b.run T13727b [stderr mismatch] (normal) warnings/should_compile/T13727/T13727c.run T13727c [stderr mismatch] (normal) warnings/should_compile/T13727/T13727d.run T13727d [stderr mismatch] (normal) warnings/should_compile/T13727/T13727e.run T13727e [stderr mismatch] (normal) warnings/should_compile/T13727/T13727f.run T13727f [stderr mismatch] (normal) warnings/should_compile/T13727/T13727g.run T13727g [stderr mismatch] (normal) warnings/should_compile/T13727/T13727h.run T13727h [stderr mismatch] (normal) warnings/should_compile/T13727/T13727i.run T13727i [stderr mismatch] (normal) warnings/should_compile/T13727/T13727j.run T13727j [stderr mismatch] (normal) warnings/should_compile/T13727/T13727k.run T13727k [stderr mismatch] (normal) ../../libraries/base/tests/IO/T3307.run T3307 [bad stderr] (normal) ../../libraries/base/tests/IO/environment001.run environment001 [bad stderr] (normal) ../../libraries/base/tests/IO/T12010/T12010.run T12010 [bad stderr] (threaded1) ../../libraries/base/tests/IO/concio001.run concio001 [bad stderr] (normal) ../../libraries/base/tests/IO/concio001.thr.run concio001.thr [bad stderr] (normal) Unexpected stat failures: perf/compiler/T12425.run T12425 [stat not good enough] (optasm) perf/compiler/T10370.run T10370 [stat not good enough] (optasm) perf/compiler/T9630.run T9630 [stat not good enough] (normal) perf/haddock/haddock.base.run haddock.base [stat not good enough] (normal) perf/haddock/haddock.Cabal.run haddock.Cabal [stat not good enough] (normal) perf/haddock/haddock.compiler.run haddock.compiler [stat not good enough] (normal) perf/should_run/T9203.run T9203 [stat too good] (normal)

On November 20, 2018 2:06:55 AM GMT+00:00, Carter Schonwald
Hey Everyone ... I'm concerned, it looks like ghc 8.6.2 on OSX doens't pass validate or even a rudimentary `make test`
I'm not sure how to make heads or tails of all these errors, and it looks like a huge amount of dev work over time has accumulated some failures ....
I can't reproduce this. The binary distributions are produced by CircleCI , which runs the test suite. Can you be more specific about how you are running this test? Cheers, - Ben -- Sent from my Android device with K-9 Mail. Please excuse my brevity.

Happy to:
What’s the best way to look at the Diffs / expected actual for 50 or so
tests? So I can better triage these things as important or not going
forward? For all I know it could be as simple as our passing diff stuff is
white space significant. But I need some guidance on what files I should
be looking at
I can’t find any docs on how to poke at / read those on the wiki. Alp
suggested just running a single test at a time, but that’s no ideal when
it’s so many ...
I ran that ghc build with clang from llvm 7 on high Sierra and no carter
patches.
I did cd testsuite ; make test THREADS=7
On Tue, Nov 20, 2018 at 2:10 AM Ben Gamari
On November 20, 2018 2:06:55 AM GMT+00:00, Carter Schonwald < carter.schonwald@gmail.com> wrote:
Hey Everyone ... I'm concerned, it looks like ghc 8.6.2 on OSX doens't pass validate or even a rudimentary `make test`
I'm not sure how to make heads or tails of all these errors, and it looks like a huge amount of dev work over time has accumulated some failures ....
I can't reproduce this. The binary distributions are produced by CircleCI , which runs the test suite.
Can you be more specific about how you are running this test?
Cheers,
- Ben
-- Sent from my Android device with K-9 Mail. Please excuse my brevity.

On November 20, 2018 1:23:29 PM EST, Carter Schonwald
Happy to:
What’s the best way to look at the Diffs / expected actual for 50 or so tests? So I can better triage these things as important or not going forward? For all I know it could be as simple as our passing diff stuff is white space significant. But I need some guidance on what files I should be looking at
I can’t find any docs on how to poke at / read those on the wiki. Alp suggested just running a single test at a time, but that’s no ideal when it’s so many ...
I ran that ghc build with clang from llvm 7 on high Sierra and no carter patches.
I did cd testsuite ; make test THREADS=7
You can add TEST="T1234 T5678" to the "make test" command line. This is documented here [1]. Does this help? Cheers, - Ben [1] https://ghc.haskell.org/trac/ghc/wiki/Building/RunningTests/Running#Commonly... -- Sent from my Android device with K-9 Mail. Please excuse my brevity.

That doesn’t help when I want to look at the output for 50 failed tests ...
is this a gap in our current tooling?
On Tue, Nov 20, 2018 at 2:40 PM Ben Gamari
On November 20, 2018 1:23:29 PM EST, Carter Schonwald < carter.schonwald@gmail.com> wrote:
Happy to:
What’s the best way to look at the Diffs / expected actual for 50 or so tests? So I can better triage these things as important or not going forward? For all I know it could be as simple as our passing diff stuff is white space significant. But I need some guidance on what files I should be looking at
I can’t find any docs on how to poke at / read those on the wiki. Alp suggested just running a single test at a time, but that’s no ideal when it’s so many ...
I ran that ghc build with clang from llvm 7 on high Sierra and no carter patches.
I did cd testsuite ; make test THREADS=7
You can add TEST="T1234 T5678" to the "make test" command line. This is documented here [1]. Does this help?
Cheers,
- Ben
[1] https://ghc.haskell.org/trac/ghc/wiki/Building/RunningTests/Running#Commonly...
-- Sent from my Android device with K-9 Mail. Please excuse my brevity.

My favourite way is (in the testsuite/ directory) to make accept (usually make TEST=<the tests I care about> accept), then inspect the diff with git diff (well, I use magit, but same difference, or whatever your favourite git diff inspector is). On Tue, Nov 20, 2018 at 10:34 PM Carter Schonwald < carter.schonwald@gmail.com> wrote:
That doesn’t help when I want to look at the output for 50 failed tests ... is this a gap in our current tooling?
On Tue, Nov 20, 2018 at 2:40 PM Ben Gamari
wrote: On November 20, 2018 1:23:29 PM EST, Carter Schonwald < carter.schonwald@gmail.com> wrote:
Happy to:
What’s the best way to look at the Diffs / expected actual for 50 or so tests? So I can better triage these things as important or not going forward? For all I know it could be as simple as our passing diff stuff is white space significant. But I need some guidance on what files I should be looking at
I can’t find any docs on how to poke at / read those on the wiki. Alp suggested just running a single test at a time, but that’s no ideal when it’s so many ...
I ran that ghc build with clang from llvm 7 on high Sierra and no carter patches.
I did cd testsuite ; make test THREADS=7
You can add TEST="T1234 T5678" to the "make test" command line. This is documented here [1]. Does this help?
Cheers,
- Ben
[1] https://ghc.haskell.org/trac/ghc/wiki/Building/RunningTests/Running#Commonly...
-- Sent from my Android device with K-9 Mail. Please excuse my brevity.
_______________________________________________ ghc-devs mailing list ghc-devs@haskell.org http://mail.haskell.org/cgi-bin/mailman/listinfo/ghc-devs

I'm seeing a lot of issues with make test on the Mac also. Basically I'm
running "make test >& test.log", I have 80 unexpected failures, The end of
the log is at the end of this email.
Should I open a bug ?
Details about my env, ghc version etc. Are there other command I should run
to give more info, e.g. ghc --info?
ghc --version
The Glorious Glasgow Haskell Compilation System, version 8.6.2
bash-3.2$ uname -a
Darwin iMac27.local 17.7.0 Darwin Kernel Version 17.7.0: Wed Oct 10
23:06:14 PDT 2018; root:xnu-4570.71.13~1/RELEASE_X86_64 x86_64
bash-3.2$ gcc -v
Configured with: --prefix=/Applications/Xcode.app/Contents/Developer/usr
--with-gxx-include-dir=/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include/c++/4.2.1
Apple LLVM version 10.0.0 (clang-1000.11.45.5)
Target: x86_64-apple-darwin17.7.0
Thread model: posix
InstalledDir:
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin
Unexpected results from:
TEST="Ppr001 Ppr002 Ppr003 Ppr004 Ppr005 Ppr006 Ppr007 Ppr008 Ppr009 Ppr010
Ppr011 Ppr012 Ppr013 Ppr014 Ppr015 Ppr016 Ppr017 Ppr018 Ppr019 Ppr020
Ppr021 Ppr022 Ppr023 Ppr024 Ppr025 Ppr026 Ppr027 Ppr028 Ppr029 Ppr030
Ppr031 Ppr032 Ppr033 Ppr034 Ppr035 Ppr036 Ppr037 Ppr038 Ppr039 Ppr040
Ppr041 Ppr042 Ppr043 Ppr044 Ppr045 Ppr046 Ppr048 T10255 T10268 T10269
T10276 T10278 T10280 T10307 T10309 T10312 T10354 T10357 T10358 T10370
T10396 T10399 T10598 T11018 T11321 T11332 T12417 T13050p T13163 T13199
T13550 T13942 T14289 T14289b T14289c T14306 T15303 T9203 T9630 boolFormula
bundle-export exampleTest load-main"
SUMMARY for test run started at Sat Nov 24 11:18:00 2018 AST
1:49:06 spent to go through
6180 total tests, which gave rise to
22774 test cases, of which
16244 were skipped
33 had missing libraries
6324 expected passes
90 expected failures
0 caused framework failures
0 caused framework warnings
0 unexpected passes
80 unexpected failures
3 unexpected stat failures
Unexpected failures:
ghc-api/annotations/exampleTest.run exampleTest [bad exit code]
(normal)
ghc-api/annotations/T10255.run T10255 [bad exit code] (normal)
ghc-api/annotations/T10268.run T10268 [bad exit code] (normal)
ghc-api/annotations/T10269.run T10269 [bad stdout] (normal)
ghc-api/annotations/T10280.run T10280 [bad exit code] (normal)
ghc-api/annotations/T10312.run T10312 [bad exit code] (normal)
ghc-api/annotations/T10307.run T10307 [bad exit code] (normal)
ghc-api/annotations/T10309.run T10309 [bad exit code] (normal)
ghc-api/annotations/boolFormula.run boolFormula [bad exit code]
(normal)
ghc-api/annotations/T10357.run T10357 [bad exit code] (normal)
ghc-api/annotations/T10358.run T10358 [bad exit code] (normal)
ghc-api/annotations/T10278.run T10278 [bad exit code] (normal)
ghc-api/annotations/T10354.run T10354 [bad exit code] (normal)
ghc-api/annotations/T10396.run T10396 [bad exit code] (normal)
ghc-api/annotations/T10399.run T10399 [bad exit code] (normal)
ghc-api/annotations/T11018.run T11018 [bad exit code] (normal)
ghc-api/annotations/bundle-export.run bundle-export [bad exit code]
(normal)
ghc-api/annotations/T10276.run T10276 [bad exit code] (normal)
ghc-api/annotations/T10598.run T10598 [bad exit code] (normal)
ghc-api/annotations/T11321.run T11321 [bad exit code] (normal)
ghc-api/annotations/T11332.run T11332 [bad exit code] (normal)
ghc-api/annotations/load-main.run load-main [bad exit code] (normal)
ghc-api/annotations/T12417.run T12417 [bad exit code] (normal)
ghc-api/annotations/T13163.run T13163 [bad exit code] (normal)
ghc-api/annotations/T15303.run T15303 [bad exit code] (normal)
printer/Ppr001.run Ppr001 [bad exit code] (normal)
printer/Ppr002.run Ppr002 [bad exit code] (normal)
printer/Ppr003.run Ppr003 [bad exit code] (normal)
printer/Ppr004.run Ppr004 [bad exit code] (normal)
printer/Ppr005.run Ppr005 [bad exit code] (normal)
printer/Ppr006.run Ppr006 [bad exit code] (normal)
printer/Ppr007.run Ppr007 [bad exit code] (normal)
printer/Ppr008.run Ppr008 [bad exit code] (normal)
printer/Ppr009.run Ppr009 [bad exit code] (normal)
printer/Ppr010.run Ppr010 [bad exit code] (normal)
printer/Ppr011.run Ppr011 [bad exit code] (normal)
printer/Ppr012.run Ppr012 [bad exit code] (normal)
printer/Ppr013.run Ppr013 [bad exit code] (normal)
printer/Ppr014.run Ppr014 [bad exit code] (normal)
printer/Ppr015.run Ppr015 [bad exit code] (normal)
printer/Ppr016.run Ppr016 [bad exit code] (normal)
printer/Ppr017.run Ppr017 [bad exit code] (normal)
printer/Ppr018.run Ppr018 [bad exit code] (normal)
printer/Ppr019.run Ppr019 [bad exit code] (normal)
printer/Ppr020.run Ppr020 [bad exit code] (normal)
printer/Ppr021.run Ppr021 [bad exit code] (normal)
printer/Ppr022.run Ppr022 [bad exit code] (normal)
printer/Ppr023.run Ppr023 [bad exit code] (normal)
printer/Ppr024.run Ppr024 [bad exit code] (normal)
printer/Ppr025.run Ppr025 [bad exit code] (normal)
printer/Ppr026.run Ppr026 [bad exit code] (normal)
printer/Ppr027.run Ppr027 [bad exit code] (normal)
printer/Ppr028.run Ppr028 [bad exit code] (normal)
printer/Ppr029.run Ppr029 [bad exit code] (normal)
printer/Ppr030.run Ppr030 [bad exit code] (normal)
printer/Ppr031.run Ppr031 [bad exit code] (normal)
printer/Ppr032.run Ppr032 [bad exit code] (normal)
printer/Ppr033.run Ppr033 [bad exit code] (normal)
printer/Ppr034.run Ppr034 [bad exit code] (normal)
printer/Ppr035.run Ppr035 [bad exit code] (normal)
printer/Ppr036.run Ppr036 [bad exit code] (normal)
printer/Ppr037.run Ppr037 [bad exit code] (normal)
printer/Ppr038.run Ppr038 [bad exit code] (normal)
printer/Ppr039.run Ppr039 [bad exit code] (normal)
printer/Ppr040.run Ppr040 [bad exit code] (normal)
printer/Ppr041.run Ppr041 [bad exit code] (normal)
printer/Ppr042.run Ppr042 [bad exit code] (normal)
printer/Ppr043.run Ppr043 [bad exit code] (normal)
printer/Ppr044.run Ppr044 [bad exit code] (normal)
printer/Ppr045.run Ppr045 [bad exit code] (normal)
printer/Ppr046.run Ppr046 [bad exit code] (normal)
printer/Ppr048.run Ppr048 [bad exit code] (normal)
printer/T13199.run T13199 [bad exit code] (normal)
printer/T13050p.run T13050p [bad exit code] (normal)
printer/T13550.run T13550 [bad exit code] (normal)
printer/T13942.run T13942 [bad exit code] (normal)
printer/T14289.run T14289 [bad exit code] (normal)
printer/T14289b.run T14289b [bad exit code] (normal)
printer/T14289c.run T14289c [bad exit code] (normal)
printer/T14306.run T14306 [bad exit code] (normal)
Unexpected stat failures:
perf/compiler/T10370.run T10370 [stat not good enough] (optasm)
perf/compiler/T9630.run T9630 [stat not good enough] (normal)
perf/should_run/T9203.run T9203 [stat too good] (normal)
make[1]: *** [test] Error 1
make: *** [all] Error 2
On Tue, Nov 20, 2018 at 3:10 AM Ben Gamari
On November 20, 2018 2:06:55 AM GMT+00:00, Carter Schonwald < carter.schonwald@gmail.com> wrote:
Hey Everyone ... I'm concerned, it looks like ghc 8.6.2 on OSX doens't pass validate or even a rudimentary `make test`
I'm not sure how to make heads or tails of all these errors, and it looks like a huge amount of dev work over time has accumulated some failures ....
I can't reproduce this. The binary distributions are produced by CircleCI , which runs the test suite.
Can you be more specific about how you are running this test?
Cheers,
- Ben
-- Sent from my Android device with K-9 Mail. Please excuse my brevity. _______________________________________________ ghc-devs mailing list ghc-devs@haskell.org http://mail.haskell.org/cgi-bin/mailman/listinfo/ghc-devs

George Colpitts
I'm seeing a lot of issues with make test on the Mac also. Basically I'm running "make test >& test.log", I have 80 unexpected failures, The end of the log is at the end of this email.
Should I open a bug ?
Yes, that would be great. When you do so it would be helpful if you could attach the test log. It would also be good to know what OS X and XCode version you are using. Cheers, - Ben

Done. https://ghc.haskell.org/trac/ghc/ticket/15947
On Sat, Nov 24, 2018 at 8:44 PM Ben Gamari
George Colpitts
writes: I'm seeing a lot of issues with make test on the Mac also. Basically I'm running "make test >& test.log", I have 80 unexpected failures, The end of the log is at the end of this email.
Should I open a bug ?
Yes, that would be great. When you do so it would be helpful if you could attach the test log. It would also be good to know what OS X and XCode version you are using.
Cheers,
- Ben
participants (4)
-
Ben Gamari
-
Carter Schonwald
-
George Colpitts
-
Spiwack, Arnaud