Hi Nicolas,
I'm glad you raised this issue. I've just recently been granted permission
to apply patches to the IO manager, and I want to be sure my patches are
good before applying them. It's hard to tell whether things are OK when the
validation already fails. It would be great to get these things cleaned up,
even if it means just categorizing certain tests as "non-show-stopping
failures" or something like that.
I ran a build the other day on os x and got these failures:
Unexpected results from:
TEST="T149 T5313 T1372 dynbrk009 print020 T4908 spec-inline T2507 T5321FD
T5030 T4801 T6048 T5631 T5837 T5642 T3064 parsing001 T1969 T5321Fun T783
T3294 ghcilink002 ghcilink005 lazy-bs-alloc T1288_ghci"
They overlap yours, but are not identical.
By the way, I'm also getting validate failures on linux:
Unexpected results from:
TEST="T149 T4908 spec-inline T5321FD T5030 T4801 T6048 T5631 T5837 T5642
T3064 parsing001 T1969 T5321Fun T783 T3294"
-Andi
On Thu, May 2, 2013 at 11:22 AM, Nicolas Frisby
I'm switching my GHC development over to a Mac, and so I'm establishing a validation baseline, since I don't expect all tests to pass on my setup.
After a ./sync-all pull (as of Johan's ade1ae97), and a ./validate --slow, I see unexpected results for these tests.
TEST="T149 T5313 jules_xref launchbury layout008 jl_defaults T7360 T1969 T5631 T3064 T4801 T3294 jules_xref2 ImpSafeOnly08 safePkg01 ImpSafeOnly02 ImpSafeOnly03 ImpSafeOnly01 ImpSafeOnly06 ImpSafeOnly07 ImpSafeOnly04 ImpSafeOnly05 ImpSafeOnly09 ImpSafeOnly10 T4474a T4474c T4474b space_leak_001 conc058 conc068 conc065 conc066 conc020 conc035 conc017 rittri lex T2507 haddock.Cabal T7478 jq_readsPrec IntegerConversionRules integerConstantFolding signals004 T7170 dynamic003 length001 echo001 cgrun071 hSetBuffering004 hSetBuffering002 hClose002 andy_cherry qq007 qq008 recomp006"
(See below for more of the summary info.)
Question 1: To other GHC developers using OS X: do you recognize these tests as "unexpecteds expected on OS X"?
Question 2: Has anyone diagnosed these particular tests? IE is there an OS X tsar? (I am not necessarily volunteering here.)
Thanks.
-----
T149 became a pass with one my patches about a month ago, but I was seeing nondeterminism and was hoping someone more familiar with the T149 test
If I run the testsuite manually (cd testsuite/tests/; make TESTS=<as above>), the "ImpSafeOnly*" tests pass as expected.
The 'conc*' tests don't even compile because block and unblock were replaced by mask, but I'm weary of directly changing this because it seems like these should have shown up on all platforms.
I've lightly investigated some of the others, and opened a few tickets (#7876 #7877, comment on #7684), but I'm asking here for more information before I flood the ticket system. A common culprit seems to be the IO library's behavior wrt to closed handles. Other tests look to involve some dynamic linking issues.
Unexpected passes: driver T5313 (normal,hpc,optasm,ghci,threaded1,threaded2,dyn) perf/should_run T149 (normal)
Unexpected failures: ../../libraries/base/tests dynamic003 [bad exit code] (ghci) ../../libraries/base/tests echo001 [bad exit code] (ghci) ../../libraries/base/tests length001 [bad exit code] (ghci) ../../libraries/base/tests/IO hClose002 [bad exit code] (ghci,threaded1,threaded2) ../../libraries/base/tests/IO hSetBuffering002 [bad exit code] (ghci) ../../libraries/base/tests/IO hSetBuffering004 [bad stdout or stderr] (ghci) ../../libraries/unix/tests signals004 [bad exit code] (ghci,threaded1,threaded2) codeGen/should_run cgrun071 [bad exit code] (normal,hpc,optasm,ghci,threaded1,threaded2,dyn,g1) concurrent/should_run conc017 [exit code non-0] (normal,hpc,optasm,threaded1,threaded2,dyn) concurrent/should_run conc017 [bad stdout or stderr] (ghci) concurrent/should_run conc020 [exit code non-0] (normal,hpc,optasm,threaded1,threaded2,dyn) concurrent/should_run conc020 [bad stdout or stderr] (ghci) concurrent/should_run conc035 [exit code non-0] (normal,hpc,optasm,threaded1,threaded2,dyn) concurrent/should_run conc035 [bad stdout or stderr] (ghci) concurrent/should_run conc058 [exit code non-0] (normal,hpc,optasm,threaded1,threaded2,dyn) concurrent/should_run conc058 [bad stdout or stderr] (ghci) concurrent/should_run conc065 [exit code non-0] (normal,hpc,optasm,threaded1,threaded2,dyn) concurrent/should_run conc066 [exit code non-0] (normal,hpc,optasm,threaded1,threaded2,dyn) concurrent/should_run conc068 [bad exit code] (ghci) concurrent/should_run conc068 [exit code non-0] (normal,hpc,optasm,threaded1,dyn) driver T2507 [bad stderr] (normal) driver/recomp006 recomp006 [bad stderr] (normal) ffi/should_run T7170 [bad stdout or stderr] (ghci) ghc-api/T7478 T7478 [bad exit code] (normal) layout layout008 [bad stdout] (normal) lib/integer IntegerConversionRules [bad stderr] (normal) lib/integer integerConstantFolding [bad stderr] (normal) perf/compiler T1969 [stat not good enough] (normal) perf/compiler T3064 [stat not good enough] (normal) perf/compiler T3294 [stderr mismatch] (normal) perf/compiler T4801 [stat too good] (normal) perf/compiler T5631 [stat not good enough] (normal) perf/haddock haddock.Cabal [stat not good enough] (normal) perf/should_run T4474a [stat not good enough] (normal) perf/should_run T4474b [stat not good enough] (normal) perf/should_run T4474c [stat not good enough] (normal) perf/space_leaks space_leak_001 [stat too good] (hpc,optasm,dyn) programs/andy_cherry andy_cherry [bad exit code] (ghci) programs/jl_defaults jl_defaults [bad exit code] (ghci) programs/jq_readsPrec jq_readsPrec [bad exit code] (ghci) programs/jules_xref jules_xref [bad exit code] (ghci) programs/jules_xref2 jules_xref2 [bad exit code] (ghci) programs/launchbury launchbury [bad exit code] (ghci) programs/lex lex [bad exit code] (ghci) programs/rittri rittri [bad exit code] (ghci) quasiquotation/qq007 qq007 [exit code non-0] (normal,hpc,optasm) quasiquotation/qq008 qq008 [exit code non-0] (normal,hpc,optasm) safeHaskell/check/pkg01 ImpSafeOnly01 [exit code non-0] (normal) safeHaskell/check/pkg01 ImpSafeOnly02 [exit code non-0] (normal) safeHaskell/check/pkg01 ImpSafeOnly03 [stderr mismatch] (normal) safeHaskell/check/pkg01 ImpSafeOnly04 [exit code non-0] (normal) safeHaskell/check/pkg01 ImpSafeOnly05 [stderr mismatch] (normal) safeHaskell/check/pkg01 ImpSafeOnly06 [exit code non-0] (normal) safeHaskell/check/pkg01 ImpSafeOnly07 [stderr mismatch] (normal) safeHaskell/check/pkg01 ImpSafeOnly08 [stderr mismatch] (normal) safeHaskell/check/pkg01 ImpSafeOnly09 [stderr mismatch] (normal) safeHaskell/check/pkg01 ImpSafeOnly10 [exit code non-0] (normal) safeHaskell/check/pkg01 safePkg01 [bad exit code] (normal) simplCore/should_compile T7360 [stderr mismatch] (optasm)
_______________________________________________ ghc-devs mailing list ghc-devs@haskell.org http://www.haskell.org/mailman/listinfo/ghc-devs