[GHC] #12141: Testsuite failures when GHC is built with 'quickest' profile

1 Jun 2016

      #12141: Testsuite failures when GHC is built with 'quickest' profile
-------------------------------------+-------------------------------------
           Reporter:  RyanGlScott    |             Owner:
               Type:  bug            |            Status:  new
           Priority:  normal         |         Milestone:
          Component:  Test Suite     |           Version:  8.1
           Keywords:                 |  Operating System:  Unknown/Multiple
       Architecture:                 |   Type of failure:  Other
  Unknown/Multiple                   |
          Test Case:                 |        Blocked By:
           Blocking:                 |   Related Tickets:
Differential Rev(s):                 |         Wiki Page:
-------------------------------------+-------------------------------------
 After building GHC HEAD with the `quickest` setting and running 'make
 test', here is the testsuite failures (I've included the perf-related
 tests' for completeness's sake, although they're probably spurious):

 {{{
 Unexpected results from:
 TEST="T10083 T8848 linker_unload debug T4930 HyperStrUse
 integerConstantFolding T9938 T3717 break011 T9938B T7796 break013
 T8639_api spec-inline T9220 T4306 T8628 T5623 T7360 T10694 T6056
 AmapCoerce T7837 T4018 IntegerConversionRules prog001 T11195 T10482
 break024 T9881 EvalTest T4007 UnsatFun T3055 T3234 T4908 T7865 T5327 T8832
 dynCompileExpr ghci004 T7116 ghci006 T8598 T2110 tcfail072 ghci025 T10482a
 T10508_api T3772 T10830 T9872d T4830 T9872a T9872b T9872c T9233 T9020
 InlineByteArrayAlloc T5536 T5949 T7954 lazy-bs-alloc T5321Fun T3064
 parsing001 T4801 T5030 T5642 T3924 Conversions T5237 T876 T5549 T9848
 T7619 T5631 T9203 T8766 T3294 InlineCloneArrayAlloc T4334 MethSharing
 T7257 InlineArrayAlloc T5205 T3586 T10547 T783 T6048 T4474a T4474c T4474b
 T9675 T3738 T5113 T5321FD T5837 T4029 T9339 T10359 T7797 T9961 T4978 T1969
 T4267 space_leak_001"

 OVERALL SUMMARY for test run started at Wed Jun  1 18:03:49 2016 EDT
  0:15:57 spent to go through
     5174 total tests, which gave rise to
    16207 test cases, of which
    10987 were skipped

       71 had missing libraries
     4925 expected passes
      116 expected failures

        0 caused framework failures
        1 unexpected passes
       51 unexpected failures
       56 unexpected stat failures

 Unexpected passes:
    /tmp/ghctest/_iBKeQ/1/2/3/./simplCore/should_compile/T10083  T10083
 (normal)

 Unexpected failures:
    /tmp/ghctest/_iBKeQ/1/2/3/../../libraries/array/tests/T9220
 T9220 [bad stdout] (ghci)
    /tmp/ghctest/_iBKeQ/1/2/3/./codeGen/should_compile/debug
 debug [bad stdout] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./driver/T9938
 T9938 [bad exit code] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./driver/T9938B
 T9938B [bad exit code] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./ghc-api/T10508_api
 T10508_api [bad exit code] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./ghc-api/T8628
 T8628 [bad exit code] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./ghc-api/T8639_api
 T8639_api [bad exit code] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./ghc-api/dynCompileExpr/dynCompileExpr
 dynCompileExpr [bad exit code] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./ghci.debugger/scripts/break011
 break011 [bad stdout] (ghci)
    /tmp/ghctest/_iBKeQ/1/2/3/./ghci.debugger/scripts/break013
 break013 [bad stdout] (ghci)
    /tmp/ghctest/_iBKeQ/1/2/3/./ghci.debugger/scripts/break024
 break024 [bad stdout] (ghci)
    /tmp/ghctest/_iBKeQ/1/2/3/./ghci/prog001/prog001
 prog001 [bad exit code] (ghci-ext)
    /tmp/ghctest/_iBKeQ/1/2/3/./ghci/scripts/T9881
 T9881 [bad stdout] (ghci)
    /tmp/ghctest/_iBKeQ/1/2/3/./ghci/scripts/ghci004
 ghci004 [bad exit code] (ghci-ext)
    /tmp/ghctest/_iBKeQ/1/2/3/./ghci/scripts/ghci006
 ghci006 [bad exit code] (ghci-ext)
    /tmp/ghctest/_iBKeQ/1/2/3/./ghci/scripts/ghci025
 ghci025 [bad stdout] (ghci)
    /tmp/ghctest/_iBKeQ/1/2/3/./indexed-types/should_compile/T7837
 T7837 [stderr mismatch] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./lib/integer/IntegerConversionRules
 IntegerConversionRules [bad stdout] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./lib/integer/integerConstantFolding
 integerConstantFolding [bad stdout] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./numeric/should_compile/T7116
 T7116 [bad stdout] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./perf/compiler/T4007
 T4007 [bad stdout] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./perf/space_leaks/T4018
 T4018 [bad exit code] (optasm)
    /tmp/ghctest/_iBKeQ/1/2/3/./pmcheck/should_compile/T11195
 T11195 [exit code non-0] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./rts/linker_unload
 linker_unload [bad exit code] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./simplCore/should_compile/EvalTest
 EvalTest [bad stdout] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./simplCore/should_compile/T3055
 T3055 [bad stdout] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./simplCore/should_compile/T3234
 T3234 [stderr mismatch] (optasm)
    /tmp/ghctest/_iBKeQ/1/2/3/./simplCore/should_compile/T3717
 T3717 [stderr mismatch] (optasm)
    /tmp/ghctest/_iBKeQ/1/2/3/./simplCore/should_compile/T3772
 T3772 [bad stdout] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./simplCore/should_compile/T4306
 T4306 [bad stdout] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./simplCore/should_compile/T4908
 T4908 [stderr mismatch] (optasm)
    /tmp/ghctest/_iBKeQ/1/2/3/./simplCore/should_compile/T4930
 T4930 [stderr mismatch] (optasm)
    /tmp/ghctest/_iBKeQ/1/2/3/./simplCore/should_compile/T5327
 T5327 [bad exit code] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./simplCore/should_compile/T5623
 T5623 [bad exit code] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./simplCore/should_compile/T6056
 T6056 [stderr mismatch] (optasm)
    /tmp/ghctest/_iBKeQ/1/2/3/./simplCore/should_compile/T7360
 T7360 [stderr mismatch] (optasm)
    /tmp/ghctest/_iBKeQ/1/2/3/./simplCore/should_compile/T7796
 T7796 [bad stdout] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./simplCore/should_compile/T7865
 T7865 [bad stdout] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./simplCore/should_compile/T8832
 T8832 [bad stdout] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./simplCore/should_compile/T8848
 T8848 [stderr mismatch] (optasm)
    /tmp/ghctest/_iBKeQ/1/2/3/./simplCore/should_compile/spec-inline
 spec-inline [stderr mismatch] (optasm)
    /tmp/ghctest/_iBKeQ/1/2/3/./simplCore/should_run/AmapCoerce
 AmapCoerce [bad stdout] (optasm)
    /tmp/ghctest/_iBKeQ/1/2/3/./simplCore/should_run/T10830
 T10830 [bad exit code] (optasm)
    /tmp/ghctest/_iBKeQ/1/2/3/./simplCore/should_run/T2110
 T2110 [bad stdout] (optasm)
    /tmp/ghctest/_iBKeQ/1/2/3/./stranal/should_compile/T10482
 T10482 [stderr mismatch] (optasm)
    /tmp/ghctest/_iBKeQ/1/2/3/./stranal/should_compile/T10482a
 T10482a [stderr mismatch] (optasm)
    /tmp/ghctest/_iBKeQ/1/2/3/./stranal/should_compile/T10694
 T10694 [stderr mismatch] (optasm)
    /tmp/ghctest/_iBKeQ/1/2/3/./stranal/sigs/HyperStrUse
 HyperStrUse [stderr mismatch] (optasm)
    /tmp/ghctest/_iBKeQ/1/2/3/./stranal/sigs/T8598
 T8598 [stderr mismatch] (optasm)
    /tmp/ghctest/_iBKeQ/1/2/3/./stranal/sigs/UnsatFun
 UnsatFun [stderr mismatch] (optasm)
    /tmp/ghctest/_iBKeQ/1/2/3/./typecheck/should_fail/tcfail072
 tcfail072 [stderr mismatch] (normal)

 Unexpected stat failures:
    /tmp/ghctest/_iBKeQ/1/2/3/../../libraries/base/tests/T8766
 T8766 [stat not good enough] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/../../libraries/base/tests/T9848
 T9848 [stat not good enough] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./callarity/perf/T3924
 T3924 [stat not good enough] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./perf/compiler/T10547
 T10547 [stat not good enough] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./perf/compiler/T1969
 T1969 [stat not good enough] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./perf/compiler/T3064
 T3064 [stat not good enough] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./perf/compiler/T3294
 T3294 [stat not good enough] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./perf/compiler/T4801
 T4801 [stat not good enough] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./perf/compiler/T5030
 T5030 [stat not good enough] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./perf/compiler/T5321FD
 T5321FD [stat not good enough] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./perf/compiler/T5321Fun
 T5321Fun [stat not good enough] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./perf/compiler/T5631
 T5631 [stat not good enough] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./perf/compiler/T5642
 T5642 [stat not good enough] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./perf/compiler/T5837
 T5837 [stat not good enough] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./perf/compiler/T6048
 T6048 [stat not good enough] (optasm)
    /tmp/ghctest/_iBKeQ/1/2/3/./perf/compiler/T783                     T783
 [stat not good enough] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./perf/compiler/T9020
 T9020 [stat not good enough] (optasm)
    /tmp/ghctest/_iBKeQ/1/2/3/./perf/compiler/T9233
 T9233 [stat not good enough] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./perf/compiler/T9675
 T9675 [stat not good enough] (optasm)
    /tmp/ghctest/_iBKeQ/1/2/3/./perf/compiler/T9872a
 T9872a [stat not good enough] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./perf/compiler/T9872b
 T9872b [stat not good enough] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./perf/compiler/T9872c
 T9872c [stat not good enough] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./perf/compiler/T9872d
 T9872d [stat not good enough] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./perf/compiler/T9961
 T9961 [stat not good enough] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./perf/compiler/parsing001
 parsing001 [stat not good enough] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./perf/should_run/Conversions
 Conversions [stat not good enough] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./perf/should_run/InlineArrayAlloc
 InlineArrayAlloc [stat not good enough] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./perf/should_run/InlineByteArrayAlloc
 InlineByteArrayAlloc [stat not good enough] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./perf/should_run/InlineCloneArrayAlloc
 InlineCloneArrayAlloc [stat not good enough] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./perf/should_run/MethSharing
 MethSharing [stat not good enough] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./perf/should_run/T10359
 T10359 [stat not good enough] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./perf/should_run/T3586
 T3586 [stat not good enough] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./perf/should_run/T3738
 T3738 [stat not good enough] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./perf/should_run/T4267
 T4267 [stat not good enough] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./perf/should_run/T4474a
 T4474a [stat not good enough] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./perf/should_run/T4474b
 T4474b [stat not good enough] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./perf/should_run/T4474c
 T4474c [stat not good enough] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./perf/should_run/T4830
 T4830 [stat not good enough] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./perf/should_run/T4978
 T4978 [stat not good enough] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./perf/should_run/T5113
 T5113 [stat not good enough] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./perf/should_run/T5205
 T5205 [stat not good enough] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./perf/should_run/T5237
 T5237 [stat not good enough] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./perf/should_run/T5536
 T5536 [stat not good enough] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./perf/should_run/T5549
 T5549 [stat not good enough] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./perf/should_run/T5949
 T5949 [stat not good enough] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./perf/should_run/T7257
 T7257 [stat not good enough] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./perf/should_run/T7619
 T7619 [stat not good enough] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./perf/should_run/T7797
 T7797 [stat not good enough] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./perf/should_run/T7954
 T7954 [stat not good enough] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./perf/should_run/T876                   T876
 [stat not good enough] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./perf/should_run/T9203
 T9203 [stat not good enough] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./perf/should_run/T9339
 T9339 [stat not good enough] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./perf/should_run/lazy-bs-alloc
 lazy-bs-alloc [stat not good enough] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./perf/space_leaks/T4029
 T4029 [stat too good] (ghci)
    /tmp/ghctest/_iBKeQ/1/2/3/./perf/space_leaks/T4334
 T4334 [stat not good enough] (normal)
    /tmp/ghctest/_iBKeQ/1/2/3/./perf/space_leaks/space_leak_001
 space_leak_001 [stat not good enough] (normal)
 }}}

 I can't reproduce these issues when testing with GHC built with the
 `quick` setting.

--
Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/12141
GHC http://www.haskell.org/ghc/
The Glasgow Haskell Compiler