Re: [GHC] #9389: Full Test Suite Failures

11 Dec 2014

      #9389: Full Test Suite Failures
-------------------------------------+-------------------------------------
              Reporter:  jrp         |            Owner:
                  Type:  bug         |           Status:  new
              Priority:  normal      |        Milestone:
             Component:  Test Suite  |          Version:  7.8.3
            Resolution:              |         Keywords:
      Operating System:  MacOS X     |     Architecture:  Unknown/Multiple
       Type of failure:  Other       |       Difficulty:  Unknown
             Test Case:              |       Blocked By:
              Blocking:              |  Related Tickets:
Differential Revisions:              |  #9286,#8756,#7876,#7877
-------------------------------------+-------------------------------------

Comment (by jrp):

 Today, quick build  gives (sorry, no github repo yet):
 {{{
 OVERALL SUMMARY for test run started at Thu Dec 11 20:47:57 2014 GMT
  0:41:48 spent to go through
     4359 total tests, which gave rise to
    14160 test cases, of which
     2699 were skipped

      275 had missing libraries
    10958 expected passes
      145 expected failures

        3 caused framework failures
        0 unexpected passes
       62 unexpected failures
       18 unexpected stat failures

 Unexpected failures:
    ../../libraries/base/tests     enum01 [exit code non-0]
 (normal,hpc,optasm,threaded1,threaded2,dyn)
    ../../libraries/base/tests     enum01 [bad stdout or stderr] (ghci)
    ../../libraries/base/tests     enum02 [exit code non-0]
 (normal,hpc,optasm,threaded1,threaded2,dyn)
    ../../libraries/base/tests     enum02 [bad stdout or stderr] (ghci)
    ../../libraries/base/tests     enum03 [exit code non-0]
 (normal,hpc,optasm,threaded1,threaded2,dyn)
    ../../libraries/base/tests     enum03 [bad stdout or stderr] (ghci)
    ../../libraries/base/tests     topHandler01 [bad exit code] (threaded1)
    ../../libraries/base/tests     topHandler01 [bad stdout or stderr]
 (ghci)
    ../../libraries/process/tests  process011 [bad exit code]
 (threaded1,threaded2)
    ../../libraries/process/tests  process011 [bad stdout or stderr] (ghci)
    ../../libraries/unix/tests     forkprocess01 [bad exit code] (ghci)
    ../../libraries/unix/tests     signals002 [bad stdout]
 (threaded1,threaded2)
    ../../libraries/unix/tests     signals002 [bad stdout or stderr] (ghci)
    cabal/cabal01                  cabal01 [bad exit code] (normal)
    cabal/sigcabal01               sigcabal01 [bad stderr] (normal)
    codeGen/should_run             CgStaticPointers [bad stdout or stderr]
 (ghci)
    concurrent/should_run          allocLimit4 [bad exit code] (ghci)
    concurrent/should_run          conc012 [bad exit code] (ghci)
    concurrent/should_run          conc059 [bad stderr]
 (threaded1,threaded2)
    deSugar/should_run             DsStaticPointers [bad stdout or stderr]
 (ghci)
    deSugar/should_run             dsrun014 [bad exit code] (ghci)
    ffi/should_run                 T2276_ghci [bad stdout or stderr] (ghci)
    ghci.debugger/scripts          print021 [bad exit code] (ghci)
    ghci/prog003                   prog003 [bad stderr] (ghci)
    ghci/scripts                   T8696 [bad stderr] (ghci)
    ghci/scripts                   ghci024 [bad stdout] (normal)
    ghci/scripts                   ghci058 [bad stderr] (ghci)
    numeric/should_run             add2 [bad exit code] (ghci)
    numeric/should_run             mul2 [bad exit code] (ghci)
    numeric/should_run             quotRem2 [bad exit code] (ghci)
    parser/should_run              readRun004 [bad exit code] (ghci)
    rts                            GcStaticPointers [bad stdout or stderr]
 (ghci)
    rts                            ListStaticPointers [bad stdout or
 stderr] (ghci)
    rts                            T7919 [bad exit code]
 (optasm,threaded2,dyn)
    th                             TH_StaticPointers [bad stdout or stderr]
 (ghci)
    typecheck/should_run           T7861 [bad exit code]
 (normal,hpc,optasm,ghci,threaded1,threaded2,dyn)

 }}}

 An unadorned {{{validate}}} gives:

 {{{
 OVERALL SUMMARY for test run started at Thu Dec 11 22:03:04 2014 GMT
  0:05:02 spent to go through
     4359 total tests, which gave rise to
    14156 test cases, of which
    10141 were skipped

       53 had missing libraries
     3884 expected passes
       70 expected failures

        0 caused framework failures
        0 unexpected passes
        6 unexpected failures
        2 unexpected stat failures

 Unexpected failures:
    cabal/cabal01     cabal01 [bad exit code] (normal)
    cabal/sigcabal01  sigcabal01 [bad stderr] (normal)
    ffi/should_run    T2276_ghci [bad stdout or stderr] (ghci)
    ghci/prog003      prog003 [bad stderr] (ghci)
    ghci/scripts      T8696 [bad stderr] (ghci)
    ghci/scripts      ghci058 [bad stderr] (ghci)

 Unexpected stat failures:
    perf/compiler  T4801 [stat too good] (normal)
    perf/haddock   haddock.base [stat not good enough] (normal)
 }}}

--
Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/9389#comment:14
GHC http://www.haskell.org/ghc/
The Glasgow Haskell Compiler