Re: Windows test failures

Thanks Roland, I've reviewed the patch in Phab. Cheers, Tamar On Sat, Dec 1, 2018 at 7:08 AM Roland Senn wrote:

For T14452 there is a patch ( https://phabricator.haskell.org/D5398) ready for review..

Roland

Am Freitag, den 30.11.2018, 21:49 +0000 schrieb Simon Peyton Jones via ghc-devs:

At the end of the first test run it would have given a list of tests that failed and a line saying TEST=".... List of tests..."

Copy that line and at the root of the checkout do

make TEST=".... List of tests..." test -C testsuite/tests

(that's uppercase C). This will run everything using one thread. :)

OK, done. Results below.

Simon

/c/code/HEAD$ make TEST="T10420 T10672_x64 T13385 T14452 T15815 T3307 T3319 T4006 TH_scopedTvs environment001 plugin-recomp-change plugin-recomp-flags plugin-recomp-impure plugin-recomp-pure plugins07 plugins09 plugins10 plugins11 plugins13 plugins14 print017" test -C testsuite/tests

make: Entering directory '/c/code/HEAD/testsuite/tests'

PYTHON="python3" "python3" ../driver/runtests.py -e "ghc_compiler_always_flags='-dcore-lint -dcmm-lint -no-user-package-db -rtsopts -fno-warn-missed-specialisations -fshow-warning-groups -fdiagnostics-color=never -fno-diagnostics-show-caret -Werror=compat -dno-debug-output'" -e config.compiler_debugged=False -e ghc_with_native_codegen=True -e config.have_vanilla=True -e config.have_dynamic=False -e config.have_profiling=False -e ghc_with_threaded_rts=True -e ghc_with_dynamic_rts=False -e config.have_interp=True -e config.unregisterised=False -e config.have_gdb=False -e config.have_readelf=True -e config.ghc_dynamic_by_default=False -e config.ghc_dynamic=False -e ghc_with_smp=True -e ghc_with_llvm=False -e windows=True -e darwin=False -e config.in_tree_compiler=True -e config.cleanup=True -e config.local=True --rootdir=. --config-file=../config/ghc -e 'config.platform="x86_64-unknown-mingw32"' -e 'config.os="mingw32"' -e 'config.arch="x86_64"' -e 'config.wordsize="64"' -e 'config.timeout=int() or config.timeout' -e 'config.exeext=".exe"' -e 'config.top="/c/code/HEAD/testsuite"' --config 'compiler="/c/code/HEAD/inplace/bin/ghc-stage2.exe"' --config 'ghc_pkg="/c/code/HEAD/inplace/bin/ghc-pkg.exe"' --config 'haddock=' --config 'hp2ps="/c/code/HEAD/inplace/bin/hp2ps.exe"' --config 'hpc="/c/code/HEAD/inplace/bin/hpc.exe"' --config 'gs="gs"' --config 'timeout_prog="../timeout/install-inplace/bin/timeout.exe"' -e "config.stage=2" --rootdir=../../libraries/Win32/tests --rootdir=../../libraries/array/tests --rootdir=../../libraries/base/tests --rootdir=../../libraries/binary/tests --rootdir=../../libraries/bytestring/tests --rootdir=../../libraries/containers/tests --rootdir=../../libraries/deepseq/tests --rootdir=../../libraries/directory/tests --rootdir=../../libraries/filepath/tests --rootdir=../../libraries/ghc-compact/tests --rootdir=../../libraries/ghc-heap/tests --rootdir=../../libraries/ghc-prim/tests --rootdir=../../libraries/haskeline/tests --rootdir=../../libraries/hpc/tests --rootdir=../../libraries/pretty/tests --rootdir=../../libraries/process/tests --rootdir=../../libraries/stm/tests --rootdir=../../libraries/template-haskell/tests --rootdir=../../libraries/text/tests \

--only=T10420 --only=T10672_x64 --only=T13385 --only=T14452 --only=T15815 --only=T3307 --only=T3319 --only=T4006 --only=TH_scopedTvs --only=environment001 --only=plugin-recomp-change --only=plugin-recomp-flags --only=plugin-recomp-impure --only=plugin-recomp-pure --only=plugins07 --only=plugins09 --only=plugins10 --only=plugins11 --only=plugins13 --only=plugins14 --only=print017 \

\

\

\

\

\

Timeout is 300

0

Found 398 .T files...

Beginning test run at Fri Nov 30 21:07:17 2018 GMTST

====> Scanning ./ado/all.T

====> Scanning ./annotations/should_compile/all.T

====> Scanning ./annotations/should_compile/T13818/all.T

…lots more “Scanning” lines…

====> Scanning ../../libraries/ghc-heap/tests/all.T

====> Scanning ../../libraries/hpc/tests/fork/test.T--- driver/T14452.run/T14452.stdout.normalised 2018-11-30 21:07:36.565566000 +0000

+++ driver/T14452.run/T14452.run.stdout.normalised 2018-11-30 21:07:36.567569500 +0000

@@ -1 +1 @@

--O3

+"-O3"

--- libraries/base/tests/T4006.run/T4006.stdout.normalised 2018-11-30 21:15:19.867313900 +0000

+++ libraries/base/tests/T4006.run/T4006.run.stdout.normalised 2018-11-30 21:15:19.870787900 +0000

@@ -1,2 +1,2 @@

It works here

-

+

--- libraries/base/tests/IO/environment001.run/environment001.stdout.normalised 2018-11-30 21:16:00.645817500 +0000

+++ libraries/base/tests/IO/environment001.run/environment001.run.stdout.normalised 2018-11-30 21:16:00.654738900 +0000

@@ -1,7 +1,8 @@

-

-Test 1: 3

-

-Test 2: 1

+

+

+Test 1: 9

+

+Test 2: 3

!

Test 3: 3

["a","b"]

====> Scanning ../../libraries/hpc/tests/function/test.T

====> Scanning ../../libraries/hpc/tests/function2/test.T

====> Scanning ../../libraries/hpc/tests/ghc_ghci/test.T

====> Scanning ../../libraries/hpc/tests/raytrace/test.T

====> Scanning ../../libraries/hpc/tests/raytrace/tixs/test.T

====> Scanning ../../libraries/hpc/tests/simple/test.T

====> Scanning ../../libraries/hpc/tests/simple/tixs/test.T

====> Scanning ../../libraries/process/tests/all.T

====> Scanning ../../libraries/process/tests/T9775/all.T

====> Scanning ../../libraries/stm/tests/all.T

====> Scanning ../../libraries/template-haskell/tests/all.T

=====> T14452(normal) 1 of 21 [0, 0, 0]

cd "driver/T14452.run" && $MAKE -s --no-print-directory T14452

Actual stdout output differs from expected:

diff -uw "driver/T14452.run/T14452.stdout.normalised" "driver/T14452.run/T14452.run.stdout.normalised"

*** unexpected failure for T14452(normal)

=====> T13385(ghci) 2 of 21 [0, 1, 0]

cd "ghci/scripts/T13385.run" && HC="/c/code/HEAD/inplace/bin/ghc-stage2.exe" HC_OPTS="-dcore-lint -dcmm-lint -no-user-package-db -rtsopts -fno-warn-missed-specialisations -fshow-warning-groups -fdiagnostics-color=never -fno-diagnostics-show-caret -Werror=compat -dno-debug-output -XRebindableSyntax" "/c/code/HEAD/inplace/bin/ghc-stage2.exe" --interactive -v0 -ignore-dot-ghci -fno-ghci-history +RTS -I0.1 -RTS -fghci-leak-check -dcore-lint -dcmm-lint -no-user-package-db -rtsopts -fno-warn-missed-specialisations -fshow-warning-groups -fdiagnostics-color=never -fno-diagnostics-show-caret -Werror=compat -dno-debug-output -XRebindableSyntax < T13385.script

=====> print017(ghci) 3 of 21 [0, 1, 0]

cd "ghci.debugger/scripts/print017.run" && HC="/c/code/HEAD/inplace/bin/ghc-stage2.exe" HC_OPTS="-dcore-lint -dcmm-lint -no-user-package-db -rtsopts -fno-warn-missed-specialisations -fshow-warning-groups -fdiagnostics-color=never -fno-diagnostics-show-caret -Werror=compat -dno-debug-output " "/c/code/HEAD/inplace/bin/ghc-stage2.exe" --interactive -v0 -ignore-dot-ghci -fno-ghci-history +RTS -I0.1 -RTS -fghci-leak-check -dcore-lint -dcmm-lint -no-user-package-db -rtsopts -fno-warn-missed-specialisations -fshow-warning-groups -fdiagnostics-color=never -fno-diagnostics-show-caret -Werror=compat -dno-debug-output -ignore-dot-ghci< print017.script

=====> print017(ghci-ext) 3 of 21 [0, 1, 0]

cd "ghci.debugger/scripts/print017.run" && HC="/c/code/HEAD/inplace/bin/ghc-stage2.exe" HC_OPTS="-dcore-lint -dcmm-lint -no-user-package-db -rtsopts -fno-warn-missed-specialisations -fshow-warning-groups -fdiagnostics-color=never -fno-diagnostics-show-caret -Werror=compat -dno-debug-output " "/c/code/HEAD/inplace/bin/ghc-stage2.exe" --interactive -v0 -ignore-dot-ghci -fno-ghci-history -fexternal-interpreter +RTS -I0.1 -RTS -dcore-lint -dcmm-lint -no-user-package-db -rtsopts -fno-warn-missed-specialisations -fshow-warning-groups -fdiagnostics-color=never -fno-diagnostics-show-caret -Werror=compat -dno-debug-output -ignore-dot-ghci< print017.script

=====> plugin-recomp-change(normal) 4 of 21 [0, 1, 0]

cd "plugins/plugin-recomp-change.run" && $MAKE -s --no-print-directory -C plugin-recomp package.plugins01 TOP=/c/code/HEAD/testsuite

cd "plugins/plugin-recomp-change.run" && $MAKE -s --no-print-directory plugin-recomp-change

=====> T10672_x64(normal) 5 of 21 [0, 1, 0]

cd "rts/T10672/T10672_x64.run" && $MAKE -s --no-print-directory T10672_x64

Timeout happened...killed process "cd "rts/T10672/T10672_x64.run" && $MAKE -s --no-print-directory T10672_x64 "...

Wrong exit code for T10672_x64()(expected 0 , actual 99 )

*** unexpected failure for T10672_x64(normal)

=====> TH_scopedTvs(normal) 6 of 21 [0, 2, 0]

cd "th/TH_scopedTvs.run" && "/c/code/HEAD/inplace/bin/ghc-stage2.exe" -c TH_scopedTvs.hs -dcore-lint -dcmm-lint -no-user-package-db -rtsopts -fno-warn-missed-specialisations -fshow-warning-groups -fdiagnostics-color=never -fno-diagnostics-show-caret -Werror=compat -dno-debug-output -XTemplateHaskell -package template-haskell -v0

=====> TH_scopedTvs(ext-interp) 6 of 21 [0, 2, 0]

cd "th/TH_scopedTvs.run" && "/c/code/HEAD/inplace/bin/ghc-stage2.exe" -c TH_scopedTvs.hs -dcore-lint -dcmm-lint -no-user-package-db -rtsopts -fno-warn-missed-specialisations -fshow-warning-groups -fdiagnostics-color=never -fno-diagnostics-show-caret -Werror=compat -dno-debug-output -XTemplateHaskell -package template-haskell -fexternal-interpreter -v0

=====> T3319(normal) 7 of 21 [0, 2, 0]

cd "th/T3319.run" && "/c/code/HEAD/inplace/bin/ghc-stage2.exe" -c T3319.hs -dcore-lint -dcmm-lint -no-user-package-db -rtsopts -fno-warn-missed-specialisations -fshow-warning-groups -fdiagnostics-color=never -fno-diagnostics-show-caret -Werror=compat -dno-debug-output -XTemplateHaskell -package template-haskell -ddump-splices -v0

=====> T3319(ext-interp) 7 of 21 [0, 2, 0]

cd "th/T3319.run" && "/c/code/HEAD/inplace/bin/ghc-stage2.exe" -c T3319.hs -dcore-lint -dcmm-lint -no-user-package-db -rtsopts -fno-warn-missed-specialisations -fshow-warning-groups -fdiagnostics-color=never -fno-diagnostics-show-caret -Werror=compat -dno-debug-output -XTemplateHaskell -package template-haskell -fexternal-interpreter -ddump-splices -v0

=====> T15815(normal) 8 of 21 [0, 2, 0]

cd "th/T15815.run" && "/c/code/HEAD/inplace/bin/ghc-stage2.exe" --make T15815B -dcore-lint -dcmm-lint -no-user-package-db -rtsopts -fno-warn-missed-specialisations -fshow-warning-groups -fdiagnostics-color=never -fno-diagnostics-show-caret -Werror=compat -dno-debug-output -XTemplateHaskell -package template-haskell -v0 -static

=====> T15815(ext-interp) 8 of 21 [0, 2, 0]

cd "th/T15815.run" && "/c/code/HEAD/inplace/bin/ghc-stage2.exe" --make T15815B -dcore-lint -dcmm-lint -no-user-package-db -rtsopts -fno-warn-missed-specialisations -fshow-warning-groups -fdiagnostics-color=never -fno-diagnostics-show-caret -Werror=compat -dno-debug-output -XTemplateHaskell -package template-haskell -fexternal-interpreter -v0 -static

=====> T4006(normal) 9 of 21 [0, 2, 0]

cd "libraries/base/tests/T4006.run" && "/c/code/HEAD/inplace/bin/ghc-stage2.exe" -o T4006 T4006.hs -dcore-lint -dcmm-lint -no-user-package-db -rtsopts -fno-warn-missed-specialisations -fshow-warning-groups -fdiagnostics-color=never -fno-diagnostics-show-caret -Werror=compat -dno-debug-output

cd "libraries/base/tests/T4006.run" && ./T4006

Actual stdout output differs from expected:

diff -uw "libraries/base/tests/T4006.run/T4006.stdout.normalised" "libraries/base/tests/T4006.run/T4006.run.stdout.normalised"

*** unexpected failure for T4006(normal)

=====> T3307(normal) 10 of 21 [0, 3, 0]

cd "libraries/base/tests/IO/T3307.run" && $MAKE -s --no-print-directory T3307-test

Wrong exit code for T3307()(expected 0 , actual 2 )

Stdout ( T3307 ):

Test 1

[99,104,105,110,101,115,101,45,102,105,108,101,45,229,176,143,232,175,180]

Ni hao

Test 2

[99,104,105,110,101,115,101,45,102,105,108,101,45,229,176,143,232,175,180]

Ni hao

Test 3

[99,104,105,110,101,115,101,45,102,105,108,101,45,23567,35828]

Stderr ( T3307 ):

*** framework failure for T3307(normal) 'latin-1' codec can't encode characters in position 24-25: ordinal not in range(256)

=====> environment001(normal) 11 of 21 [0, 3, 1]

cd "libraries/base/tests/IO/environment001.run" && $MAKE -s --no-print-directory environment001-test

Actual stdout output differs from expected:

diff -uw "libraries/base/tests/IO/environment001.run/environment001.stdout.normalised" "libraries/base/tests/IO/environment001.run/environment001.run.stdout.normalised"

*** unexpected failure for environment001(normal)

=====> plugins07(normal) 12 of 21 [0, 4, 1]

cd "plugins/plugins07.run" && $MAKE -s --no-print-directory -C rule-defining-plugin package.plugins07 TOP=/c/code/HEAD/testsuite

cd "plugins/plugins07.run" && $MAKE -s --no-print-directory plugins07

=====> plugins09(normal) 13 of 21 [0, 4, 1]

cd "plugins/plugins09.run" && $MAKE -s --no-print-directory -C simple-plugin package.plugins09 TOP=/c/code/HEAD/testsuite

cd "plugins/plugins09.run" && $MAKE -s --no-print-directory plugins09

Actual stdout output differs from expected:

diff -uw "plugins/plugins09.run/plugins09.stdout.normalised" "plugins/plugins09.run/plugins09.run.stdout.normalised"--- plugins/plugins09.run/plugins09.stdout.normalised 2018-11-30 21:17:20.709370700 +0000

+++ plugins/plugins09.run/plugins09.run.stdout.normalised 2018-11-30 21:17:20.711314000 +0000

@@ -1,9 +0,0 @@

-parsePlugin(a,b)

-interfacePlugin: Prelude

-interfacePlugin: GHC.Float

-interfacePlugin: GHC.Base

-typeCheckPlugin (rn)

-interfacePlugin: GHC.Types

-typeCheckPlugin (tc)

-interfacePlugin: GHC.Integer.Type

-interfacePlugin: GHC.Natural

--- plugins/plugins10.run/plugins10.stdout.normalised 2018-11-30 21:17:57.644357800 +0000

+++ plugins/plugins10.run/plugins10.run.stdout.normalised 2018-11-30 21:17:57.646078700 +0000

@@ -1,21 +0,0 @@

-parsePlugin()

-interfacePlugin: Prelude

-interfacePlugin: Language.Haskell.TH

-interfacePlugin: Language.Haskell.TH.Quote

-interfacePlugin: GHC.Float

-interfacePlugin: GHC.Base

-interfacePlugin: Language.Haskell.TH.Syntax

-typeCheckPlugin (rn)

-interfacePlugin: GHC.Types

-typeCheckPlugin (tc)

-interfacePlugin: GHC.Integer.Type

-interfacePlugin: GHC.Natural

-parsePlugin(a)

-typeCheckPlugin (rn)

-interfacePlugin: Language.Haskell.TH.Lib.Internal

-metaPlugin: return []

-metaPlugin: quoteExp stringify "x"

-interfacePlugin: GHC.CString

-typeCheckPlugin (rn)

-typeCheckPlugin (rn)

-typeCheckPlugin (tc)

*** unexpected failure for plugins09(normal)

=====> plugins10(normal) 14 of 21 [0, 5, 1]

cd "plugins/plugins10.run" && $MAKE -s --no-print-directory -C simple-plugin package.plugins10 TOP=/c/code/HEAD/testsuite

cd "plugins/plugins10.run" && $MAKE -s --no-print-directory plugins10

Actual stdout output differs from expected:

diff -uw "plugins/plugins10.run/plugins10.stdout.normalised" "plugins/plugins10.run/plugins10.run.stdout.normalised"

*** unexpected failure for plugins10(normal)

=====> plugins11(normal) 15 of 21 [0, 6, 1]

cd "plugins/plugins11.run" && $MAKE -s --no-print-directory -C simple-plugin package.plugins11 TOP=/c/code/HEAD/testsuite

cd "plugins/plugins11.run" && $MAKE -s --no-print-directory plugins11

Timeout happened...killed process "cd "plugins/plugins11.run" && $MAKE -s --no-print-directory plugins11 "...

Wrong exit code for plugins11()(expected 0 , actual 99 )

*** unexpected failure for plugins11(normal)

=====> plugins13(normal) 16 of 21 [0, 7, 1]

cd "plugins/plugins13.run" && $MAKE -s --no-print-directory -C simple-plugin package.plugins13 TOP=/c/code/HEAD/testsuite

cd "plugins/plugins13.run" && $MAKE -s --no-print-directory plugins13

=====> plugins14(normal) 17 of 21 [0, 7, 1]

cd "plugins/plugins14.run" && $MAKE -s --no-print-directory -C simple-plugin package.plugins14 TOP=/c/code/HEAD/testsuite

cd "plugins/plugins14.run" && $MAKE -s --no-print-directory plugins14

=====> T10420(normal) 18 of 21 [0, 7, 1]

cd "plugins/T10420.run" && $MAKE -s --no-print-directory -C rule-defining-plugin package.T10420 TOP=/c/code/HEAD/testsuite

cd "plugins/T10420.run" && $MAKE -s --no-print-directory T10420

=====> plugin-recomp-pure(normal) 19 of 21 [0, 7, 1]

cd "plugins/plugin-recomp-pure.run" && $MAKE -s --no-print-directory -C plugin-recomp package.plugins01 TOP=/c/code/HEAD/testsuite

cd "plugins/plugin-recomp-pure.run" && $MAKE -s --no-print-directory plugin-recomp-pure

Timeout happened...killed process "cd "plugins/plugin-recomp-pure.run" && $MAKE -s --no-print-directory plugin-recomp-pure "...

Wrong exit code for plugin-recomp-pure()(expected 0 , actual 99 )

Stdout ( plugin-recomp-pure ):

[1 of 1] Compiling Main ( plugin-recomp-test.hs, plugin-recomp-test.o )

Stderr ( plugin-recomp-pure ):

Simple Plugin Passes Queried

Got options:

Simple Plugin Pass Run

*** unexpected failure for plugin-recomp-pure(normal)

=====> plugin-recomp-impure(normal) 20 of 21 [0, 8, 1]

cd "plugins/plugin-recomp-impure.run" && $MAKE -s --no-print-directory -C plugin-recomp package.plugins01 TOP=/c/code/HEAD/testsuite

cd "plugins/plugin-recomp-impure.run" && $MAKE -s --no-print-directory plugin-recomp-impure

Wrong exit code for plugin-recomp-impure()(expected 0 , actual 2 )

Stdout ( plugin-recomp-impure ):

[1 of 1] Compiling Main ( plugin-recomp-test.hs, plugin-recomp-test.o )

Linking plugin-recomp-test.exe ...

[1 of 1] Compiling Main ( plugin-recomp-test.hs, plugin-recomp-test.o ) [Plugin forced recompilation]

Stderr ( plugin-recomp-impure ):

Simple Plugin Passes Queried

Got options:

Simple Plugin Pass Run

Simple Plugin Passes Queried

Access violation in generated code when reading 0xa824

Attempting to reconstruct a stack trace...

Frame Code address

* 0x49adab0 0x1eb49ec C:\code\HEAD\inplace\bin\ghc-stage2.exe+0x1ab49ec

make[1]: *** [Makefile:99: plugin-recomp-impure] Error 11

*** unexpected failure for plugin-recomp-impure(normal)

=====> plugin-recomp-flags(normal) 21 of 21 [0, 9, 1]

cd "plugins/plugin-recomp-flags.run" && $MAKE -s --no-print-directory -C plugin-recomp package.plugins01 TOP=/c/code/HEAD/testsuite

cd "plugins/plugin-recomp-flags.run" && $MAKE -s --no-print-directory plugin-recomp-flags

Traceback (most recent call last):

File "/c/code/HEAD/testsuite/driver/testlib.py", line 824, in test_common_work

do_test(name, way, func, args, files)

File "/c/code/HEAD/testsuite/driver/testlib.py", line 910, in do_test

result = func(*[name,way] + args)

File "/c/code/HEAD/testsuite/driver/testlib.py", line 993, in run_command

return simple_run( name, '', override_options(cmd), '' )

File "/c/code/HEAD/testsuite/driver/testlib.py", line 1338, in simple_run

dump_stderr(name)

File "/c/code/HEAD/testsuite/driver/testlib.py", line 1501, in dump_stderr

print(str)

UnicodeEncodeError: 'latin-1' codec can't encode characters in position 24-25: ordinal not in range(256)

Unexpected results from:

TEST="T10672_x64 T14452 T3307 T4006 environment001 plugin-recomp-impure plugin-recomp-pure plugins09 plugins10 plugins11"

SUMMARY for test run started at Fri Nov 30 21:07:17 2018 GMTST

0:26:45 spent to go through

21 total tests, which gave rise to

36 test cases, of which

11 were skipped

0 had missing libraries

15 expected passes

0 expected failures

1 caused framework failures

0 caused framework warnings

0 unexpected passes

9 unexpected failures

0 unexpected stat failures

Unexpected failures:

driver/T14452.run T14452 [bad stdout] (normal)

rts/T10672/T10672_x64.run T10672_x64 [bad exit code] (normal)

libraries/base/tests/T4006.run T4006 [bad stdout] (normal)

libraries/base/tests/IO/environment001.run environment001 [bad stdout] (normal)

plugins/plugins09.run plugins09 [bad stdout] (normal)

plugins/plugins10.run plugins10 [bad stdout] (normal)

plugins/plugins11.run plugins11 [bad exit code] (normal)

plugins/plugin-recomp-pure.run plugin-recomp-pure [bad exit code] (normal)

plugins/plugin-recomp-impure.run plugin-recomp-impure [bad exit code] (normal)

Framework failures:

libraries/base/tests/IO/T3307.run T3307 [normal] ('latin-1' codec can't encode characters in position 24-25: ordinal not in range(256))

Appending 0 stats to git notes.

make: *** [../mk/test.mk:342: test] Error 1

make: Leaving directory '/c/code/HEAD/testsuite/tests'

/c/code/HEAD$

*From:* Phyx *Sent:* 30 November 2018 11:58 *To:* Simon Peyton Jones *Subject:* Re: Windows test failures

At the end of the first test run it would have given a list of tests that failed and a line saying TEST=".... List of tests..."

Copy that line and at the root of the checkout do

make TEST=".... List of tests..." test -C testsuite/tests

(that's uppercase C). This will run everything using one thread. :)

Should give a good starting point as to what's wrong.

Kind regards,

Tamar

On Fri, Nov 30, 2018, 10:30 Simon Peyton Jones wrote:

So I just say

make TEST

is that right?

Or is it

make THREADS=1

or what? Sorry to be dim

*From:* Phyx *Sent:* 30 November 2018 08:05 *To:* Simon Peyton Jones *Cc:* ghc-devs *Subject:* Re: Windows test failures

Hi Simon,

Could you try rerunning those failing tests with make TEST? No threads? I have been trying to clean up the testsuite and there should be only 3 failing tests, two plugin tests with bad stdout and T10672_x64 which I am looking into.

I have however noticed that the testsuite has become increasingly unstable under threads for some reason.

I also haven't run trunk yet since last week so they could be new..

But rerunning the fails with no threads should give a better idea.

Regards,

Tamar

On Fri, Nov 30, 2018, 07:46 Simon Peyton Jones via ghc-devs < ghc-devs@haskell.org> wrote:

Ben, Phyx, and other CI folk

‘sh validate –fast’ still gives a lot of failures on Window. The output is below. I would be so good to get this to zero!

(another minor thing is that it would be great to eliminate the long path at the beginning – this is platform independent – I have to delete manually many times each day.

Thanks

Simon

Unexpected passes:

/c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test spaces/rts/T9405.run T9405 [unexpected] (normal)

Unexpected failures:

/c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test spaces/driver/T14452.run T14452 [bad stdout] (normal)

/c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test spaces/ghci/linking/ghcilink001.run ghcilink001 [bad exit code] (normal)

/c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test spaces/ghci/prog010/ghci.prog010.run ghci.prog010 [bad exit code] (ghci)

/c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test spaces/ghci/scripts/ghci050.run ghci050 [bad exit code] (ghci)

/c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test spaces/ghci/should_run/T14963a.run T14963a [bad exit code] (ghci)

/c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test spaces/ghci.debugger/scripts/print012.run print012 [bad exit code] (ghci)

/c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test spaces/ghci.debugger/scripts/print016.run print016 [bad exit code] (ghci)

/c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test spaces/ghci.debugger/scripts/break019.run break019 [bad exit code] (ghci)

/c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test spaces/ghci.debugger/scripts/break028.run break028 [bad exit code] (ghci)

/c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test spaces/ghci.debugger/scripts/dynbrk002.run dynbrk002 [bad exit code] (ghci)

/c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test spaces/ghci.debugger/scripts/T2740.run T2740 [bad exit code] (ghci)

/c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test spaces/indexed-types/should_fail/T7102a.run T7102a [bad exit code] (ghci)

/c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test spaces/plugins/plugin-recomp-change.run plugin-recomp-change [bad exit code] (normal)

/c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test spaces/rts/T10672/T10672_x64.run T10672_x64 [bad exit code] (normal)

/c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test spaces/th/TH_spliceGuard.run TH_spliceGuard [exit code non-0] (normal)

/c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test spaces/th/TH_overlaps.run TH_overlaps [exit code non-0] (normal)

/c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test spaces/th/T5886.run T5886 [exit code non-0] (normal)

/c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test spaces/th/T10697_decided_3.run T10697_decided_3 [exit code non-0] (normal)

/c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test spaces/th/T11629.run T11629 [exit code non-0] (normal)

/c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test spaces/libraries/base/tests/T4006.run T4006 [bad stdout] (normal)

/c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test spaces/libraries/base/tests/IO/environment001.run environment001 [bad stdout] (normal)

/c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test spaces/ghci/should_run/T15633b.run T15633b [bad exit code] (ghci)

/c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test spaces/plugins/plugins07.run plugins07 [bad exit code] (normal)

/c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test spaces/plugins/plugins09.run plugins09 [bad stdout] (normal)

/c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test spaces/plugins/plugins10.run plugins10 [bad stdout] (normal)

/c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test spaces/plugins/plugins11.run plugins11 [bad stdout] (normal)

/c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test spaces/plugins/T10420.run T10420 [bad exit code] (normal)

/c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test spaces/plugins/plugin-recomp-pure.run plugin-recomp-pure [bad exit code] (normal)

/c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test spaces/plugins/plugin-recomp-impure.run plugin-recomp-impure [bad exit code] (normal)

/c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test spaces/plugins/plugin-recomp-flags.run plugin-recomp-flags [bad exit code] (normal)

Framework failures:

/c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test spaces/perf/compiler/MultiLayerModules.run MultiLayerModules [runTest] (Unhandled exception during cleanup: Unable to remove folder '/c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test spaces/perf/compiler/MultiLayerModules.run': [Errno 13] Permission denied: '/c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test spaces/perf/compiler/MultiLayerModules.run'

Unable to start current test.)

/c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test spaces/libraries/base/tests/IO/T3307.run T3307 [normal] ('latin-1' codec can't encode characters in position 24-25: ordinal not in range(256))

_______________________________________________ ghc-devs mailing list ghc-devs@haskell.org http://mail.haskell.org/cgi-bin/mailman/listinfo/ghc-devs https://na01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fmail.haskell.org%2Fcgi-bin%2Fmailman%2Flistinfo%2Fghc-devs&data=02%7C01%7Csimonpj%40microsoft.com%7C5e3ed1874b394aa23a2608d656bb20c2%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636791759052384365&sdata=NeDotHWxbah6wsfYah2fSG90%2B0uAfMfNEgmuEGe2MZA%3D&reserved=0

_______________________________________________ ghc-devs mailing listghc-devs@haskell.orghttp://mail.haskell.org/cgi-bin/mailman/listinfo/ghc-devs