[GHC] #13633: testwsdeque failure on POWER8

#13633: testwsdeque failure on POWER8 ---------------------------------------+---------------------------------- Reporter: trommler | Owner: (none) Type: bug | Status: new Priority: normal | Milestone: Component: Runtime System | Version: 8.1 Keywords: SMP | Operating System: Linux Architecture: powerpc64 | Type of failure: Runtime crash Test Case: rts/testwsdeque | Blocked By: Blocking: | Related Tickets: Differential Rev(s): | Wiki Page: ---------------------------------------+---------------------------------- On a POWER8 `testwsdeque` fails occasionally under load: {{{ Wrong exit code for testwsdeque(threaded1)(expected 0 , actual 134 ) Stderr ( testwsdeque ): internal error: FAIL: 277808608 3 13 (GHC version 8.3.20170430 for powerpc64le_unknown_linux) }}} -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/13633 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler

#13633: testwsdeque failure on POWER8 -----------------------------------+--------------------------------------- Reporter: trommler | Owner: (none) Type: bug | Status: new Priority: normal | Milestone: Component: Runtime System | Version: 8.1 Resolution: | Keywords: SMP Operating System: Linux | Architecture: powerpc64 Type of failure: Runtime crash | Test Case: rts/testwsdeque Blocked By: | Blocking: Related Tickets: | Differential Rev(s): Wiki Page: | -----------------------------------+--------------------------------------- Comment (by simonmar): This is bad and suggests that either we're using the wrong barriers in the implementation, or the implementation of the barriers is wrong for POWER8. -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/13633#comment:1 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler

This is bad and suggests that either we're using the wrong barriers in
#13633: testwsdeque failure on POWER8 -----------------------------------+--------------------------------------- Reporter: trommler | Owner: (none) Type: bug | Status: new Priority: normal | Milestone: Component: Runtime System | Version: 8.1 Resolution: | Keywords: SMP Operating System: Linux | Architecture: powerpc64 Type of failure: Runtime crash | Test Case: rts/testwsdeque Blocked By: | Blocking: Related Tickets: | Differential Rev(s): Wiki Page: | -----------------------------------+--------------------------------------- Comment (by trommler): Replying to [comment:1 simonmar]: the implementation, or the implementation of the barriers is wrong for POWER8. I looked at the implementation of the barriers and `cas()` in `SMP.h`again and they are correct for POWER and PowerPC. -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/13633#comment:2 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler

#13633: testwsdeque failure on POWER8 -----------------------------------+--------------------------------------- Reporter: trommler | Owner: (none) Type: bug | Status: new Priority: normal | Milestone: Component: Runtime System | Version: 8.1 Resolution: | Keywords: SMP Operating System: Linux | Architecture: powerpc64 Type of failure: Runtime crash | Test Case: rts/testwsdeque Blocked By: | Blocking: Related Tickets: | Differential Rev(s): Wiki Page: | -----------------------------------+--------------------------------------- Comment (by trommler): Test `testwsdeque` always fails on POWER9 under load. -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/13633#comment:3 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler

#13633: testwsdeque failure on POWER8 -------------------------------------+------------------------------------- Reporter: trommler | Owner: (none) Type: bug | Status: new Priority: normal | Milestone: Component: Runtime System | Version: 8.1 Resolution: | Keywords: SMP, ci- | breakage Operating System: Linux | Architecture: powerpc64 Type of failure: Runtime crash | Test Case: | rts/testwsdeque Blocked By: | Blocking: Related Tickets: | Differential Rev(s): Wiki Page: | -------------------------------------+------------------------------------- Changes (by RyanGlScott): * keywords: SMP => SMP, ci-breakage Comment: I'm experiencing nondeterministic CI failures on `validate-x86_64-linux- deb9-unreg` due to `testwsdeque` unexpectedly //passing//, such as in [https://ghc- gitlab.s3.amazonaws.com/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b/2019_02_24/34837/53901/job.log ?response-content-type=text/plain%3B%20charset%3Dutf-8&response-content- disposition=inline&X-Amz-Expires=600&X-Amz-Date=20190224T124346Z&X-Amz- Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAI3NPPHETCY4XXTOA/20190224 /us-east-1/s3/aws4_request&X-Amz-SignedHeaders=host&X-Amz- Signature=71a51fa4b45493ac04249e2217478068a6cb4580a6367c6080d63c262bb3c9f1 this run]: {{{ *** unexpected pass for testwsdeque(threaded1) <elided> Unexpected results from: TEST="testwsdeque" SUMMARY for test run started at Sun Feb 24 09:28:06 2019 UTC 0:42:51 spent to go through 6844 total tests, which gave rise to 21127 test cases, of which 14004 were skipped 38 had missing libraries 6984 expected passes 100 expected failures 0 caused framework failures 0 caused framework warnings 1 unexpected passes 0 unexpected failures 0 unexpected stat failures Unexpected passes: rts/testwsdeque.run testwsdeque [unexpected] (threaded1) }}} -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/13633#comment:4 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler

#13633: testwsdeque failure on POWER8 -------------------------------------+------------------------------------- Reporter: trommler | Owner: trommler Type: bug | Status: new Priority: normal | Milestone: Component: Runtime System | Version: 8.1 Resolution: | Keywords: SMP, ci- | breakage Operating System: Linux | Architecture: powerpc64 Type of failure: Runtime crash | Test Case: | rts/testwsdeque Blocked By: | Blocking: Related Tickets: | Differential Rev(s): Wiki Page: | -------------------------------------+------------------------------------- Changes (by trommler): * owner: (none) => trommler Comment: I have a patch on gitlab at https://gitlab.haskell.org/ghc/ghc/commits/wip/T13633. It seems to fix POWER9. I ran the testsuite twice and did not see it fail again. -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/13633#comment:5 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler

#13633: testwsdeque failure on POWER8 -------------------------------------+------------------------------------- Reporter: trommler | Owner: trommler Type: bug | Status: patch Priority: normal | Milestone: Component: Runtime System | Version: 8.1 Resolution: | Keywords: SMP, ci- | breakage Operating System: Linux | Architecture: powerpc64 Type of failure: Runtime crash | Test Case: | rts/testwsdeque Blocked By: | Blocking: Related Tickets: | Differential Rev(s): ghc/ghc!445 Wiki Page: | -------------------------------------+------------------------------------- Changes (by trommler): * status: new => patch * differential: => ghc/ghc!445 Comment: I ran the test about a dozen times on a POWER9 and did not see any more failures. -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/13633#comment:6 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler

#13633: testwsdeque failure on POWER8 -------------------------------------+------------------------------------- Reporter: trommler | Owner: (none) Type: bug | Status: patch Priority: normal | Milestone: Component: Runtime System | Version: 8.1 Resolution: | Keywords: SMP, ci- | breakage Operating System: Linux | Architecture: powerpc64 Type of failure: Runtime crash | Test Case: | rts/testwsdeque Blocked By: | Blocking: Related Tickets: | Differential Rev(s): ghc/ghc!445 Wiki Page: | -------------------------------------+------------------------------------- Changes (by trommler): * owner: trommler => (none) -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/13633#comment:7 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler

I'm experiencing nondeterministic CI failures on `validate-x86_64-linux- deb9-unreg` due to `testwsdeque` unexpectedly //passing//, such as in [https://ghc- gitlab.s3.amazonaws.com/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b/2019_02_24/34837/53901/job.log ?response-content-type=text/plain%3B%20charset%3Dutf-8&response-content- disposition=inline&X-Amz-Expires=600&X-Amz-Date=20190224T124346Z&X-Amz- Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAI3NPPHETCY4XXTOA/20190224 /us-east-1/s3/aws4_request&X-Amz-SignedHeaders=host&X-Amz- Signature=71a51fa4b45493ac04249e2217478068a6cb4580a6367c6080d63c262bb3c9f1
#13633: testwsdeque failure on POWER8 -------------------------------------+------------------------------------- Reporter: trommler | Owner: (none) Type: bug | Status: patch Priority: normal | Milestone: Component: Runtime System | Version: 8.1 Resolution: | Keywords: SMP, ci- | breakage Operating System: Linux | Architecture: powerpc64 Type of failure: Runtime crash | Test Case: | rts/testwsdeque Blocked By: | Blocking: Related Tickets: | Differential Rev(s): ghc/ghc!445 Wiki Page: | -------------------------------------+------------------------------------- Comment (by bgamari): Replying to [comment:4 RyanGlScott]: this run]:
I'm rather puzzled by this. This test isn't marked as `expect_broken` as far as I can tell. Why is the testsuite driver expecting it to fail? -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/13633#comment:8 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler

#13633: testwsdeque failure on POWER8
-------------------------------------+-------------------------------------
Reporter: trommler | Owner: (none)
Type: bug | Status: patch
Priority: normal | Milestone:
Component: Runtime System | Version: 8.1
Resolution: | Keywords: SMP, ci-
| breakage
Operating System: Linux | Architecture: powerpc64
Type of failure: Runtime crash | Test Case:
| rts/testwsdeque
Blocked By: | Blocking:
Related Tickets: | Differential Rev(s): ghc/ghc!445
Wiki Page: |
-------------------------------------+-------------------------------------
Comment (by Marge Bot
participants (1)
-
GHC