#10726: Upgrade MingW-w64 distributions for windows -------------------------------------+------------------------------------- Reporter: Phyx- | Owner: Phyx- Type: task | Status: new Priority: normal | Milestone: 7.12.1 Component: Build System | Version: 7.11 Resolution: | Keywords: Operating System: Windows | Architecture: | Unknown/Multiple Type of failure: None/Unknown | Test Case: Blocked By: | Blocking: Related Tickets: #9218 #9014 | Differential Revisions: #10435 | -------------------------------------+------------------------------------- Comment (by Phyx-): Chosen `MinGW-w64` build for this are the `dongsheng` daily builds from the `MinGW-w64` repository. Which avoids the issues mentioned in #9014 . The `GCC` versions will be upgraded to `5.1.1`. To be complete the `dongsheng` builds contain: {{{ binutils 2.25 gdb 7.9.1 make 4.1 gmp 6.0.0 mpfr 3.1.3 mpc 1.0.3 isl 0.14.1 mingw-w64 master gcc 5.1.1 }}} -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/10726#comment:1 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler

#10726: Upgrade MingW-w64 distributions for windows -------------------------------------+------------------------------------- Reporter: Phyx- | Owner: Phyx- Type: task | Status: patch Priority: normal | Milestone: 7.12.1 Component: Build System | Version: 7.11 Resolution: | Keywords: Operating System: Windows | Architecture: | Unknown/Multiple Type of failure: None/Unknown | Test Case: Blocked By: | Blocking: Related Tickets: #9218 #9014 | Differential Revisions: Phab:D1123 #10435 | -------------------------------------+------------------------------------- Comment (by awson): Could we, perhaps, use Msys2 builds for this? They are of a high quality and pretty well supported. Also they have gcc-5.2 and, most important, recently released binutils-2.25.1 which have a very important bug (wrong linking of 64-bit import libraries generated by MS linker) fixed. As of today the transitive closure of packages required is (I believe) this: {{{ mingw-w64-x86_64-crt-git-5.0.0.4531.49c7046-1 mingw-w64-x86_64-winpthreads-git-5.0.0.4538.78dca70-1 mingw-w64-x86_64-headers-git-5.0.0.4531.49c7046-1 mingw-w64-x86_64-libwinpthread-git-5.0.0.4538.78dca70-1 mingw-w64-x86_64-zlib-1.2.8-8 mingw-w64-x86_64-isl-0.14.1-2 mingw-w64-x86_64-mpc-1.0.3-2 mingw-w64-x86_64-mpfr-3.1.3.p0-2 mingw-w64-x86_64-gmp-6.0.0-3 mingw-w64-x86_64-gcc-libs-5.2.0-3 mingw-w64-x86_64-binutils-2.25.1-1 mingw-w64-x86_64-libiconv-1.14-5 mingw-w64-x86_64-gcc-5.2.0-3 }}} The new repo of Msys2 packages is http://repo.msys2.org/mingw. -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/10726#comment:3 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler

#10726: Upgrade MingW-w64 distributions for windows -------------------------------------+------------------------------------- Reporter: Phyx- | Owner: Phyx- Type: task | Status: patch Priority: normal | Milestone: 7.12.1 Component: Build System | Version: 7.11 Resolution: | Keywords: Operating System: Windows | Architecture: | Unknown/Multiple Type of failure: None/Unknown | Test Case: Blocked By: | Blocking: Related Tickets: #9218 #9014 | Differential Revisions: Phab:D1123 #10435 | -------------------------------------+------------------------------------- Changes (by RyanGlScott): * cc: RyanGlScott (added) -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/10726#comment:5 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler

#10726: Upgrade MingW-w64 distributions for windows -------------------------------------+------------------------------------- Reporter: Phyx- | Owner: Phyx- Type: task | Status: patch Priority: normal | Milestone: 7.12.1 Component: Build System | Version: 7.11 Resolution: | Keywords: Operating System: Windows | Architecture: | Unknown/Multiple Type of failure: None/Unknown | Test Case: Blocked By: | Blocking: Related Tickets: #9218 #9014 | Differential Revisions: Phab:D1123 #10435 | -------------------------------------+------------------------------------- Comment (by Ben Gamari ): In [changeset:"7b211b4e5a38efca437d76ea442495370da7cc9a/ghc" 7b211b4/ghc]: {{{ #!CommitTicketReference repository="ghc" revision="7b211b4e5a38efca437d76ea442495370da7cc9a" Upgrade GCC to 5.2.0 for Windows x86 and x86_64 This patch does a few things - Moved GHC x86 to MinGW-w64 (Using Awson's patch) - Moves Both GHCs to MSYS2 toolchains - Completely removes the dependencies on the git tarball repo - Downloads only the required tarball for the architecture for which we are building - Downloads the perl tarball is missing as well - Fixed a few bugs in the linker to fix tests on Windows The links currently point to repo.msys2.org and GitHub, it might be more desirable to mirror them on http://downloads.haskell.org/~ghc/mingw/ as with the previous patch attempt. For more details on what the MSYS2 packages I include see #10726 (Awson's comment). but it should contain all we need and no python or fortran, which makes the uncompressed tar a 1-2 hundreds mb smaller. The `GCC 5.2.0` in the package supports `libgcc` as a shared library, this is a problem since when compiling with -shared the produced dll now has a dependency on `libgcc_s_sjlj-1.dll`. To solve this the flag `-static-libgcc` is now being used for all GCC calls on windows. Test Plan: ./validate was ran both on x86 and x86_64 windows and compared against the baseline. A few test were failing due to Ld no longer being noisy. These were updated. The changes to the configure script *should* be validated by the build bots for the other platforms before landing Reviewers: simonmar, awson, bgamari, austin, thomie Reviewed By: thomie Subscribers: #ghc_windows_task_force, thomie, awson Differential Revision: https://phabricator.haskell.org/D1123 GHC Trac Issues: #10726, #9014, #9218, #10435 }}} -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/10726#comment:7 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler

#10726: Upgrade MingW-w64 distributions for windows -------------------------------------+------------------------------------- Reporter: Phyx- | Owner: Phyx- Type: task | Status: closed Priority: normal | Milestone: 7.12.1 Component: Build System | Version: 7.11 Resolution: fixed | Keywords: Operating System: Windows | Architecture: | Unknown/Multiple Type of failure: None/Unknown | Test Case: Blocked By: | Blocking: Related Tickets: #9218 #9014 | Differential Revisions: Phab:D1123 #10435 | -------------------------------------+------------------------------------- Changes (by Phyx-): * status: patch => closed * resolution: => fixed -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/10726#comment:9 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler

#10726: Upgrade MingW-w64 distributions for windows -------------------------------------+------------------------------------- Reporter: Phyx- | Owner: Phyx- Type: task | Status: merge Priority: normal | Milestone: 7.10.3 Component: Build System | Version: 7.11 Resolution: fixed | Keywords: Operating System: Windows | Architecture: | Unknown/Multiple Type of failure: None/Unknown | Test Case: Blocked By: | Blocking: Related Tickets: #9218 #9014 | Differential Revisions: Phab:D1123 #10435 | -------------------------------------+------------------------------------- Changes (by thomie): * milestone: 7.12.1 => 7.10.3 Comment: In #10795, user joozek78 asks for a merge to 7.10 of the above patch. -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/10726#comment:11 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler

#10726: Upgrade MingW-w64 distributions for windows -------------------------------------+------------------------------------- Reporter: Phyx- | Owner: Phyx- Type: task | Status: merge Priority: normal | Milestone: 7.10.3 Component: Build System | Version: 7.11 Resolution: fixed | Keywords: Operating System: Windows | Architecture: | Unknown/Multiple Type of failure: None/Unknown | Test Case: Blocked By: | Blocking: Related Tickets: #9218 #9014 | Differential Revisions: Phab:D1123 #10435 | -------------------------------------+------------------------------------- Changes (by joozek78): * cc: joozek78 (added) -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/10726#comment:13 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler

#10726: Upgrade MingW-w64 distributions for windows -------------------------------------+------------------------------------- Reporter: Phyx- | Owner: Phyx- Type: task | Status: merge Priority: normal | Milestone: 7.10.3 Component: Build System | Version: 7.11 Resolution: fixed | Keywords: Operating System: Windows | Architecture: | Unknown/Multiple Type of failure: None/Unknown | Test Case: Blocked By: | Blocking: Related Tickets: #9218 #9014 | Differential Revisions: Phab:D1123 #10435 | -------------------------------------+------------------------------------- Comment (by joozek78): @thomie Is there any estimate for this will be completed? When should I start to worry about this issue not being looked at? -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/10726#comment:15 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler

#10726: Upgrade MingW-w64 distributions for windows -------------------------------------+------------------------------------- Reporter: Phyx- | Owner: Phyx- Type: task | Status: merge Priority: normal | Milestone: 7.10.3 Component: Build System | Version: 7.11 Resolution: fixed | Keywords: Operating System: Windows | Architecture: | Unknown/Multiple Type of failure: None/Unknown | Test Case: Blocked By: | Blocking: Related Tickets: #9218 #9014 | Differential Revisions: Phab:D1123 #10435 | -------------------------------------+------------------------------------- Comment (by simonpj): It is not that we have decided ''not'' to produce 7.10.3. It's just that we'll only produce it if it's actually needed! More specifically, we will produce 7.10.3 if (but only if) * there is a significant body of users * for whom 7.10.2 simply doesn't work * and there is no decent workaround they can use * and for which we can be reasonably sure that the fix isn't going to break anything else (necessitating 7.10.4 to mitigate). I don't know whether or not this ticket is in this category. Simon -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/10726#comment:17 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler

#10726: Upgrade MingW-w64 distributions for windows -------------------------------------+------------------------------------- Reporter: Phyx- | Owner: Phyx- Type: task | Status: merge Priority: normal | Milestone: 7.10.3 Component: Build System | Version: 7.11 Resolution: fixed | Keywords: Operating System: Windows | Architecture: | Unknown/Multiple Type of failure: None/Unknown | Test Case: Blocked By: | Blocking: Related Tickets: #9218 #9014 | Differential Revisions: Phab:D1123 #10435 | -------------------------------------+------------------------------------- Comment (by hanjoosten): I would also VERY much see this fix released early. My project is bumping on this issue too. (see this ticket: https://github.com/fpco/minghc/issues/91) -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/10726#comment:19 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler

#10726: Upgrade MingW-w64 distributions for windows -------------------------------------+------------------------------------- Reporter: Phyx- | Owner: Phyx- Type: task | Status: merge Priority: normal | Milestone: 7.10.3 Component: Build System | Version: 7.11 Resolution: fixed | Keywords: Operating System: Windows | Architecture: | Unknown/Multiple Type of failure: None/Unknown | Test Case: Blocked By: | Blocking: Related Tickets: #9218 #9014 | Differential Revisions: Phab:D1123 #10435 | -------------------------------------+------------------------------------- Comment (by tejon): Just found this via @hanjoosten in a MinGHC issue thread. Haven't tested yet, but there's a very good chance this will fix building the GTK+ bindings on Windows: current failures mostly revolve around attempts to use -pthreads, which is not available in GCC 4.6.3 but is as of 4.9.x. -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/10726#comment:21 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler

#10726: Upgrade MingW-w64 distributions for windows -------------------------------------+------------------------------------- Reporter: Phyx- | Owner: Phyx- Type: task | Status: merge Priority: normal | Milestone: 7.10.3 Component: Build System | Version: 7.11 Resolution: fixed | Keywords: Operating System: Windows | Architecture: | Unknown/Multiple Type of failure: None/Unknown | Test Case: Blocked By: | Blocking: Related Tickets: #9218 #9014 | Differential Revisions: Phab:D1123 #10435 | -------------------------------------+------------------------------------- Comment (by thomie): It concerns #10777 ( 296bc70b5ff6c853f2782e9ec5aa47a52110345e, already merged to the ghc-7.10 branch) and the patch from comment:7 (7b211b4e5a38efca437d76ea442495370da7cc9a). I updated https://ghc.haskell.org/trac/ghc/wiki/Status/GHC-7.10.3. -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/10726#comment:23 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler

#10726: Upgrade MingW-w64 distributions for windows -------------------------------------+------------------------------------- Reporter: Phyx- | Owner: Phyx- Type: task | Status: closed Priority: normal | Milestone: 7.10.3 Component: Build System | Version: 7.11 Resolution: fixed | Keywords: Operating System: Windows | Architecture: | Unknown/Multiple Type of failure: None/Unknown | Test Case: Blocked By: | Blocking: Related Tickets: #9218 #9014 | Differential Rev(s): Phab:D1123 #10435 | -------------------------------------+------------------------------------- Changes (by bgamari): * status: merge => closed Comment: Is there any reason why we *need* the toolchain upgrade for 7.10.3? Austin has pointed out to me that this sort of change carries with it substantial risk. Given that we want to ensure that 7.10.3 is stable, I think it is reasonable to be a bit conservative here. I'm going to close this for now as 296bc70b5ff6c853f2782e9ec5aa47a52110345e has been merged. If someone has a compelling reason why we need to update the toolchain then feel free to reopen. -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/10726#comment:25 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler

#10726: Upgrade MingW-w64 distributions for windows -------------------------------------+------------------------------------- Reporter: Phyx- | Owner: Phyx- Type: task | Status: closed Priority: normal | Milestone: 7.10.3 Component: Build System | Version: 7.11 Resolution: fixed | Keywords: Operating System: Windows | Architecture: | Unknown/Multiple Type of failure: None/Unknown | Test Case: Blocked By: | Blocking: Related Tickets: #9218 #9014 | Differential Rev(s): Phab:D1123 #10435 | -------------------------------------+------------------------------------- Comment (by hanjoosten): There are several reports of problems with using windows and ghc 7.10.*. (see https://github.com/commercialhaskell/stack/issues/466 ). When using sandboxes on not too small program, these problems arise. Currently, our project too cannot use ghc 7.10 because of this. I am prefectly willing to do some testing. -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/10726#comment:27 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler

#10726: Upgrade MingW-w64 distributions for windows -------------------------------------+------------------------------------- Reporter: Phyx- | Owner: Type: task | Status: closed Priority: normal | Milestone: 7.10.3 Component: Build System | Version: 7.11 Resolution: fixed | Keywords: Operating System: Windows | Architecture: | Unknown/Multiple Type of failure: None/Unknown | Test Case: Blocked By: | Blocking: Related Tickets: #9218 #9014 | Differential Rev(s): Phab:D1123 #10435 | Wiki Page: | -------------------------------------+------------------------------------- Changes (by bgamari): * status: new => closed * resolution: => fixed -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/10726#comment:29 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler

#10726: Upgrade MingW-w64 distributions for windows -------------------------------------+------------------------------------- Reporter: Phyx- | Owner: Type: task | Status: new Priority: normal | Milestone: 7.10.3 Component: Build System | Version: 7.11 Resolution: | Keywords: Operating System: Windows | Architecture: | Unknown/Multiple Type of failure: None/Unknown | Test Case: Blocked By: | Blocking: Related Tickets: #9218 #9014 | Differential Rev(s): Phab:D1123 #10435 | Wiki Page: | -------------------------------------+------------------------------------- Changes (by lukexi): * status: closed => new * cc: bgamari, thomie (added) * resolution: fixed => Comment: I seem to be hitting a regression with 7.10.3 RC1: I get this when trying to link my bindings to Bullet Physics https://github.com/lukexi/bullet-mini {{{ Preprocessing test suite 'cubes' for bullet-mini-0.1.0.0... [2 of 3] Compiling Types ( test\shared\Types.hs, .stack- work\dist\d96ab9d9\build\cubes\cubes-tmp\Types.o ) ghc.exe: unable to load package `bullet-mini-0.1.0.0' ghc.exe: C:\msys64\home\lukex_000\Projects\bullet-mini\.stack- work\dist\d96ab9d9\build\HSbullet-mini-0.1.0.0-2FOziegOC2l7eL6oW7Ffnm.o: unknown symbol `__mingw_vsscanf' }}} The Types module is the first one that uses Template Haskell. I'd previously triumphantly gotten this package building with a modified version of 7.10.2 with the following patches applied: https://github.com/lukexi/ghc/commits/ghc-7.10.2-release-plus-rework- windows-pe-linker So something broke between here and there. So far I've tried updating my entire pacman database but that didn't seem to help. -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/10726#comment:31 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler

#10726: Upgrade MingW-w64 distributions for windows -------------------------------------+------------------------------------- Reporter: Phyx- | Owner: Type: task | Status: new Priority: normal | Milestone: 7.10.3 Component: Build System | Version: 7.11 Resolution: | Keywords: Operating System: Windows | Architecture: | Unknown/Multiple Type of failure: None/Unknown | Test Case: Blocked By: | Blocking: Related Tickets: #9218 #9014 | Differential Rev(s): Phab:D1123 #10435 | Wiki Page: | -------------------------------------+------------------------------------- Comment (by awson): `__mingw_vsscanf` resides in `libmingwex.a` which is never mentioned in project's cabal file. -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/10726#comment:33 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler

#10726: Upgrade MingW-w64 distributions for windows -------------------------------------+------------------------------------- Reporter: Phyx- | Owner: Type: task | Status: new Priority: normal | Milestone: 7.10.3 Component: Build System | Version: 7.11 Resolution: | Keywords: Operating System: Windows | Architecture: | Unknown/Multiple Type of failure: None/Unknown | Test Case: Blocked By: | Blocking: Related Tickets: #9218 #9014 | Differential Rev(s): Phab:D1123 #10435 | Wiki Page: | -------------------------------------+------------------------------------- Comment (by awson): I think the problem is in that `libmingwex.a` is unavailable during project's prelinked object file (`HSbullet- mini-0.1.0.0-2FOziegOC2l7eL6oW7Ffnm.o` in your case) creation. Thus instead of adding `mingwex` to `extra-libraries` try to all something like `-lmingwex` to `ghc-options`. -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/10726#comment:35 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler

#10726: Upgrade MingW-w64 distributions for windows -------------------------------------+------------------------------------- Reporter: Phyx- | Owner: Type: task | Status: new Priority: normal | Milestone: 7.10.3 Component: Build System | Version: 7.11 Resolution: | Keywords: Operating System: Windows | Architecture: | Unknown/Multiple Type of failure: None/Unknown | Test Case: Blocked By: | Blocking: Related Tickets: #9218 #9014 | Differential Rev(s): Phab:D1123 #10435 | Wiki Page: | -------------------------------------+------------------------------------- Comment (by Phyx-): I don't really know how `stack` works, and I am sort of confused why `--interactive` is involved here. Never the less, I don't think anything broke here, interactive was just never fixed. Previously when it built `cabal run` was used as a test. This wouldn't use the runtime linker and should still be working. I think the duplicate symbols error is coming from the fact that the Rts re-exports some symbols from `mingw` but not all. it includes `SymI_HasProto(coshf)` under the comment: {{{ /* These are statically linked from the mingw libraries into the ghc executable, so we have to employ this hack. */ }}} Does `run` still produce a working binary? -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/10726#comment:37 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler

#10726: Upgrade MingW-w64 distributions for windows -------------------------------------+------------------------------------- Reporter: Phyx- | Owner: Type: task | Status: new Priority: normal | Milestone: 7.10.3 Component: Build System | Version: 7.11 Resolution: | Keywords: Operating System: Windows | Architecture: | Unknown/Multiple Type of failure: None/Unknown | Test Case: Blocked By: | Blocking: Related Tickets: #9218 #9014 | Differential Rev(s): Phab:D1123 #10435 | Wiki Page: | -------------------------------------+------------------------------------- Comment (by Phyx-): Yes, sorry, I was confused as to why the runtime linker was involved during a normal compilation. But `TH` makes sense. I guess a temporary solution to get `7.10.3` out the door is to just re- export everything from `mingwex` since you can't actually specify `-lmingwex` current. But I have wondered and still do why the RTS is re-exporting symbols like this instead of us just linking against `-lmingwex`. Do you have an idea why @awson? -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/10726#comment:39 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler

#10726: Upgrade MingW-w64 distributions for windows -------------------------------------+------------------------------------- Reporter: Phyx- | Owner: Type: task | Status: new Priority: normal | Milestone: 7.10.3 Component: Build System | Version: 7.11 Resolution: | Keywords: Operating System: Windows | Architecture: | Unknown/Multiple Type of failure: None/Unknown | Test Case: Blocked By: | Blocking: Related Tickets: #9218 #9014 | Differential Rev(s): Phab:D1123 #10435 | Wiki Page: | -------------------------------------+------------------------------------- Comment (by Phyx-): Thanks Elieux! I didn't know I was there, I'll give it a try, would be an easy fix. @lukexi your bullet-mini example doesn't compile: {{{ Preprocessing library bullet-mini-0.1.0.0... [1 of 1] Compiling Physics.Bullet ( src\Physics\Bullet.hs, dist\build\Physics\Bullet.o ) src\Physics\Bullet.cpp:2:36: fatal error: btBulletDynamicsCommon.h: No such file or directory compilation terminated. }}} Did you miss a file? -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/10726#comment:43 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler

#10726: Upgrade MingW-w64 distributions for windows -------------------------------------+------------------------------------- Reporter: Phyx- | Owner: Type: task | Status: new Priority: normal | Milestone: 7.10.3 Component: Build System | Version: 7.11 Resolution: | Keywords: Operating System: Windows | Architecture: | Unknown/Multiple Type of failure: None/Unknown | Test Case: Blocked By: | Blocking: Related Tickets: #9218 #9014 | Differential Rev(s): Phab:D1123 #10435 | Wiki Page: | -------------------------------------+------------------------------------- Comment (by lukexi): (oops, and I forgot to push a fix to the linking test I made a few days ago, so be sure to pull again now!) -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/10726#comment:45 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler

#10726: Upgrade MingW-w64 distributions for windows -------------------------------------+------------------------------------- Reporter: Phyx- | Owner: Type: task | Status: new Priority: normal | Milestone: 7.10.3 Component: Build System | Version: 7.11 Resolution: | Keywords: Operating System: Windows | Architecture: | Unknown/Multiple Type of failure: None/Unknown | Test Case: Blocked By: | Blocking: Related Tickets: #9218 #9014 | Differential Rev(s): Phab:D1123 #10435 | Wiki Page: | -------------------------------------+------------------------------------- Comment (by Phyx-): @lukexi thanks, can reproduce it now :) @Elieux unfortunately it seems it's not that easy. The `rts` seems to be a special case again. The linker seems to ignore the `extra-libraries` from the `package.conf`, which explains why you can put anything you want in there and it'll still compile. {{{ 128 emptyPLS :: DynFlags -> PersistentLinkerState 129 emptyPLS _ = PersistentLinkerState { 130 closure_env = emptyNameEnv, 131 itbl_env = emptyNameEnv, 132 pkgs_loaded = init_pkgs, 133 bcos_loaded = [], 134 objs_loaded = [], 135 temp_sos = [] } 136 137 -- Packages that don't need loading, because the compiler 138 -- shares them with the interpreted program. 139 -- 140 -- The linker's symbol table is populated with RTS symbols using an 141 -- explicit list. See rts/Linker.c for details. 142 where init_pkgs = [rtsUnitId] }}}

Therefore i believe proper solution should be linking `libmingwex.a`as a whole archive when building ghc.exe, instead of just letting GCC to link only used symbols as it does by default.

Hence the temporary solution. The package.conf for the `rts` ignores the `extra-libraries` section in the linker. Windows isn't alone here, Mac also re-exports some symbols. And before ripping this out I want to know why. Also I think it's riskier then just adding some extra symbols. **As** it is right now, there is no way to use `libmingwex.a` on Windows.

Reexporting those symbols seems like a bad idea, because, if I'm not mistaken, RTS gets linked into ever executable produced by GHC, so this way we are actually forcing possibly unnecessary symbols into every executable?

Yes, I don't know why it was done this way. However we are already re- exporting some of the symbols. Quite a few in fact. Yes the proper solution is to rip the symbols out and just link against `libmingwex.a` which may get in to `8.0`, but for `7.10.3` I doubt it. It's already at `RC3`. -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/10726#comment:47 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler

#10726: Upgrade MingW-w64 distributions for windows -------------------------------------+------------------------------------- Reporter: Phyx- | Owner: Type: task | Status: patch Priority: high | Milestone: 7.10.3 Component: Build System | Version: 7.11 Resolution: | Keywords: Operating System: Windows | Architecture: | Unknown/Multiple Type of failure: None/Unknown | Test Case: Blocked By: | Blocking: Related Tickets: #9218 #9014 | Differential Rev(s): Phab:D1123 #10435 | Wiki Page: | -------------------------------------+------------------------------------- Comment (by RyanGlScott): I'm joining the conversation pretty late here, but how exactly did you know which symbols to export in `Linker.c`? I ask since I'm getting some pretty similar errors to what you've been reporting with different packages. For example, when loading `logfloat` in GHCi HEAD: {{{ $ ghc-stage2 --interactive GHCi, version 7.11.20151123: http://www.haskell.org/ghc/ :? for help

import Data.Number.LogFloat log1p 1.0 <interactive>: C:\Users\ryanscot\AppData\Roaming\cabal\x86_64-windows- ghc-7.11.20151123\logfloat-0.13.3.3-4JZYNCXKwghOD60rvMUAcn\HSlogfloat-0.13.3.3-4JZYNCXKwghOD60rvMUAcn.o: unknown symbol `log1p' ghc-stage2.exe: unable to load package `logfloat-0.13.3.3' }}}

And when loading `sdl2` in GHCi HEAD: {{{ $ ghc-stage2 --interactive GHCi, version 7.11.20151123: http://www.haskell.org/ghc/ :? for help

import SDL ticks GHC runtime linker: fatal error: I found a duplicate definition for symbol wmain whilst processing object file C:/Users/ryanscot/Documents/Software/ghc/inplace/mingw/bin/../lib/gcc/x86_64-w64-mingw32/5.2.0/../../../../x86_64-w64-mingw32/lib/../lib/libmingw32.a This could be caused by: * Loading two different object files which export the same symbol * Specifying the same object file twice on the GHCi command line * An incorrect `package.conf' entry, causing some object to be loaded twice. ghc-stage2.exe: panic! (the 'impossible' happened) (GHC version 7.11.20151123 for x86_64-unknown-mingw32): loadArchive "C:/Users/ryanscot/Documents/Software/ghc/inplace/mingw/bin/../lib/gcc/x86_64-w64-mingw32/5.2.0/../../../../x86_64-w64-mingw32/lib/../lib/libmingw32.a": failed

Please report this as a GHC bug: http://www.haskell.org/ghc/reportabug }}} Is this because `libmingw32`/`libmingwex` aren't being linked against when building GHC? Also, how can I figure out which symbols to reexport as a temporary fix? -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/10726#comment:50 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler

#10726: Upgrade MingW-w64 distributions for windows -------------------------------------+------------------------------------- Reporter: Phyx- | Owner: Type: task | Status: patch Priority: high | Milestone: 7.10.3 Component: Build System | Version: 7.11 Resolution: | Keywords: Operating System: Windows | Architecture: | Unknown/Multiple Type of failure: None/Unknown | Test Case: Blocked By: | Blocking: Related Tickets: #9218 #9014 | Differential Rev(s): Phab:D1123 #10435 | Wiki Page: | -------------------------------------+------------------------------------- Changes (by RyanGlScott): * Attachment "logfloat_output.txt" added. runghc -v LogFloat.hs -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/10726 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler

#10726: Upgrade MingW-w64 distributions for windows -------------------------------------+------------------------------------- Reporter: Phyx- | Owner: Type: task | Status: patch Priority: high | Milestone: 7.10.3 Component: Build System | Version: 7.11 Resolution: | Keywords: Operating System: Windows | Architecture: | Unknown/Multiple Type of failure: None/Unknown | Test Case: Blocked By: | Blocking: Related Tickets: #9218 #9014 | Differential Rev(s): Phab:D1123 #10435 | Wiki Page: | -------------------------------------+------------------------------------- Comment (by RyanGlScott): I've attached the results of invoking `runghc -v` on two different files. `LogFloat.hs` is this: {{{#!hs module Main (main) where import Data.Number.LogFloat (log1p) main :: IO () main = print $ log1p 1.0 }}} `AudioExample.hs` is [https://github.com/haskell- game/sdl2/blob/69156dd7b5aad421d70096a47defe02ec3c24688/examples/AudioExample.hs this file], just with the module name `Main` instead of `AudioExample`. Adding `-no-hs-main` didn't appear to change the error message. -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/10726#comment:52 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler

#10726: Upgrade MingW-w64 distributions for windows -------------------------------------+------------------------------------- Reporter: Phyx- | Owner: Type: task | Status: patch Priority: high | Milestone: 7.10.3 Component: Build System | Version: 7.11 Resolution: | Keywords: Operating System: Windows | Architecture: | Unknown/Multiple Type of failure: None/Unknown | Test Case: Blocked By: | Blocking: Related Tickets: #9218 #9014 | Differential Rev(s): Phab:D1123 #10435 | Wiki Page: | -------------------------------------+------------------------------------- Comment (by Phyx-): I'm currently trying to track down an issue in `HEAD` so I can't test this myself atm, but @RyanGIScott can you try something for me, since you're linking against `libm.a` try just adding `-lmsvcr120` and see if that links. You may have an older version of the library so check the output of `dir c:\Windows\System32\msvcr*.dll`. This should work since `libm.a` is a stub just to satisfy linking because the symbols are In the Microsoft runtime. @Lukexi instead of re-exporting the symbols, try using the stock `RC3`, can you rebuild your C parts with `-D__USE_MINGW_ANSI_STDIO=0`. This will make `MingW-w64` drop the `__mingw` prefixes and then the symbols should be found in the `msvcr*.dll` as well. So then you can just link against that as well. This could be a workaround if the patch doesn't make it in `7.10.3`. I haven't gotten any response to whether it would. -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/10726#comment:54 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler

#10726: Upgrade MingW-w64 distributions for windows -------------------------------------+------------------------------------- Reporter: Phyx- | Owner: Type: task | Status: patch Priority: high | Milestone: 7.10.3 Component: Build System | Version: 7.11 Resolution: | Keywords: Operating System: Windows | Architecture: | Unknown/Multiple Type of failure: None/Unknown | Test Case: Blocked By: | Blocking: Related Tickets: #9218 #9014 | Differential Rev(s): Phab:D1123 #10435 | Wiki Page: | -------------------------------------+------------------------------------- Comment (by Phyx-): LogFloat seems to have a fallback method to a less accurate version depending on if FFI is used: {{{ #ifdef __USE_FFI__ foreign import ccall unsafe "math.h log1p" log1p :: Double -> Double #else -- See statistics:Statistics.Math for a more accurate Haskell -- implementation. log1p :: Double -> Double {-# INLINE [0] log1p #-} log1p x = log (1 + x) #endif }}} `__USE_FFI__` is set in the cabal file but of course won't be set using `--interactive`. Adding `-D__USE_FFI__` to the command should trigger the same error. -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/10726#comment:56 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler

#10726: Upgrade MingW-w64 distributions for windows -------------------------------------+------------------------------------- Reporter: Phyx- | Owner: Type: task | Status: patch Priority: high | Milestone: 8.0.1 Component: Build System | Version: 7.11 Resolution: | Keywords: Operating System: Windows | Architecture: | Unknown/Multiple Type of failure: None/Unknown | Test Case: Blocked By: | Blocking: Related Tickets: #9218 #9014 | Differential Rev(s): Phab:D1123 #10435 | Wiki Page: | -------------------------------------+------------------------------------- Changes (by bgamari): * milestone: 7.10.3 => 8.0.1 Comment: Bumping to 8.0.1. -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/10726#comment:58 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler

#10726: Upgrade MingW-w64 distributions for windows -------------------------------------+------------------------------------- Reporter: Phyx- | Owner: Type: task | Status: patch Priority: high | Milestone: 8.0.1 Component: Build System | Version: 7.11 Resolution: | Keywords: Operating System: Windows | Architecture: | Unknown/Multiple Type of failure: None/Unknown | Test Case: Blocked By: | Blocking: Related Tickets: #9218 #9014 | Differential Rev(s): Phab:D1123 #10435 | Wiki Page: | -------------------------------------+------------------------------------- Comment (by Phyx-): Sorry, haven't had much time lately to look at GHC the past weeks. I should have free time again next week and I'll try to get as much as my tickets done!. I think I have a proper solution for this for `8.0.1` that doesn't require me to change the code for all platforms. -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/10726#comment:60 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler

#10726: Upgrade MingW-w64 distributions for windows -------------------------------------+------------------------------------- Reporter: Phyx- | Owner: Type: task | Status: patch Priority: high | Milestone: 8.0.1 Component: Build System | Version: 7.11 Resolution: | Keywords: Operating System: Windows | Architecture: | Unknown/Multiple Type of failure: None/Unknown | Test Case: Blocked By: | Blocking: Related Tickets: #9218 #9014 | Differential Rev(s): Phab:D1123 #10435 | Wiki Page: | -------------------------------------+------------------------------------- Comment (by Phyx-): @bgamari I've tried 2 approaches which haven't worked completely: 1) I tried removing the symbols from the export list and adding `libmingwex` to the rts's `package.conf`and have it just link against it. But turns out the `rts`'s `package.conf` is ignored on all platforms. I didn't want to have to make an exception for Windows here and I don't know why the other platforms also ignore it so I abandoned this approach. 2) I tried marking the symbols we're re-exporting as weak symbols, so there wouldn't be a change to existing code and would allow you to link against `libmingwex`. But unfortunately because of when the other libraries specified by `-l` are linked in, some of the symbols have already been used and thus aren't weak anymore. So I still get duplicate link errors. What I want to try now is leaving them as weak symbols, but loading `libmingwex.a` at `rts` initialization time. Much like how `kernel32` is loaded. This is hopefully early enough that the symbols haven't been used yet. I'll give that a try tonight. -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/10726#comment:62 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler

#10726: Upgrade MingW-w64 distributions for windows -------------------------------------+------------------------------------- Reporter: Phyx- | Owner: Type: task | Status: closed Priority: high | Milestone: 8.0.1 Component: Build System | Version: 7.11 Resolution: fixed | Keywords: Operating System: Windows | Architecture: | Unknown/Multiple Type of failure: None/Unknown | Test Case: Blocked By: | Blocking: Related Tickets: #9218 #9014 | Differential Rev(s): Phab:D1123 #10435 #11223 | Wiki Page: | -------------------------------------+------------------------------------- Changes (by Phyx-): * status: new => closed * resolution: => fixed * related: #9218 #9014 #10435 => #9218 #9014 #10435 #11223 Comment: Closing this issue as the error isn't directly related to the upgrade of `GCC` as it predated the upgrade. New issue is now #11223 . -- Ticket URL: http://ghc.haskell.org/trac/ghc/ticket/10726#comment:64 GHC http://www.haskell.org/ghc/ The Glasgow Haskell Compiler