August 2018 - ghc-devs

Haskell DLL (using FFI) causes memory leak.
by Ольга Филиппская 28 Aug '18

28 Aug '18

Hello. *Summary: *memory is consumed without releasing when a Haskell DLL (that uses FFI) is loaded and unloaded in an endless loop. *Details*: I'm working on a C++ project relying on a DLL that uses Haskell code. The DLL was built with GHC 8.0.1 x64, OS is Windows 7. (Newer versions of GHC - 8.2.1 and later - do not allow you to build such DLLs due to some bugs: ticket #1 <https://ghc.haskell.org/trac/ghc/ticket/14472#no2> , ticker #2 <https://ghc.haskell.org/trac/ghc/ticket/14784#no1>). The C++ project was built with MSVC compiler 2015. We noticed that memory is not released when the library is unloaded. I've constructed a baseline example to reproduce the bug. It has three files: the first one is *HaskellSources.hs*(see attachments). It contains one foreign export function foo. This foreign export function is necessary to reproduce the bug. The second file is *CWrapper.cpp*. I intentionally didn't include any Haskell function export because they make no difference for this example. The last file is the code of the main program (see *main.cpp*) that loads the library and unloads it at once in an endless loop. There are two cases: whether HaskellExports.o is included into the library or not. 1. HaskellExports.o is not included into the library (see attached build script* build_no_hs.sh*). Everything works just fine (i.e. amount of memory consumed by the app is the same before DLL loading and right after unloading.) 2. HaskellExports.o is included into the library (see *build_w_hs.sh*). Memory is not released after unloading the DLL, after repeated load/unload cycles memory consumption keeps growing until finally the application crashes. Is this a known problem? Is it tracked in your bugtracker? (Or maybe it is not a problem at all and I'm doing it wrong). Thank you for your time. -- *Olga Philippskaya.*

4 6

Re: Bump base version
by Ryan Scott 27 Aug '18

27 Aug '18

I'm confused. base-4.12.0.0 hasn't been released yet, so can't we just make this StableName change a part of 4.12.0.0? (Regardless of what we choose, we should make sure to advertise this change in base's changelog—currently it's unmentioned.) Ryan S.

2 2

GHC 8.6.1 release status
by Ben Gamari 25 Aug '18

25 Aug '18

Hi everyone, I was getting ready to prepare the final 8.6.1 release tarballs when Herbert pointed out that the testsuite of his cryptohash-sha256 package currently segfaults. This appears to be a rather serious, non-deterministic regression. I've opened #15544 to track this and will delay the final 8.6.1 release until this is resolved. Cheers, - Ben

8 11

Bump base version
by David Feuer 24 Aug '18

24 Aug '18

We need to bump the base version to 4.12.1 to accommodate the StableName update. -- David Feuer Well-Typed

1 0

Unlifted primop types
by David Feuer 23 Aug '18

23 Aug '18

I'm trying to implement a single primop to replace sameMutVar#, sameMutableArray#, etc. The primop should have type unliftedPtrEquality# :: forall (a :: TYPE 'UnliftedRep). a -> a -> Int# Unfortunately, I don't see a way to express this type in primops.pp.txt. Is it possible? If not, what's the right way to give the primop the right type?

4 14

Thank you
by Simon Peyton Jones 22 Aug '18

22 Aug '18

Ryan I just wanted to thank you for the incredible job you are doing in finding and fixing GHC bugs. From deriving, to pattern-match overlap checking, to Template Haskell, to arcane corners of the type inference engine... you are a bug-fixing machine! Plus you often bisect to find the patch that caused a bug and/or distil a much smaller test case. Both are extremely helpful. Thank you. Simon

1 0

Build entirely broken
by Simon Peyton Jones 22 Aug '18

22 Aug '18

>From a clean build I'm getting this ld: cannot find libraries/ghc-prim/dist-install/build/GHC/CString.o: No such file or directory ld: cannot find libraries/ghc-prim/dist-install/build/GHC/Classes.o: No such file or directory ld: cannot find libraries/ghc-prim/dist-install/build/GHC/Debug.o: No such file or directory ld: cannot find libraries/ghc-prim/dist-install/build/GHC/IntWord64.o: No such file or directory ld: cannot find libraries/ghc-prim/dist-install/build/GHC/Magic.o: No such file or directory ld: cannot find libraries/ghc-prim/dist-install/build/GHC/PrimopWrappers.o: No such file or directory ld: cannot find libraries/ghc-prim/dist-install/build/GHC/Tuple.o: No such file or directory ld: cannot find libraries/ghc-prim/dist-install/build/GHC/Types.o: No such file or directory And indeed those files don't exist. In earlier builds they were there. The command line for eg CString was "inplace/bin/ghc-stage1" -hisuf hi -osuf o -hcsuf hc -static -O0 -H64m -Wall -fllvm-fill-undef-with-garbage -Werror -this-unit-id ghc-prim-0.5.3 -hide-all-packages -i -ilibraries/ghc-prim/. -ilibraries/ghc-prim/dist-install/build -Ilibraries/ghc-prim/dist-install/build -ilibraries/ghc-prim/dist-install/build/./autogen -Ilibraries/ghc-prim/dist-install/build/./autogen -Ilibraries/ghc-prim/. -optP-include -optPlibraries/ghc-prim/dist-install/build/./autogen/cabal_macros.h -package-id rts -this-unit-id ghc-prim -XHaskell2010 -O -dcore-lint -dno-debug-output -ticky -no-user-package-db -rtsopts -Wno-trustworthy-safe -Wno-deprecated-flags -Wnoncanonical-monad-instances -odir libraries/ghc-prim/dist-install/build -hidir libraries/ghc-prim/dist-install/build -stubdir libraries/ghc-prim/dist-install/build -split-objs -dynamic-too -c libraries/ghc-prim/./GHC/CString.hs -o libraries/ghc-prim/dist-install/build/GHC/CString.o -dyno libraries/ghc-prim/dist-install/build/GHC/CString.dyn_o which looks right. What's going on? This has me totally stalled. Simonb

3 7

Stable name equality
by David Feuer 21 Aug '18

21 Aug '18

eqStableName# is not currently defined as pointer equality. Is there some reason for this? My understanding is that there is a one-to-one correspondence between stable name objects and active stable name table entries, so pointer equality should be sufficient. Am I missing something?

3 7

Sphinx faliing
by Simon Peyton Jones 20 Aug '18

20 Aug '18

I have the following crash when building docs on Linux. This is on a clean, up-to-date HEAD build. Does anyone have any ideas? The "full traceback" is here # Sphinx version: 1.3.6 # Python version: 2.7.12 (CPython) # Docutils version: 0.12 release # Jinja2 version: 2.8 # Last messages: # Running Sphinx v1.3.6 # loading pickled environment... # not yet created # building [mo]: targets for 0 po files that are out of date # building [man]: all manpages # updating environment: # 40 added, 0 changed, 0 removed # reading sources... [ 2%] 8.2.1-notes # reading sources... [ 5%] 8.4.1-notes # Loaded extensions: # ghc_packages (1.0) from /5playpen/simonpj/HEAD-4/docs/users_guide/ghc_packages.pyc # sphinx.ext.extlinks (1.3.6) from /usr/lib/python2.7/dist-packages/sphinx/ext/extlinks.pyc # flags (1.0) from /5playpen/simonpj/HEAD-4/docs/users_guide/flags.pyc # sphinx.ext.mathjax (1.3.6) from /usr/lib/python2.7/dist-packages/sphinx/ext/mathjax.pyc # alabaster (0.7.7) from /usr/lib/python2.7/dist-packages/alabaster/__init__.pyc Traceback (most recent call last): File "/usr/lib/python2.7/dist-packages/sphinx/cmdline.py", line 244, in main app.build(opts.force_all, filenames) File "/usr/lib/python2.7/dist-packages/sphinx/application.py", line 267, in build self.builder.build_update() File "/usr/lib/python2.7/dist-packages/sphinx/builders/__init__.py", line 246, in build_update self.build(['__all__'], to_build) File "/usr/lib/python2.7/dist-packages/sphinx/builders/__init__.py", line 265, in build self.doctreedir, self.app)) File "/usr/lib/python2.7/dist-packages/sphinx/environment.py", line 547, in update self._read_serial(docnames, app) File "/usr/lib/python2.7/dist-packages/sphinx/environment.py", line 567, in _read_serial self.read_doc(docname, app) File "/usr/lib/python2.7/dist-packages/sphinx/environment.py", line 716, in read_doc encoding=self.config.source_encoding) File "/usr/lib/python2.7/dist-packages/sphinx/io.py", line 104, in __init__ FileInput.__init__(self, *args, **kwds) File "/usr/lib/python2.7/dist-packages/docutils/io.py", line 238, in __init__ raise InputError(error.errno, error.strerror, source_path) InputError: [Errno 2] No such file or directory: u'/5playpen/simonpj/HEAD-4/docs/users_guide/8.4.1-notes.rst' Simon Running Sphinx v1.3.6 loading pickled environment... not yet created building [mo]: targets for 0 po files that are out of date building [man]: all manpages updating environment: 40 added, 0 changed, 0 removed reading sources... [ 2%] 8.2.1-notes loading pickled environment... not yet created building [mo]: targets for 0 po files that are out of date building [html]: targets for 40 source files that are out of date updating environment: 40 added, 0 changed, 0 removed reading sources... [ 2%] 8.2.1-notes reading sources... [ 5%] 8.4.1-notes Exception occurred: File "/usr/lib/python2.7/dist-packages/docutils/io.py", line 238, in __init__ raise InputError(error.errno, error.strerror, source_path) InputError: [Errno 2] No such file or directory: u'/5playpen/simonpj/HEAD-4/docs/users_guide/8.4.1-notes.rst' The full traceback has been saved in /tmp/sphinx-err-XYpRbc.log, if you want to report the issue to the developers. Please also report this if it was a user error, so that a better error message can be provided next time. A bug report can be filed in the tracker at <https://github.com/sphinx-doc/sphinx/issues>. Thanks! docs/users_guide/ghc.mk:28: recipe for target 'docs/users_guide/build-man/ghc.1' failed make[1]: *** [docs/users_guide/build-man/ghc.1] Error 1 make[1]: *** Waiting for unfinished jobs.... reading sources... [ 5%] 8.4.1-notes Exception occurred: File "/usr/lib/python2.7/dist-packages/docutils/io.py", line 238, in __init__ raise InputError(error.errno, error.strerror, source_path) InputError: [Errno 2] No such file or directory: u'/5playpen/simonpj/HEAD-4/docs/users_guide/8.4.1-notes.rst' The full traceback has been saved in /tmp/sphinx-err-2RrOTD.log, if you want to report the issue to the developers. Please also report this if it was a user error, so that a better error message can be provided next time. A bug report can be filed in the tracker at <https://github.com/sphinx-doc/sphinx/issues>. Thanks! docs/users_guide/ghc.mk:16: recipe for target 'docs/users_guide/build-html/users_guide/index.html' failed make[1]: *** [docs/users_guide/build-html/users_guide/index.html] Error 1

1 1

Trac #13064: push
by Simon Peyton Jones 20 Aug '18

20 Aug '18

Ben I've pushed fixes for Trac #13064/#15393, and also for #15487. The fixes are on wip/T13064 They concern error reporting for unused imports etc. I have not pushed to master because the fixes produce warnings in at least * containers * bytestring * text about unused imports. And indeed they are unused! But I'm not sure I'll the protocol right about updating those package, doing the right submodule updates etc. Also I have not compiled Haddock. Could you possibly close the loop on this - do the necessary changes and commit to master? Thanks! Simon

1 0