September 2012 - Glasgow-haskell-users

GHC build linking error
by wren ng thornton 29 Nov '12

29 Nov '12

Hello all, I'm working on creating some distribution bundles of GHC 7.4.1 and HP 2012.2.0.0 for OSX 10.5 to help rectify the lack of support on older Macs. In building GHC I've run into a linking error in stage1: ld: duplicate symbol ___gmpz_abs in libraries/integer-gmp/gmp/objs/add.o and libraries/integer-gmp/gmp/objs/abs.o Which looks like the same issue discussed in: http://www.haskell.org/pipermail/glasgow-haskell-users/2011-December/021339… The only proposed solution was Sean mentioned explicitly passing the GMP.framework to ./configure via --with-gmp-libraries and --with-gmp-includes; however, I have no such GMP.framework (I'm building from the framework versions of GHC 6.12.1 and HP 2010.1.0.0). So, any ideas on how to fix this? -- Live well, ~wren

3 3

GHC on OpenIndiana
by asyropoulos＠aol.com 28 Oct '12

28 Oct '12

Dear Developers, I am trying to compile the GHC on OpenIndiana (essentially Solaris 11). I follow the steps in http://www.haskell.org/ghc/docs/6.4.1/html/building/sec-porting-ghc.html#se… and here is what I get: $ ./distrib/hc-build --prefix=/opt/gnu/ghcb --enable-hc-boot *** Building compiler... checking for gfind... /usr/bin/gfind checking for sort... /opt/gnu/bin/sort checking for ghc... no checking build system type... i386-pc-solaris2.11 checking host system type... i386-pc-solaris2.11 checking target system type... i386-pc-solaris2.11 HOST: i386-pc-solaris2.11 Can't work out build platform Not e that configure.ac contains a section on Solaris: SOLARIS_BROKEN_SHLD=NO case $host in i386-*-solaris2) # here we go with the test MINOR=`uname -r|cut -d '.' -f 2-` if test "$MINOR" -lt "11"; then SOLARIS_BROKEN_SHLD=YES fi ;; esac For whatever the reason I "need to update configure.in to recognise the new architecture, and re-generate configure with autoreconf" but I have no idea what exactly to add. There is no template inside to help me. Could you please let me know what should I do to proceed? Thank you in advance for your help/suggestions. A.S. -- Apostolos Syropoulos Xanthi, Greece

3 2

RULES for ByteString are not fired
by Kazu Yamamoto 28 Oct '12

28 Oct '12

Hello, I seems to us (my friends and me) that term rewriting rules for ByteString are not fired in recent GHCs. 6.12.3 OK 7.0.4 NG 7.4.1 NG 7.6.1RC1 NG For example, with the example from this ticket http://hackage.haskell.org/trac/ghc/ticket/3703 results in as follows: % ghc -O -ddump-simpl-stats --make breakOn.hs 14 RuleFired 4 Class op showsPrec 2 Class op show 2 eqChar#->case 2 unpack 2 unpack-list 1 Class op == 1 Class op >> There is no ByteString rules. Is this a bug or intention? --Kazu {-# LANGUAGE OverloadedStrings #-} import qualified Data.ByteString.Char8 as B main :: IO () main = do let string1 = B.pack "This is a string" string2 = B.pack "This is another string" print (breakOn ' ' string1) print (breakOn ' ' string2) breakOn :: Char -> B.ByteString -> (B.ByteString, B.ByteString) breakOn c = B.break (c==)

3 2

PolyKind issue in GHC 7.6.1rc1: How to make a kind a functional dependency?
by Edward Kmett 12 Oct '12

12 Oct '12

If I define the following {-# LANGUAGE FunctionalDependencies, GADTs, KindSignatures, MultiParamTypeClasses, PolyKinds, RankNTypes, TypeOperators, DefaultSignatures, DataKinds, FlexibleInstances, UndecidableInstances #-} module Indexed.Test where class IMonad (m :: (k -> *) -> k -> *) where ireturn :: a x -> m a x infixr 5 :- data Thrist :: ((i,i) -> *) -> (i,i) -> * where Nil :: Thrist a '(i,i) (:-) :: a '(i,j) -> Thrist a '(j,k) -> Thrist a '(i,k) instance IMonad Thrist where ireturn a = a :- Nil Then 'ireturn' complains (correctly) that it can't match the k with the kind (i,i). The reason it can't is because when you look at the resulting signature for the MPTC it generates it looks like class IMonad k m where ireturn :: a x -> m a x However, there doesn't appear to be a way to say that the kind k should be determined by m. I tried doing: class IMonad (m :: (k -> *) -> k -> *) | m -> k where ireturn :: a x -> m a x Surprisingly (to me) this compiles and generates the correct constraints for IMonad: ghci> :set -XPolyKinds -XKindSignatures -XFunctionalDependencies -XDataKinds -XGADTs ghci> class IMonad (m :: (k -> *) -> k -> *) | m -> k where ireturn :: a x -> m a x ghci> :info IMonad class IMonad k m | m -> k where ireturn :: a x -> m a x But when I add ghci> :{ Prelude| data Thrist :: ((i,i) -> *) -> (i,i) -> * where Prelude| Nil :: Thrist a '(i,i) Prelude| (:-) :: a '(i,j) -> Thrist a '(j,k) -> Thrist a '(i,k) Prelude| :} and attempt to introduce the instance, I crash: ghci> instance IMonad Thrist where ireturn a = a :- Nil ghc: panic! (the 'impossible' happened) (GHC version 7.6.0.20120810 for x86_64-apple-darwin): lookupVarEnv_NF: Nothing Please report this as a GHC bug: http://www.haskell.org/ghc/reportabug Moreover, attempting to compile them in separate modules leads to a different issue. Within the module, IMonad has a type that includes the kind k and the constraint on it from m. But from the other module, :info shows no such constraint, and the above code again fails to typecheck, but upon trying to recompile, when GHC goes to load the IMonad instance from the core file, it panicks again differently about references to a variable not present in the core. Is there any way to make such a constraint that determines a kind from a type parameter in GHC 7.6 at this time? I tried the Kind hack used in GHC.TypeLits, but it doesn't seem to be applicable to this situation. -Edward

9 37

Installing binary tarball fails on Linux
by Johan Tibell 09 Oct '12

09 Oct '12

Hi, I tried to install the GHC 7.4.1 32-bit binary tarball today and ran into the error below. Are 32-bit GHC's not supported on 64-bit Linuxes? The error: Installing library in /usr/local/lib/ghc-7.4.1/ghc-prim-0.2.0.0 ghc-cabal: Bad interface file: dist-install/build/GHC/Classes.hi magic number mismatch: old/corrupt interface file? (wanted 33214052, got 129742) Full log: $ tar jxf ghc-7.4.1-i386-unknown-linux.tar.bz2 $ cd ghc-7.4.1/ tibell@tibell:ghc-7.4.1$ ./configure --prefix=/usr/local checking for path to top of build tree... /tmp/ghc-7.4.1 Build platform inferred as: i386-unknown-linux Host platform inferred as: i386-unknown-linux Target platform inferred as: i386-unknown-linux GHC build : i386-unknown-linux GHC host : i386-unknown-linux GHC target : i386-unknown-linux checking for perl... /usr/bin/perl checking if your perl works in shell scripts... yes checking for a BSD-compatible install... /usr/bin/install -c checking whether ln -s works... yes checking for gsed... sed checking for gcc... /usr/bin/gcc checking for gcc... /usr/bin/gcc checking whether the C compiler works... yes checking for C compiler default output file name... a.out checking for suffix of executables... checking whether we are cross compiling... no checking for suffix of object files... o checking whether we are using the GNU C compiler... yes checking whether /usr/bin/gcc accepts -g... yes checking for /usr/bin/gcc option to accept ISO C89... none needed checking version of gcc... 4.4.3 checking how to run the C preprocessor... /usr/bin/gcc -E checking whether ld understands --hash-size=31... checking whether ld understands --reduce-memory-overheads... checking for extra options to pass gcc when compiling via C... -fwrapv checking Setting up CFLAGS, LDFLAGS, IGNORE_LINKER_LD_FLAGS and CPPFLAGS... done checking Setting up CONF_CC_OPTS_STAGE0, CONF_GCC_LINKER_OPTS_STAGE0, CONF_LD_LINKER_OPTS_STAGE0 and CONF_CPP_OPTS_STAGE0... done checking Setting up CONF_CC_OPTS_STAGE1, CONF_GCC_LINKER_OPTS_STAGE1, CONF_LD_LINKER_OPTS_STAGE1 and CONF_CPP_OPTS_STAGE1... done checking Setting up CONF_CC_OPTS_STAGE2, CONF_GCC_LINKER_OPTS_STAGE2, CONF_LD_LINKER_OPTS_STAGE2 and CONF_CPP_OPTS_STAGE2... done checking for .subsections_via_symbols... no checking for GNU non-executable stack support... yes checking for grep that handles long lines and -e... /bin/grep checking for egrep... /bin/grep -E checking for ANSI C header files... yes checking for sys/types.h... yes checking for sys/stat.h... yes checking for stdlib.h... yes checking for string.h... yes checking for memory.h... yes checking for strings.h... yes checking for inttypes.h... yes checking for stdint.h... yes checking for unistd.h... yes checking size of void *... 8 checking for ar... /usr/bin/ar checking whether /usr/bin/ar is GNU ar... yes checking for ar arguments... q checking whether ranlib is needed... no configure: creating ./config.status config.status: creating settings config.status: creating mk/config.mk config.status: creating mk/install.mk **************************************************** Configuration done, ready to 'make install' (see README and INSTALL files for more info.) **************************************************** $ sudo make install make -r --no-print-directory -f ghc.mk install BINDIST=YES NO_INCLUDE_DEPS=YES /usr/bin/install -c -m 755 -d "/usr/local/share/man" /usr/bin/install -c -m 755 -d "/usr/local/share/man/man1" /usr/bin/install -c -m 644 docs/man/ghc.1 "/usr/local/share/man/man1" "rm" -f driver/split/dist/ghc-split echo '#!/usr/bin/perl' >> driver/split/dist/ghc-split echo '$TARGETPLATFORM = "i386-unknown-linux";' >> driver/split/dist/ghc-split echo '$TABLES_NEXT_TO_CODE = "YES";' >> driver/split/dist/ghc-split cat driver/split/dist/ghc-split.prl >> driver/split/dist/ghc-split /usr/bin/install -c -m 755 -d "/usr/local/lib/ghc-7.4.1" /usr/bin/install -c -m 755 driver/split/dist/ghc-split "/usr/local/lib/ghc-7.4.1" /usr/bin/install -c -m 755 -d "/usr/local/bin" "rm" -f "/usr/local/bin/ghci-7.4.1" create () { touch "$1" && chmod 755 "$1" ; } && create "/usr/local/bin/ghci-7.4.1" echo '#!/bin/sh' >> "/usr/local/bin/ghci-7.4.1" echo 'exec "/usr/local/bin/ghc-7.4.1" --interactive ${1+"$@"}' >> "/usr/local/bin/ghci-7.4.1" chmod +x "/usr/local/bin/ghci-7.4.1" "rm" -f "/usr/local/bin/ghci" ln -s ghci-7.4.1 "/usr/local/bin/ghci" /usr/bin/install -c -m 755 -d "/usr/local/lib/ghc-7.4.1/include" /usr/bin/install -c -m 755 -d "/usr/local/lib/ghc-7.4.1/include/." && /usr/bin/install -c -m 644 includes/./*.h "/usr/local/lib/ghc-7.4.1/include/./" && /usr/bin/install -c -m 755 -d "/usr/local/lib/ghc-7.4.1/include/rts" && /usr/bin/install -c -m 644 includes/rts/*.h "/usr/local/lib/ghc-7.4.1/include/rts/" && /usr/bin/install -c -m 755 -d "/usr/local/lib/ghc-7.4.1/include/rts/prof" && /usr/bin/install -c -m 644 includes/rts/prof/*.h "/usr/local/lib/ghc-7.4.1/include/rts/prof/" && /usr/bin/install -c -m 755 -d "/usr/local/lib/ghc-7.4.1/include/rts/storage" && /usr/bin/install -c -m 644 includes/rts/storage/*.h "/usr/local/lib/ghc-7.4.1/include/rts/storage/" && /usr/bin/install -c -m 755 -d "/usr/local/lib/ghc-7.4.1/include/stg" && /usr/bin/install -c -m 644 includes/stg/*.h "/usr/local/lib/ghc-7.4.1/include/stg/" && true /usr/bin/install -c -m 644 includes/ghcautoconf.h includes/ghcplatform.h includes/dist-ghcconstants/header/GHCConstants.h includes/dist-derivedconstants/header/DerivedConstants.h "/usr/local/lib/ghc-7.4.1/include/" /usr/bin/install -c -m 755 -d "/usr/local/lib/ghc-7.4.1/include" /usr/bin/install -c -m 644 rts/dist/build/ffi.h rts/dist/build/ffitarget.h "/usr/local/lib/ghc-7.4.1/include/" /usr/bin/install -c -m 755 -d "/usr/local/bin" "rm" -f "/usr/local/bin/haddock-ghc-7.4.1" create () { touch "$1" && chmod 755 "$1" ; } && create "/usr/local/bin/haddock-ghc-7.4.1" echo '#!/bin/sh' >> "/usr/local/bin/haddock-ghc-7.4.1" echo 'exedir="/usr/local/lib/ghc-7.4.1"' >> "/usr/local/bin/haddock-ghc-7.4.1" echo 'exeprog="haddock"' >> "/usr/local/bin/haddock-ghc-7.4.1" echo 'executablename="$exedir/$exeprog"' >> "/usr/local/bin/haddock-ghc-7.4.1" echo 'datadir="/usr/local/share"' >> "/usr/local/bin/haddock-ghc-7.4.1" echo 'bindir="/usr/local/bin"' >> "/usr/local/bin/haddock-ghc-7.4.1" echo 'topdir="/usr/local/lib/ghc-7.4.1"' >> "/usr/local/bin/haddock-ghc-7.4.1" cat utils/haddock/haddock.wrapper >> "/usr/local/bin/haddock-ghc-7.4.1" chmod +x "/usr/local/bin/haddock-ghc-7.4.1" /usr/bin/install -c -m 755 -d "/usr/local/lib/ghc-7.4.1/html/" /usr/bin/install -c -m 755 -d "/usr/local/lib/ghc-7.4.1/html/Classic.theme/" /usr/bin/install -c -m 755 -d "/usr/local/lib/ghc-7.4.1/html/Ocean.std-theme/" /usr/bin/install -c -m 755 -d "/usr/local/lib/ghc-7.4.1/latex/" /usr/bin/install -c -m 644 utils/haddock/html/frames.html "/usr/local/lib/ghc-7.4.1/html/" /usr/bin/install -c -m 644 utils/haddock/html/haddock-util.js "/usr/local/lib/ghc-7.4.1/html/" /usr/bin/install -c -m 644 utils/haddock/html/Classic.theme/haskell_icon.gif "/usr/local/lib/ghc-7.4.1/html/Classic.theme/" /usr/bin/install -c -m 644 utils/haddock/html/Classic.theme/minus.gif "/usr/local/lib/ghc-7.4.1/html/Classic.theme/" /usr/bin/install -c -m 644 utils/haddock/html/Classic.theme/plus.gif "/usr/local/lib/ghc-7.4.1/html/Classic.theme/" /usr/bin/install -c -m 644 utils/haddock/html/Classic.theme/xhaddock.css "/usr/local/lib/ghc-7.4.1/html/Classic.theme/" /usr/bin/install -c -m 644 utils/haddock/html/Ocean.std-theme/hslogo-16.png "/usr/local/lib/ghc-7.4.1/html/Ocean.std-theme/" /usr/bin/install -c -m 644 utils/haddock/html/Ocean.std-theme/minus.gif "/usr/local/lib/ghc-7.4.1/html/Ocean.std-theme/" /usr/bin/install -c -m 644 utils/haddock/html/Ocean.std-theme/ocean.css "/usr/local/lib/ghc-7.4.1/html/Ocean.std-theme/" /usr/bin/install -c -m 644 utils/haddock/html/Ocean.std-theme/plus.gif "/usr/local/lib/ghc-7.4.1/html/Ocean.std-theme/" /usr/bin/install -c -m 644 utils/haddock/html/Ocean.std-theme/synopsis.png "/usr/local/lib/ghc-7.4.1/html/Ocean.std-theme/" /usr/bin/install -c -m 644 utils/haddock/latex/haddock.sty "/usr/local/lib/ghc-7.4.1/latex/" "rm" -f "/usr/local/bin/haddock" ln -s haddock-ghc-7.4.1 "/usr/local/bin/haddock" /usr/bin/install -c -m 755 -d "/usr/local/bin" "rm" -f "/usr/local/bin/hsc2hs" create () { touch "$1" && chmod 755 "$1" ; } && create "/usr/local/bin/hsc2hs" echo '#!/bin/sh' >> "/usr/local/bin/hsc2hs" echo 'exedir="/usr/local/lib/ghc-7.4.1"' >> "/usr/local/bin/hsc2hs" echo 'exeprog="hsc2hs"' >> "/usr/local/bin/hsc2hs" echo 'executablename="$exedir/$exeprog"' >> "/usr/local/bin/hsc2hs" echo 'datadir="/usr/local/share"' >> "/usr/local/bin/hsc2hs" echo 'bindir="/usr/local/bin"' >> "/usr/local/bin/hsc2hs" echo 'topdir="/usr/local/lib/ghc-7.4.1"' >> "/usr/local/bin/hsc2hs" echo 'HSC2HS_EXTRA="--cflag=-fno-stack-protector "' >> "/usr/local/bin/hsc2hs" cat utils/hsc2hs/hsc2hs.wrapper >> "/usr/local/bin/hsc2hs" chmod +x "/usr/local/bin/hsc2hs" /usr/bin/install -c -m 644 utils/hsc2hs/template-hsc.h "/usr/local/lib/ghc-7.4.1" /usr/bin/install -c -m 755 -d "/usr/local/bin" "rm" -f "/usr/local/bin/ghc-pkg-7.4.1" create () { touch "$1" && chmod 755 "$1" ; } && create "/usr/local/bin/ghc-pkg-7.4.1" echo '#!/bin/sh' >> "/usr/local/bin/ghc-pkg-7.4.1" echo 'exedir="/usr/local/lib/ghc-7.4.1"' >> "/usr/local/bin/ghc-pkg-7.4.1" echo 'exeprog="ghc-pkg"' >> "/usr/local/bin/ghc-pkg-7.4.1" echo 'executablename="$exedir/$exeprog"' >> "/usr/local/bin/ghc-pkg-7.4.1" echo 'datadir="/usr/local/share"' >> "/usr/local/bin/ghc-pkg-7.4.1" echo 'bindir="/usr/local/bin"' >> "/usr/local/bin/ghc-pkg-7.4.1" echo 'topdir="/usr/local/lib/ghc-7.4.1"' >> "/usr/local/bin/ghc-pkg-7.4.1" cat utils/ghc-pkg/ghc-pkg.wrapper >> "/usr/local/bin/ghc-pkg-7.4.1" chmod +x "/usr/local/bin/ghc-pkg-7.4.1" /usr/bin/install -c -m 755 -d "/usr/local/bin" "rm" -f "/usr/local/bin/ghc-pkg" ln -s ghc-pkg-7.4.1 "/usr/local/bin/ghc-pkg" /usr/bin/install -c -m 755 -d "/usr/local/bin" "rm" -f "/usr/local/bin/runghc" create () { touch "$1" && chmod 755 "$1" ; } && create "/usr/local/bin/runghc" echo '#!/bin/sh' >> "/usr/local/bin/runghc" echo 'exedir="/usr/local/lib/ghc-7.4.1"' >> "/usr/local/bin/runghc" echo 'exeprog="runghc"' >> "/usr/local/bin/runghc" echo 'executablename="$exedir/$exeprog"' >> "/usr/local/bin/runghc" echo 'datadir="/usr/local/share"' >> "/usr/local/bin/runghc" echo 'bindir="/usr/local/bin"' >> "/usr/local/bin/runghc" echo 'topdir="/usr/local/lib/ghc-7.4.1"' >> "/usr/local/bin/runghc" cat utils/runghc/runghc.wrapper >> "/usr/local/bin/runghc" chmod +x "/usr/local/bin/runghc" "rm" -f "/usr/local/bin/runhaskell" ln -s runghc "/usr/local/bin/runhaskell" /usr/bin/install -c -m 755 -d "/usr/local/bin" "rm" -f "/usr/local/bin/ghc-7.4.1" create () { touch "$1" && chmod 755 "$1" ; } && create "/usr/local/bin/ghc-7.4.1" echo '#!/bin/sh' >> "/usr/local/bin/ghc-7.4.1" echo 'exedir="/usr/local/lib/ghc-7.4.1"' >> "/usr/local/bin/ghc-7.4.1" echo 'exeprog="ghc-stage2"' >> "/usr/local/bin/ghc-7.4.1" echo 'executablename="$exedir/$exeprog"' >> "/usr/local/bin/ghc-7.4.1" echo 'datadir="/usr/local/share"' >> "/usr/local/bin/ghc-7.4.1" echo 'bindir="/usr/local/bin"' >> "/usr/local/bin/ghc-7.4.1" echo 'topdir="/usr/local/lib/ghc-7.4.1"' >> "/usr/local/bin/ghc-7.4.1" echo 'executablename="$exedir/ghc"' >> "/usr/local/bin/ghc-7.4.1" cat ghc/ghc.wrapper >> "/usr/local/bin/ghc-7.4.1" chmod +x "/usr/local/bin/ghc-7.4.1" "rm" -f "/usr/local/bin/ghc" ln -s ghc-7.4.1 "/usr/local/bin/ghc" /usr/bin/install -c -m 755 -d "/usr/local/lib/ghc-7.4.1" for i in driver/ghc-usage.txt driver/ghci-usage.txt rts/dist/build/libHSrts.a rts/dist/build/libHSrts_p.a rts/dist/build/libHSrts-ghc7.4.1.so rts/dist/build/libHSrts_l.a rts/dist/build/libHSrts_debug.a rts/dist/build/libHSrts_thr.a rts/dist/build/libHSrts_thr_debug.a rts/dist/build/libHSrts_thr_l.a rts/dist/build/libHSrts_thr_p.a rts/dist/build/libHSrts_debug-ghc7.4.1.so rts/dist/build/libHSrts_thr-ghc7.4.1.so rts/dist/build/libHSrts_thr_debug-ghc7.4.1.so rts/dist/build/libffi.so rts/dist/build/libffi.so.5 rts/dist/build/libffi.so.5.0.10 settings; do \ case $i in \ *.a) \ /usr/bin/install -c -m 644 $i "/usr/local/lib/ghc-7.4.1"; \ true /usr/local/lib/ghc-7.4.1/`basename $i` ;; \ *.dll) \ /usr/bin/install -c -m 644 -s $i "/usr/local/lib/ghc-7.4.1" ;; \ *.so) \ /usr/bin/install -c -m 755 $i "/usr/local/lib/ghc-7.4.1" ;; \ *.dylib) \ /usr/bin/install -c -m 755 $i "/usr/local/lib/ghc-7.4.1";; \ *) \ /usr/bin/install -c -m 644 $i "/usr/local/lib/ghc-7.4.1"; \ esac; \ done /usr/bin/gcc -E -undef -traditional -P -DINSTALLING -DLIB_DIR='"/usr/local/lib/ghc-7.4.1"' -DINCLUDE_DIR='"/usr/local/lib/ghc-7.4.1/include"' -DPAPI_INCLUDE_DIR="" -DPAPI_LIB_DIR="" -x c -Iincludes rts/package.conf.in -o rts/package.conf.install.raw grep -v '^#pragma GCC' rts/package.conf.install.raw | sed -e 's/""//g' -e 's/:[ ]*,/: /g' >rts/package.conf.install /usr/bin/install -c -m 755 -d "/usr/local/lib/ghc-7.4.1" for i in utils/haddock/dist/build/tmp/haddock utils/hsc2hs/dist-install/build/tmp/hsc2hs utils/ghc-pkg/dist-install/build/tmp/ghc-pkg utils/runghc/dist-install/build/tmp/runghc ghc/stage2/build/tmp/ghc-stage2; do \ /usr/bin/install -c -m 755 $i "/usr/local/lib/ghc-7.4.1"; \ done "mv" "/usr/local/lib/ghc-7.4.1/ghc-stage2" "/usr/local/lib/ghc-7.4.1/ghc" /usr/bin/install -c -m 755 -d "/usr/local/lib/ghc-7.4.1" "rm" -rf "/usr/local/lib/ghc-7.4.1/package.conf.d" /usr/bin/install -c -m 755 -d "/usr/local/lib/ghc-7.4.1/package.conf.d" "/usr/local/lib/ghc-7.4.1/ghc-pkg" --force --global-conf "/usr/local/lib/ghc-7.4.1/package.conf.d" update rts/package.conf.install Reading package info from "rts/package.conf.install" ... done. "utils/ghc-cabal/dist-install/build/tmp/ghc-cabal" install "/usr/local/lib/ghc-7.4.1/ghc" "/usr/local/lib/ghc-7.4.1/ghc-pkg" "strip" "/usr/local/lib/ghc-7.4.1" libraries/ghc-prim dist-install '' '/usr/local' '/usr/local/lib/ghc-7.4.1' '/usr/local/share/doc/ghc/html/libraries' NO Installing library in /usr/local/lib/ghc-7.4.1/ghc-prim-0.2.0.0 ghc-cabal: Bad interface file: dist-install/build/GHC/Classes.hi magic number mismatch: old/corrupt interface file? (wanted 33214052, got 129742) make[1]: *** [install_packages] Error 1 make: *** [install] Error 2 -- Johan

5 8

Re: memory fragmentation with ghc-7.6.1
by Ben Gamari 01 Oct '12

01 Oct '12

Simon Marlow <marlowsd(a)gmail.com> writes: > On 28/09/12 17:36, Ben Gamari wrote: >> Unfortunately, after poking around I found a few obvious problems with >> both the code and my testing configuration which explained the >> performance drop. Things seem to be back to normal now. Sorry for the >> noise! Great job on the new codegen. > > That's good to hear, thanks for letting me know! > Of course! That being said, I have run in to a bit of a performance issue which could be related to the runtime system. In particular, as I scale up in thread count (from 6 up to 48, the core count of the machine) in my program[1] (test data available), I'm seeing the total runtime increase, as well as a corresponding increase in CPU-seconds used. This despite the RTS claiming consistently high (~94%) productivity. Meanwhile Threadscope shows that nearly all of my threads are working busily with very few STM retries and no idle time. This in an application which should scale reasonably well (or so I believe). Attached below you will find a crude listing of various runtime statistics over a variety of thread counts (ranging into what should probably be regarded as the absurdly large). The application is a parallel Gibbs sampler for learning probabilistic graphical models. It involves a set of worker threads (updateWorkers) pulling work units off of a common TQueue. After grabbing a work unit, the thread will read a reference to the current global state from an IORef. It will then begin a long-running calculation, resulting in a small value (forced to normal form with deepseq) which it then communicates back to a global update thread (diffWorker) in the form of a lambda through another TQueue. The global update thread then maps the global state (the same as was read from the IORef earlier) through this lambda with atomicModifyIORef'. This is all implemented in [2]. I do understand that I'm asking a lot of the language and I have been quite impressed by how well Haskell and GHC have stood up to the challenge thusfar. That being said, the behavior I'm seeing seems a bit strange. If synchronization overhead were the culprit, I'd expect to observe STM retries or thread blocking, which I do not see (by eye it seems that STM retries occur on the order of 5/second and worker threads otherwise appear to run uninterrupted except for GC; GHC event log from a 16 thread run available here[3]). If GC were the problem, I would expect this to be manifested in the productivity, which it is clearly not. Do you have any idea what else might be causing such extreme performance degradation with higher thread counts? I would appreciate any input you would have to offer. Thanks for all of your work! Cheers, - Ben [1] https://github.com/bgamari/bayes-stack/v2 [2] https://github.com/bgamari/bayes-stack/blob/v2/BayesStack/Core/Gibbs.hs [3] http://goldnerlab.physics.umass.edu/~bgamari/RunCI.eventlog Performance of Citation Influence model on lda-handcraft data set 1115 arcs, 702 nodes, 50 items per node average 100 sweeps in blocks of 10, 200 topics Running with +RTS -A1G ghc-7.7 9c15249e082642f9c4c0113133afd78f07f1ade2 Cores User time (s) Walltime (s) CPU % Productivity ====== ============= ============= ====== ============= 2 488.66 269.41 188% 93.7% 3 533.43 195.28 281% 94.1% 4 603.92 166.94 374% 94.3% 5 622.40 138.16 466% 93.8% 6 663.73 123.00 558% 94.2% 7 713.96 114.17 647% 94.0% 8 724.66 101.98 736% 93.7% 9 802.75 100.59 826% . 10 865.05 97.69 917% . 11 966.97 99.09 1010% . 12 1238.42 114.28 1117% 13 1242.43 106.53 1206% 14 1428.59 112.48 1310% 15 1299.40 97.52 1387% 16 1559.99 108.86 1481% 17 1972.02 126.49 1604% 18 2157.03 130.91 1696% 19 1966.24 115.29 1770% . 20 2693.64 146.76 1887% . 21 3051.16 158.48 1990% . 22 4100.88 199.18 2109% 93.7% 23 4156.94 193.38 2201% 93.5% 24 4780.46 212.13 2303% 94.3% 25 5733.64 242.78 2407% . 26 7806.47 313.92 2526% . 27 6368.32 249.65 2596% . 28 8563.18 320.26 2717% -sstderr output from 2 cores: ====================================== 214,358,463,960 bytes allocated in the heap 2,261,367,592 bytes copied during GC 71,053,384 bytes maximum residency (7 sample(s)) 2,077,816 bytes maximum slop 2299 MB total memory in use (0 MB lost due to fragmentation) Tot time (elapsed) Avg pause Max pause Gen 0 100 colls, 100 par 28.58s 14.27s 0.1427s 0.3345s Gen 1 7 colls, 6 par 3.36s 1.74s 0.2486s 0.3241s Parallel GC work balance: 25.06% (serial 0%, perfect 100%) TASKS: 4 (1 bound, 3 peak workers (3 total), using -N2) SPARKS: 0 (0 converted, 0 overflowed, 0 dud, 0 GC'd, 0 fizzled) INIT time 0.03s ( 0.03s elapsed) MUT time 474.28s (252.98s elapsed) GC time 31.94s ( 16.01s elapsed) EXIT time 0.12s ( 0.12s elapsed) Total time 506.49s (269.26s elapsed) Alloc rate 451,969,681 bytes per MUT second Productivity 93.7% of total user, 176.2% of total elapsed gc_alloc_block_sync: 108391 whitehole_spin: 0 gen[0].sync: 7392 gen[1].sync: 97126 -sstderr output from 24 cores: ======================================= 262,335,150,000 bytes allocated in the heap 1,323,818,912 bytes copied during GC 67,648,048 bytes maximum residency (7 sample(s)) 2,927,176 bytes maximum slop 25172 MB total memory in use (0 MB lost due to fragmentation) Tot time (elapsed) Avg pause Max pause Gen 0 29 colls, 29 par 162.40s 6.77s 0.2335s 0.3469s Gen 1 7 colls, 6 par 118.34s 5.32s 0.7600s 1.2448s Parallel GC work balance: 5.61% (serial 0%, perfect 100%) TASKS: 27 (1 bound, 26 peak workers (26 total), using -N24) SPARKS: 0 (0 converted, 0 overflowed, 0 dud, 0 GC'd, 0 fizzled) INIT time 0.34s ( 0.34s elapsed) MUT time 4606.75s (197.59s elapsed) GC time 280.74s ( 12.09s elapsed) EXIT time 0.40s ( 0.40s elapsed) Total time 4888.61s (210.80s elapsed) Alloc rate 56,945,837 bytes per MUT second Productivity 94.3% of total user, 2185.8% of total elapsed gc_alloc_block_sync: 5397994 whitehole_spin: 0 gen[0].sync: 32282 gen[1].sync: 5072

3 2

ANNOUNCE: GHC version 7.6.1
by Ian Lynagh 30 Sep '12

30 Sep '12

============================================================= The (Interactive) Glasgow Haskell Compiler -- version 7.6.1 ============================================================= The GHC Team is pleased to announce a new major release of GHC, 7.6.1. Here are some of the highlights of the 7.6 branch since 7.4: * Polymorphic kinds and data promotion are now fully implemented and supported features. * Windows 64bit is now a supported platform. * It is now possible to defer type errors until runtime using the -fdefer-type-errors flag. * The RTS now supports changing the number of capabilities at runtime with Control.Concurrent.setNumCapabilities. Full release notes are here: http://www.haskell.org/ghc/docs/7.6.1/html/users_guide/release-7-6-1.html How to get it ~~~~~~~~~~~~~ The easy way is to go to the web page, which should be self-explanatory: http://www.haskell.org/ghc/ We supply binary builds in the native package format for many platforms, and the source distribution is available from the same place. Packages will appear as they are built - if the package for your system isn't available yet, please try again later. Background ~~~~~~~~~~ Haskell is a standard lazy functional programming language. GHC is a state-of-the-art programming suite for Haskell. Included is an optimising compiler generating good code for a variety of platforms, together with an interactive system for convenient, quick development. The distribution includes space and time profiling facilities, a large collection of libraries, and support for various language extensions, including concurrency, exceptions, and foreign language interfaces (C, whatever). GHC is distributed under a BSD-style open source license. A wide variety of Haskell related resources (tutorials, libraries, specifications, documentation, compilers, interpreters, references, contact information, links to research groups) are available from the Haskell home page (see below). On-line GHC-related resources ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Relevant URLs on the World-Wide Web: GHC home page http://www.haskell.org/ghc/ GHC developers' home page http://hackage.haskell.org/trac/ghc/ Haskell home page http://www.haskell.org/ Supported Platforms ~~~~~~~~~~~~~~~~~~~ The list of platforms we support, and the people responsible for them, is here: http://hackage.haskell.org/trac/ghc/wiki/Contributors Ports to other platforms are possible with varying degrees of difficulty. The Building Guide describes how to go about porting to a new platform: http://hackage.haskell.org/trac/ghc/wiki/Building Developers ~~~~~~~~~~ We welcome new contributors. Instructions on accessing our source code repository, and getting started with hacking on GHC, are available from the GHC's developer's site run by Trac: http://hackage.haskell.org/trac/ghc/ Mailing lists ~~~~~~~~~~~~~ We run mailing lists for GHC users and bug reports; to subscribe, use the web interfaces at http://www.haskell.org/mailman/listinfo/glasgow-haskell-users http://www.haskell.org/mailman/listinfo/glasgow-haskell-bugs There are several other haskell and ghc-related mailing lists on www.haskell.org; for the full list, see http://www.haskell.org/mailman/listinfo/ Some GHC developers hang out on #haskell on IRC, too: http://www.haskell.org/haskellwiki/IRC_channel Please report bugs using our bug tracking system. Instructions on reporting bugs can be found here: http://www.haskell.org/ghc/reportabug

12 18

Simplification of instances
by David Waern 28 Sep '12

28 Sep '12

Hi, was there a change in how GHC simplifies instances sometime between 7.4.1 and 7.6.1? Haddock used to produce this: http://hackage.haskell.org/packages/archive/kan-extensions/2.7/doc/html/Dat… but is now producing this: http://hackage.haskell.org/packages/archive/kan-extensions/3.1/doc/html/Dat… Haddock uses tcRnGetInfo to get the instances. Thanks, David

2 2

memory fragmentation with ghc-7.6.1
by John Lato 26 Sep '12

26 Sep '12

Hello, We've noticed that some applications exhibit significantly worse memory usage when compiled with ghc-7.6.1 compared to ghc-7.4, leading to out of memory errors in some cases. Running one app with +RTS -s, I see this: ghc-7.4 525,451,699,736 bytes allocated in the heap 53,404,833,048 bytes copied during GC 39,097,600 bytes maximum residency (2439 sample(s)) 1,547,040 bytes maximum slop 628 MB total memory in use (0 MB lost due to fragmentation) ghc-7.6 512,535,907,752 bytes allocated in the heap 53,327,184,712 bytes copied during GC 40,038,584 bytes maximum residency (2391 sample(s)) 1,456,472 bytes maximum slop 3414 MB total memory in use (2744 MB lost due to fragmentation) The total memory in use (consistent with 'top's output) is much higher when built with ghc-7.6, due entirely to fragmentation. I've filed a bug report (http://hackage.haskell.org/trac/ghc/ticket/7257, http://hpaste.org/74987) but I was wondering if anyone else has noticed this? I'm not entirely sure what's triggering this behavior (some applications work fine), although I suspect it has to do with allocation of pinned memory. John L.

4 5

Overloading Lists
by Achim Krause 25 Sep '12

25 Sep '12

As was mentioned in Haskell Cafe some days ago, there is some work going on on overloading lists by George Giorgidze, Jeroen Weijers and me. We are implementing two approaches in fact. The first one is using a typeclass called FromList, defined as class FromList l where type (Elem l) fromList :: [Elem l] -> l And explicit lists and arithmetic sequences get just desugared in the obvious way using this, so, for example, [1,2,3] gets desugared to (fromList [1,2,3]). The disadvantages of this (although being very easy to implement and use) is that this goes through recursive lists each time it gets used. Since explicit lists need not to be static (i.e. can contain variables), this can really matter. The second approach thus is the following (kinda motivated from the way parallel arrays are desugared): There is a class class Singleton l where type (Elem l) singleton :: Elem l -> l and now explicit lists like [1,2,3] get desugared to (singleton 1) `mappend` (singleton 2) `mappend` (singleton 3). Arithmetic sequences are simply done by providing a class "GenericEnum" containing slightly more general versions of the classical from, fromThen, fromTo, fromThenTo, and the desugaring then really is exactly the same as in the non-overloaded case. I wrote a patch for the GHC which is supposed to do this stuff. It compiles, and the typechecking and desugaring of arithmetic sequences works just fine. However, the explicit lists give me a runtime error, when used on a simple test file containing explicit list notation: Can't find interface-file declaration for variable base:Data.Monoid.mempty Probable cause: bug in .hi-boot file, or inconsistent .hi file Use -ddump-if-trace to get an idea of which file caused the error In the expression: [] In an equation for `testlist': testlist = [] At first I thought that I forgot something about adding a new module to the PrelNames module, so I did the following: I created a class Monoid2 (with functions mempty2 and mappend2) in the module GHC.Exts, because I know this module to work with wired-ins (For example, the fromList from the previous approach, the genericEnum and the singleton were also put there). The new error message became: Can't find interface-file declaration for variable base:GHC.Exts.mempty2 Probable cause: bug in .hi-boot file, or inconsistent .hi file Use -ddump-if-trace to get an idea of which file caused the error In the expression: [] In an equation for `testlist': testlist = [] I double-checked the stuff I did in PrelNames.hs. Since I was running short of Uniques (the code says that Template Hakell uses IdUniques 200-499), I started to use IdUniques from 500 on, but not for memptyName and mappendName, so I'm pretty sure that PrelNames should work the way I did it. A quick search for "Can't find interface-file" shows that the error originates from TcInterface. I assume now, that the error comes from how I typecheck ExplicitLists: tcExpr (ExplicitList _ witness exprs) res_ty = case witness of Nothing -> do { (coi, elt_ty) <- matchExpectedListTy res_ty ; exprs' <- mapM (tc_elt elt_ty) exprs ; return $ mkHsWrapCo coi (ExplicitList elt_ty Nothing exprs') } where tc_elt elt_ty expr = tcPolyExpr expr elt_ty Just (singleton, mempty, mappend) -> do { elt_ty <- newFlexiTyVarTy liftedTypeKind ; mempty' <- tcSyntaxOp OverloadedListOrigin mempty res_ty ; mappend' <- tcSyntaxOp OverloadedListOrigin mappend (mkFunTys [res_ty, res_ty] res_ty) ; singleton' <- tcSyntaxOp OverloadedListOrigin singleton (mkFunTy elt_ty res_ty) ; exprs' <- mapM (tc_elt elt_ty) exprs ; return $ ExplicitList elt_ty (Just (singleton',mempty',mappend')) exprs'} where tc_elt elt_ty expr = tcPolyExpr expr elt_ty A few remarks about that: I changed the ExplicitList constructor by adding a witness field of the type Maybe (SyntaxExpr, SyntaxExpr, SyntaxExpr). The renamer leaves this at Nothing, if the overloaded lists extension is turned off, otherwise it changes it to Just (singleton, mempty, mappend) where these are variables containing the respective names. The Nothing case in the above code is just whats done for regular lists in the original code. The Just case is supposed to do the following: If an overloaded list has type a, then the respective mempty should also have type a, and the respective mappend should have type a -> a -> a. If there are no instances with these types, then we should get an error, because overloaded lists should always be monoids, according to our desugaring rules. There should now be some element type, appearing in the type signature of singleton. Therefore we introduce a type variable elt_ty and match singleton against the function elt_ty -> res_ty, this should give the instance we need and infer the element type. Then we match all elements of the list against this type just as is done in the original code. My observations: If I interchange the mempty line with the mappend line, we get a similar error, but about mappend. If I comment both of these lines out, the error vanishes. (The last point is not that easy to check, because we need to return something, but if you replace the Just in the return thing by Nothing, everything works.) So the error has to do something with these two lines (which is not that surprising, because this is the only point where mempty should become instantiated). I also tried to interchange these lines, this did not do anything (except when the mappend line comes before the mempty line the error talks about mappend2 instead of mempty2). I do not have any ideas what to try and what could be wrong. I DID a complete clean build, so it's really about the code. The code as it is now is on github, my account is "achimkrause". If anyone wants to test it, please do not forget to patch the base and the dph repository also: base contains my changes to GHC.Exts, and in dph I had to make some imports of GHC.Exts qualified, because there are also singleton functions. Please feel free to ask questions. I would be very happy if you could help us figure this out, we are fairly sure that this is some kind of common error. Cheers, Achim

1 0