- Glasgow-haskell-users

Libffi errors while cross-compiling GHC 7.6.2 (Stage 1)
by Nikita Karetnikov 01 Mar '13

01 Mar '13

I'd like to cross-build GHC 7.6.2. I got stuck when I was trying to build a Stage 1 compiler [1]. Here's a bug report: [2,3]. I'm not sure that it's a bug; maybe I misunderstood the process. Could anyone advise? I have no experience with C. Though, I'll try to help out. [1] http://hackage.haskell.org/trac/ghc/wiki/CrossCompilation [2] http://www.haskell.org/pipermail/ghc-tickets/2013-February/001240.html [3] http://hackage.haskell.org/trac/ghc/ticket/7717

1 0

Race-condition in alternative 'System.Timeout.timeout' implementation
by Herbert Valerio Riedel 27 Feb '13

27 Feb '13

Hello *, I've been experimenting with an alternative implementation of 'System.Timeout.timeout'[1] which avoids the overhead of spawning a new thread for each invocation. Part of my motivation is to see if I can implement a faster version of threadWaitReadTimeout :: Int -> Fd -> IO Bool threadWaitReadTimeout to = liftM (maybe False (const True)) . timeout to . threadWaitRead and thus exploit GHC's event notification system instead of having to reimplement a timeout-manager myself (like popular HTTP server libraries such as Snap or Warp do currently). The following Haskell program shows a proof-of-concept implementation derived directly from 'System.Timeout.timeout' together with a Criterion benchmark comparing the performance between the original and the alternative 'timeout' function wrapping a 'readMVar' call. On a i7-3770 with GHC-7.6.2/Linux/64bit ran with "+RTS -A4m -N4", the benchmark shows a 15x improvement for the new implementation (below 1 uS) compared to the original implementation (~13 uS): ,---- | benchmarking id | mean: 22.60933 ns, lb 22.50331 ns, ub 22.73515 ns, ci 0.950 | std dev: 591.0383 ps, lb 509.6189 ps, ub 663.2670 ps, ci 0.950 | found 17 outliers among 100 samples (17.0%) | 17 (17.0%) high mild | variance introduced by outliers: 19.992% | variance is moderately inflated by outliers | | benchmarking timeout_1ms | mean: 13.79584 us, lb 13.62939 us, ub 13.92814 us, ci 0.950 | std dev: 756.3080 ns, lb 524.7628 ns, ub 1.068547 us, ci 0.950 | found 14 outliers among 100 samples (14.0%) | 4 (4.0%) low severe | 5 (5.0%) high mild | 5 (5.0%) high severe | variance introduced by outliers: 52.484% | variance is severely inflated by outliers | | benchmarking timeout2_1ms | mean: 879.8152 ns, lb 874.5223 ns, ub 885.9759 ns, ci 0.950 | std dev: 29.31963 ns, lb 25.65941 ns, ub 32.98116 ns, ci 0.950 | found 9 outliers among 100 samples (9.0%) | 9 (9.0%) high mild | variance introduced by outliers: 28.734% | variance is moderately inflated by outliers | ... `---- Alas there's a race-condition hidden somewhere I'm struggling with; When the timeout is set low enough, the internal 'Timeout2' exceptions leaks outside the 'timeout2' wrapper: ,---- | ... | benchmarking timeout2_10us | newtimeout: <<timeout2>> `---- I've tried rewriting the code but couldn't figure out a way to keep the exception from escaping 'timeout2'. Does the race-condition actually lie in the 'timeout2' implementation -- and if so, is it possible to rewrite 'timeout2' to solve it? [1]: http://hackage.haskell.org/packages/archive/base/latest/doc/html/System-Tim… cheers, hvr

5 7

Re: Race-condition in alternative 'System.Timeout.timeout' implementation
by Akio Takano 25 Feb '13

25 Feb '13

I accidentally replied to Herbert privately. I'm forwarding the message to the list. - Takano Akio ---------- Forwarded message ---------- From: Akio Takano <tkn.akio(a)gmail.com> Date: Mon, Feb 25, 2013 at 6:15 PM Subject: Re: Race-condition in alternative 'System.Timeout.timeout' implementation To: Herbert Valerio Riedel <hvr(a)gnu.org> Hi, I think the problem is that E.unregisterTimeout doesn't guarantee that no timeout will be delivered after it returns. This allows an execution sequence like: 0. Thread A calls timeout2 1. Thread A registers a callback to the event manager 2. Thread A unregisters the callback 3. Thread A exits from the handleJust 4. The callback is triggered, killing thread A If I understand correctly this can be worked around with an extra mutex in timeout2. I'll attach my implementation. It's called timeout3 and is a bit slower than timeout2, but I haven't seen a leaking exception with it. On Mon, Feb 25, 2013 at 7:31 AM, Herbert Valerio Riedel <hvr(a)gnu.org> wrote: > Hello *, > > I've been experimenting with an alternative implementation of > 'System.Timeout.timeout'[1] which avoids the overhead of spawning a new > thread for each invocation. > > Part of my motivation is to see if I can implement a faster version of > > threadWaitReadTimeout :: Int -> Fd -> IO Bool > threadWaitReadTimeout to = liftM (maybe False (const True)) > . timeout to . threadWaitRead > > and thus exploit GHC's event notification system instead of having to > reimplement a timeout-manager myself (like popular HTTP server libraries > such as Snap or Warp do currently). > > > The following Haskell program shows a proof-of-concept implementation > derived directly from 'System.Timeout.timeout' together with a Criterion > benchmark comparing the performance between the original and the > alternative 'timeout' function wrapping a 'readMVar' call. > > > > On a i7-3770 with GHC-7.6.2/Linux/64bit ran with "+RTS -A4m -N4", the > benchmark shows a 15x improvement for the new implementation (below 1 > uS) compared to the original implementation (~13 uS): > > ,---- > | benchmarking id > | mean: 22.60933 ns, lb 22.50331 ns, ub 22.73515 ns, ci 0.950 > | std dev: 591.0383 ps, lb 509.6189 ps, ub 663.2670 ps, ci 0.950 > | found 17 outliers among 100 samples (17.0%) > | 17 (17.0%) high mild > | variance introduced by outliers: 19.992% > | variance is moderately inflated by outliers > | > | benchmarking timeout_1ms > | mean: 13.79584 us, lb 13.62939 us, ub 13.92814 us, ci 0.950 > | std dev: 756.3080 ns, lb 524.7628 ns, ub 1.068547 us, ci 0.950 > | found 14 outliers among 100 samples (14.0%) > | 4 (4.0%) low severe > | 5 (5.0%) high mild > | 5 (5.0%) high severe > | variance introduced by outliers: 52.484% > | variance is severely inflated by outliers > | > | benchmarking timeout2_1ms > | mean: 879.8152 ns, lb 874.5223 ns, ub 885.9759 ns, ci 0.950 > | std dev: 29.31963 ns, lb 25.65941 ns, ub 32.98116 ns, ci 0.950 > | found 9 outliers among 100 samples (9.0%) > | 9 (9.0%) high mild > | variance introduced by outliers: 28.734% > | variance is moderately inflated by outliers > | ... > `---- > > Alas there's a race-condition hidden somewhere I'm struggling with; When > the timeout is set low enough, the internal 'Timeout2' exceptions leaks > outside the 'timeout2' wrapper: > > ,---- > | ... > | benchmarking timeout2_10us > | newtimeout: <<timeout2>> > `---- > > I've tried rewriting the code but couldn't figure out a way to keep the > exception from escaping 'timeout2'. Does the race-condition actually lie > in the 'timeout2' implementation -- and if so, is it possible to rewrite > 'timeout2' to solve it? > > > [1]: http://hackage.haskell.org/packages/archive/base/latest/doc/html/System-Tim… > > cheers, > hvr > > _______________________________________________ > Glasgow-haskell-users mailing list > Glasgow-haskell-users(a)haskell.org > http://www.haskell.org/mailman/listinfo/glasgow-haskell-users >

1 0

online docs for GHC head seem to be stale
by Carter Schonwald 24 Feb '13

24 Feb '13

Hey All, I've been looking around in the documentation online for the current ghc head, and it looks to lack any information on the new SIMD ops. then i noticed the time stamp: http://www.haskell.org/ghc/dist/current/docs/html/libraries/ so those docs are from December? Whats needed to be done to bring those to be more up to date?

1 0

Quasi quoting and global names (for haskell-src-exts-qq)
by L Corbijn 18 Feb '13

18 Feb '13

Hello, In the haskell-src-exts quasi quoter there is some code to convert all names in `dataToQa` to global names. The reasoning is according to the source: -- | The generic functions in 'Language.Haskell.TH.Quote' don't use global -- names for syntax constructors. This has the unfortunate effect of breaking -- quotation when the haskell-src-exts syntax module is imported qualified. -- The solution is to set the flavour of all names to 'NameG'. qualify :: Name -> Name -- Need special cases for constructors used in string literals. Assume nearly -- all else is a datatype defined in Syntax module of haskell-src-exts. qualify n | ":" <- nameBase n = '(:) {- snip: quite some excluded constructors -} | otherwise = Name (mkOccName (nameBase n)) flavour {- snip: some code for the flavour -} For the full source code see [1]. When fixing the pattern quasi quoter this qualification caused a long error (when using the quasi quoter). So in a simple attempt to fix it I replaced `qualify` with `id` and it all worked. Now assuming that the qualification code was needed for some past version of GHC I would like to make the implementation dependent on the version of GHC. The only problem is that I haven't found the right version of GHC where this behaviour changed. Does somebody know at what version it was needed? Greetings, Lars Corbijn [1] http://hackage.haskell.org/package/haskell-src-exts-qq-0.6.1

2 1

Building the GHC library without building GHC
by C Rodrigues 15 Feb '13

15 Feb '13

Hi, I was going to do some hacking on Haddock. Haddock depends on the GHC API from the development version of GHC, however, stage2 crashes on my system when I try to build the newest GHC from the repository. Since I don't actually need to compile with the new GHC, I'm hoping there's a workaround. Is there a way to build only the GHC library so that I can get back to Haddock?

2 1

How to compile ghc 7.6.2 with llvm?
by Magicloud Magiclouds 12 Feb '13

12 Feb '13

Hi, I am using Linuxmint Nadia with clang and llvm-3.0 installed. Then I `mv build.mk.sample build.mk`, set "BuildFlavour = perf-llvm", add "GhcWithLlvmCodeGen = YES". Finally `./configure --with-gcc=/usr/bin/llvm-gcc`. Configure output attached. After make, I tried `inplace/bin/ghc-stage2 –info`, it is still using native code generator. What should I do? config.log<https://docs.google.com/file/d/0BzTVWOyY2ZO4SXRqdnUzdE5WREk/edit> -- 竹密岂妨流水过山高哪阻野云飞 And for G+, please use magiclouds#gmail.com.

3 6

I cannot compile ghc-7.6.2
by Magicloud Magiclouds 12 Feb '13

12 Feb '13

Hi, Linuxmint Nadia, ghc-7.6.1 was built and running OK. Just downloaded ghc-7.6.2, without changing anything and environment, and boot and configure returned OK, I got these. What happened? 20130210Sun183147magicloud(a)ctu-9986008283~/s/ghc-7.6.2 $ make + test -f mk/config.mk.old + cp -p mk/config.mk mk/config.mk.old touch -r mk/config.mk.old mk/config.mk + test -f mk/project.mk.old + cp -p mk/project.mk mk/project.mk.old touch -r mk/project.mk.old mk/project.mk + test -f compiler/ghc.cabal.old + cp -p compiler/ghc.cabal compiler/ghc.cabal.old touch -r compiler/ghc.cabal.old compiler/ghc.cabal ===--- building phase 0 make -r --no-print-directory -f ghc.mk phase=0 phase_0_builds libraries/hpc/ghc.mk:3: libraries/hpc/dist-boot/package-data.mk: No such file or directory libraries/Cabal/Cabal/ghc.mk:3: libraries/Cabal/Cabal/dist-boot/ package-data.mk: No such file or directory libraries/binary/ghc.mk:3: libraries/binary/dist-boot/package-data.mk: No such file or directory libraries/bin-package-db/ghc.mk:3: libraries/bin-package-db/dist-boot/ package-data.mk: No such file or directory libraries/hoopl/ghc.mk:3: libraries/hoopl/dist-boot/package-data.mk: No such file or directory compiler/ghc.mk:450: compiler/stage1/package-data.mk: No such file or directory utils/hsc2hs/ghc.mk:14: utils/hsc2hs/dist/package-data.mk: No such file or directory ghc/ghc.mk:106: ghc/stage1/package-data.mk: No such file or directory mkdir inplace mkdir inplace/bin "rm" -f utils/ghc-pkg/Version.hs mkdir inplace/lib echo "module Version where" >> utils/ghc-pkg/Version.hs "rm" -f inplace/bin/mkdirhier echo "version, targetOS, targetARCH :: String" >> utils/ghc-pkg/Version.hs echo "version = \"7.6.2\"" >> utils/ghc-pkg/Version.hs echo '#!/bin/sh' >> inplace/bin/mkdirhier echo "targetOS = \"linux\"" >> utils/ghc-pkg/Version.hs cat utils/mkdirhier/mkdirhier.sh >> inplace/bin/mkdirhier echo "targetARCH = \"x86_64\"" >> utils/ghc-pkg/Version.hs chmod +x inplace/bin/mkdirhier "inplace/bin/mkdirhier" utils/ghc-cabal/dist/build/tmp//. "inplace/bin/mkdirhier" bootstrapping/. "inplace/bin/mkdirhier" inplace/bin//. "inplace/bin/mkdirhier" compiler/stage1/build//. "inplace/bin/mkdirhier" utils/ghc-pkg/dist/build/tmp//. "inplace/bin/mkdirhier" inplace/lib/package.conf.d/. "/usr/local/bin/ghc" -H32m -O --make utils/ghc-cabal/Main.hs -o utils/ghc-cabal/dist/build/tmp/ghc-cabal \ -no-user-package-db \ -Wall \ -DCABAL_VERSION=1,16,0 \ -odir bootstrapping \ -hidir bootstrapping \ -ilibraries/Cabal/Cabal \ -ilibraries/filepath \ -ilibraries/hpc \ "rm" -f compiler/stage1/build/Config.hs Creating compiler/stage1/build/Config.hs ... done. libraries/Cabal/Cabal/Distribution/ParseUtils.hs:88:18: Could not find module `Data.Map' It is a member of the hidden package `containers-0.5.0.0'. Use -v to see a list of the files searched for. make[1]: *** [utils/ghc-cabal/dist/build/tmp/ghc-cabal] Error 1 make: *** [all] Error 2 -- 竹密岂妨流水过山高哪阻野云飞 And for G+, please use magiclouds#gmail.com.

2 2

RE: GHC 7.8 release?
by Simon Peyton-Jones 10 Feb '13

10 Feb '13

It’s fairly simple in my mind. There are two “channels” (if I understand Mark’s terminology right): · Haskell Platform: o A stable development environment, lots of libraries known to work o Newcomers, and people who value stability, should use the Haskell Platform o HP comes with a particular version of GHC, probably not the hottest new one, but that doesn’t matter. It works. · GHC home page downloads: o More features but not so stable o Libraries not guaranteed to work o Worth releasing, though, as a forcing function to fix bugs, and as a checkpoint for people to test, so that by the time the HP adopts a particular version it is reasonably solid. So we already have the two channels Mark asks for, don’t we? One is called the Haskell Platform and one is called the GHC home page. That leaves a PR issue: we really don’t want newcomers or Joe Users wanting the “new shiny”. They want the Haskell Platform, and as Mark says those users should not pay the slightest attention until it appears in the Haskell Platform. So perhaps we principally need a way to point people away from GHC and towards HP? eg We could prominently say at every download point “Stop! Are you sure you want this? You might be better off with the Haskell Platform! Here’s why...”. Have I understood aright? If so, how could we achieve the right social dynamics? Our goal is to let people who value stability get stability, while the hot-shots race along in a different channel and pay the price of flat tires etc. PS: absolutely right to use 7.6.2 for the next HP. Don’t even think about 7.8. Simon From: Mark Lentczner [mailto:mark.lentczner@gmail.com] Sent: 07 February 2013 17:43 To: Simon Peyton-Jones Cc: andreas.voellmy(a)gmail.com; Carter Schonwald; GHC users; Simon Marlow; parallel-haskell; kostirya(a)gmail.com; Edsko de Vries; ghc-devs(a)haskell.org Subject: Re: GHC 7.8 release? I'd say the window for 7.8 in the platform is about closed. If 7.8 were to be release in the next two weeks that would be just about the least amount of time I'd want to see for libraries in the platform to get all stable with the GHC version. And we'd also be counting on the GHC team to be quickly responding to bugs so that there could be a point release of 7.8 mid-April. Historically, none of that seems likely. So my current trajectory is to base HP 2013.2.0.0 on GHC 7.6.2. Since 7.8 will seems like it will be released before May, we will be faced again with the bad public relations issue: Everyone will want the new shiny and be confused as to why the platform is such a laggard. We'll see four reactions: * New comers who are starting out and figure they should use the latest... Many will try to use 7.8, half the libraries on hackage won't work, things will be wonky, and they'll have a poor experience. * People doing production / project work will stay on 7.6 and ignore 7.8 for a few months. * The small group of people exploring the frontiers will know how to get things set up and be happy. * Eventually library authors will get around to making sure their stuff will work with it. I wish GHC would radically change it's release process. Things like 7.8 shouldn't be release as "7.8". That sounds major and stable. The web site will have 7.8 at the top. The warning to use the platform will fall flat because it makes the platform look out of date. Really, "7.8" should be in a different release channel, not on the front page. It should bake in that channel for six months - where only the third group of people will use it, until it is getting close to merge into main, at which point the fourth group will start to use it, so that the day it hits main, all the libraries just work. Ideally, the first two groups of people will not pay the slightest attention to it until it is further baked. While we achievements of the GHC team are great, less than half of those 7.8 features seem interesting from the viewpoint of the aims of the platform. I don't think adding syntactic or type-level features are really all that important for Haskell at this juncture. And while I do like to see improvements in generated code and run-time performance, I think even those are less important than making crucial ecosystem improvements to things like package management, cross-compilation, and libraries. - Mark

15 25

Re: GHC 7.8 release?
by Ian Lynagh 08 Feb '13

08 Feb '13

On Thu, Feb 07, 2013 at 09:42:39AM -0800, Mark Lentczner wrote: > > I wish GHC would radically change it's release process. Things like 7.8 > shouldn't be release as "7.8". That sounds major and stable. The web site > will have 7.8 at the top. The warning to use the platform will fall flat > because it makes the platform look out of date. Really, "7.8" should be in > a different release channel, not on the front page. It should bake in that > channel for six months - where only the third group of people will use it, > until it is getting close to merge into main, at which point the fourth > group will start to use it, so that the day it hits main, all the libraries > just work. Ideally, the first two groups of people will not pay the > slightest attention to it until it is further baked. It's a catch-22: We don't want people to use a new release until all the bugs have been found and fixed, and all the libraries have been updated. But if people don't use it, then the bugs won't be found and the libraries won't be updated. I think you're saying that you'd like the uptake of new GHC versions to be slower, which would mean fewer people would be using 7.6 now, but in the last few days I've seen the Debian guys have had to send mails to maintainers telling them that their packages don't work with 7.6: http://lists.debian.org/debian-haskell/2013/02/threads.html despite 7.6 having been out for 5 months and about to enter the HP. Perhaps more automatic Hackage building, with a group of people looking at the logs of failing packages and acting appropriately, is the way forward. Some cases (such as "installation failed due to dependencies not being installable") you'd want to be handled automatically. Thanks Ian

2 1