- Haskell-Cafe - Haskell.org

Parallel combinator, performance advice
by Neil Mitchell 08 Apr '09

08 Apr '09

Hi, I've written a parallel_ function, code attached. I'm looking for criticism, suggestions etc on how to improve the performance and fairness of this parallel construct. (If it turns out this construct is already in a library somewhere, I'd be interested in that too!) The problem I'm trying to solve is running system commands in parallel. Importantly (unlike other Haskell parallel stuff) I'm not expecting computationally heavy Haskell to be running in the threads, and only want a maximum of n commands to fire at a time. The way I'm trying to implement this is with a parallel_ function: parallel_ :: [IO a] -> IO () The semantics are that after parallel_ returns each action will have been executed exactly once. The implementation (attached) creates a thread pool of numCapabililties-1 threads, each of which reads from a task pool and attempts to do some useful work. I use an idempotent function to ensure that all work is done at most one, and a sequence_ to ensure all work is done at least once. Running a benchmark of issuing 1 million trivial tasks (create, modify, read and IO ref) the version without any parallelism is really fast (< 0.1 sec), and the version with parallelism is slow (> 10 sec). This could be entirely due to space leaks etc when queueing many tasks. I'm useful for any thoughts people might have! Thanks in advance, Neil

5 25

Monad transformer to consume a list
by Stephan Friedrichs 08 Apr '09

08 Apr '09

Hello, is there a monad transformer to consume an input list? I've got external events "streaming into the monad" that are consumed on demand and I'm not sure if there's something better than a StateT. //Stephan -- Früher hieß es ja: Ich denke, also bin ich. Heute weiß man: Es geht auch so. - Dieter Nuhr

4 8

How to cut a file effciently?
by Magicloud Magiclouds 08 Apr '09

08 Apr '09

Hi, Let us say I have a text file of a million lines, and I want to cut it into smaller (10K lines) ones. How to do this? I have tried a few ways, none I think is lazy (I mean not reading the file all at the start). -- 竹密岂妨流水过山高哪阻野云飞

3 2

Painful Data Abstraction
by Brad Larsen 08 Apr '09

08 Apr '09

I asked this earlier on #haskell, but it was quiet hour. Here goes. Suppose I have an abstract data type for prefix dictionaries of bytestrings. I define a typeclass in a module PrefixDict.Class: module PrefixDict.Class where import qualified Data.ByteString.Char8 as B type Word = B.ByteString class PrefixDict d where empty :: d isEmpty :: d -> Bool insert :: Word -> d -> d delete :: d -> Word -> d hasWord :: d -> Word -> Bool hasPrefix :: d -> Word -> Bool I then write several implementations, including a naive list implementation, and a trie implementation, in the modules PrefixDict.ListDict and PrefixDict.TrieDict, both looking something like this: module PrefixDict.ListDict where import PrefixDict.Class data ListDict = ListDict [Word] instance PrefixDict ListDict where ... Now, there are many properties that should be satisfied by any implementation of PrefixDict, that are not easily captured in the type system. Trying to be a good coder, I write up some generic QuickCheck properties, such as prop_insert_idempotent :: (Eq d, PrefixDict d) => d -> Word -> Bool prop_insert_idempotent d w = insert w d' == d' where d' = insert w d The problem is this: I can't think of a non-kludged way of checking that TrieDict and ListDict satisfy this abstract property without having to add explicit type signatures, e.g. quickCheck (prop_insert_idempotent :: TrieDict -> Word -> Bool) I have many abstract properties, and I *really* don't like having to put an explicit signature on each one. I came up with a hackishway that minimizes the number of signatures required, by checking all abstract properties in one, generic function, reflecting a type as a value, and using scoped type variables: testAbstractProperties :: forall d. (PrefixDict d) => d -> IO () testAbstractProperties _ = do quickCheck (prop_insert_idempotent :: d -> Word -> Bool) quickCheck (prop_delete_works :: d -> Word -> Property) ... I then call this function from a "test suite" function written for each module, e.g. testTrieDict :: IO () testTrieDict = do testAbstractProperties (undefined :: TrieDict) testTrieDictSpecificProperties This means I only have to write the type signatures on the properties in one place, but it is still less than ideal. Is there a better way of doing this, or is Haskell simply not good at this kind of data abstraction? Best, Brad Larsen

2 1

cabal on mac os x (gmp problem)
by brian 08 Apr '09

08 Apr '09

For future reference: Solved, I just created a symlink to libgmp.dylib in /usr/local, and the zlib package was able to build.

1 0

Generating arbitrary function in QuickCheck
by Yusaku Hashimoto 08 Apr '09

08 Apr '09

Hi, today, I want to ask about QuickCheck. I have known recently that arbitrary works on functions as well. I played on this for a while, and met a strange behavior. I tried to write property for sortBy. import Test.QuickCheck import Data.List instance Show (a -> b) where show _ = "<<function>>" instance Arbitrary Ordering where arbitrary = elements [LT,EQ,GT] mySortBy :: (Ord a) => (a -> a -> Ordering) -> [a] -> [a] mySortBy = sortBy prop_mysortby_sorted :: (Int -> Int -> Ordering) -> [Int] -> Property prop_mysortby_sorted cmp ls = null ls `trivial` all eq_or_lt (zipWith cmp sorted (tail sorted)) where sorted = mySortBy cmp ls eq_or_lt ord = ord == EQ || ord == LT I had thought Arbitrary instance for Ord and property for sortBy both fine. But checking fails: ghci> quickCheck prop_mysortby_sorted Falsifiable, after 2 tests: <<function>> [2,3] I guess arbitrary for (Int -> Int -> Ordering) generates a non-sense function like this: -- let (arb_compare :: Int -> Int -> Ordering) generated function. arb_compare 0 1 = GT arb_compare 1 0 = GT arb_compare _ _ = EQ Then, I want to ask two questions. 1. Is my guessing in function generated by arbitrary right? 2. If so, How do I generate right function? Thanks, Yusaku Hashimoto

4 5

ANN: HCard -- A library for implementing card-like structures.
by Joe Fredette 08 Apr '09

08 Apr '09

HCard, is a library which supports a card-like data structures, it uses associated types [1] to provide shuffling, dealing, and other facilities. It's general enough to support many different types of playing cards, it currently comes with the common "French Deck" (4-suit, 13 card deck that is very common in the US) implemented and an example (though untested) cribbage scoring application. You can find HCard here [2,3], and a post about it's use of associated types here [1]. On another note, I can't think of a good reason I should be using associated types, as I explain in [1]. Well, no good reason other than the "cool factor" -- can anyone enlighten me on a possible practical benefit of using Assoc types as opposed to a simple indexed record? Anyway, enjoy HCard! /Joe Fredette [1] http://lowlymath.net/2009/card-games-scorekeeping-and-associated-datatypes/ [2] darcs get http://patch-tag.com/publicrepos/HCard [3] http://hackage.haskell.org/cgi-bin/hackage-scripts/package/HCard

1 0

ghci/i386/dragonfly: unhandled ELF relocation(Rel) type 15
by G.Isenmann 07 Apr '09

07 Apr '09

Hi, I am trying to get a useable ghc on i386 dragonfly2.2.0. My current problem: $ /var/tmp/ghc-6.10.2/bin/ghci GHCi, version 6.10.2: http://www.haskell.org/ghc/ :? for help Loading package ghc-prim ... linking ... done. Loading package integer ... linking ... done. ghc: /var/tmp/ghc-6.10.2/lib/ghc-6.10.2/base-4.1.0.0/HSbase-4.1.0.0.o: unhandled ELF relocation(Rel) type 15 Loading package base ... linking ... ghc: unable to load package `base' Looks like HSbase-4.1.0.0.o uses three different relocation types $ objdump -r lib/ghc-6.10.2/base-4.1.0.0/HSbase-4.1.0.0.o \ | awk '{print $2}' | sort -u | grep R_ R_386_32 R_386_PC32 R_386_TLS_IE but the ghc rts/Linker.c only supports two $ grep R_386_ rts/Linker.c # define R_386_32 RELOC_32 # define R_386_PC32 RELOC_PC32 case R_386_32: *pP = value; break; case R_386_PC32: *pP = value - P; break; The third seems to be the access to thread local errno $ objdump -r lib/ghc-6.10.2/base-4.1.0.0/HSbase-4.1.0.0.o \ | grep R_386_TLS_IE 001c2682 R_386_TLS_IE errno 001c2b5b R_386_TLS_IE errno 001c2f36 R_386_TLS_IE errno The difference to linux and freebsd seems to be that the access to the errno location is not hidden inside dragonflys libc but is visible for the caller similar to $ cat t.c static __thread int tls; int *get() { return &tls; } $ gcc -c t.c $ objdump -r t.o t.o: file format elf32-i386 RELOCATION RECORDS FOR [.text]: OFFSET TYPE VALUE 0000000b R_386_TLS_LE tls What would be the best or easiest way to deal with this situation? -- Goetz

1 0

strange performance issue with takusen 0.8.3
by Marko Schütz 07 Apr '09

07 Apr '09

Dear All, I have an application where some simple data extracted from some source files is inserted into a PostgreSQL database. The application uses Takusen and is compiled with GHC 6.8.3. Some (59 in the test data) of the selects take on average 460ms each for a total time for this sample run of 30s. I prepare one select statement at the beginning of the run into which I then bind the specific values for every one of the selects. It does not seem to make a difference whether I do this or whether I just use a new statement for every select. For comparison, I have collected the SQL statements in a file with PREPARE ... and DEALLOCATE for _every_ select and then run this file through psql. This takes 2s! During the run of the GHC-compiled executable the cpu load goes up. In top I see %CPU of above 72%. Any ideas that might enlighten are welcome. Best regards, Marko

2 2

Re: Configuring cabal dependencies at install-time
by John Lato 07 Apr '09

07 Apr '09

> From: Jeff Heard <jefferson.r.heard(a)gmail.com> > > Is there a way to do something like autoconf and configure > dependencies at install time? Building buster, I keep adding > dependencies and I'd like to keep that down to a minimum without the > annoyance of littering Hackage with dozens of packages. For instance, > today I developed an HTTP behaviour and that of course requires > network and http, which were previously not required. I'm about to > put together a haxr XML-RPC behaviour as well, and that of course > would add that much more to the dependency list. HaXml, haxr, and > haxr-th most likely. > > so... any way to do that short of making a bunch of separate packages > with one or two modules apiece? Otherwise I'm thinking of breaking > things up into buster, buster-ui, buster-network, buster-console, and > buster-graphics to start and adding more as I continue along. > I'd be interested in hearing answers to this as well. I'm not a fan of configure-style compile-time conditional compilation, at least for libraries. It makes it much harder to specify dependencies. With this, if package Foo depends on buster and the HTTP behavior, it's no longer enough to specify "build-depends: buster" because that will only work if buster was configured properly on any given system. I think that the proper solution is to break up libraries into separate packages as Jeff suggests (buster, buster-ui, etc.), but then the total packages on hackage would explode. I don't feel great about doing that with my own packages either; is it a problem? If so, maybe there could be just one extra package, e.g. buster and buster-extras. Is there a better solution I'm missing? John Lato

5 6