- Glasgow-haskell-users

Re: [Haskell-cafe] Strange memory consumption problems in something that should be tail-recursive
by Kirsten Chevalier 13 Feb '07

13 Feb '07

[redirecting to ghc-users since this is a GHC question] On 2/13/07, Jefferson Heard <jeff(a)renci.org> wrote: > Hi, I am running the following code against a 210 MB file in an attempt to > determine whether I should use alex or whether, since my needs are very > performance oriented, I should write a lexer of my own. I thought that > everything I'd written here was tail-recursive, but after compiling this with > GHC 2.4.6, and running it, I eat up 2GB of RAM in less than a second. So > far, I have tried token and character oriented Parsec parsers and alex and > alex is winning by a factor of 2. I would like to be able to tokenize the > entirety of a 1TB collection in less than 36 hours on my current machine, > which is where alex has gotten me so far. Thanks in advance! > > -- Jeff > > --- > > module Main > where > > > import qualified FileReader > import qualified Data.Set as Set > > punct = foldl (flip Set.insert) Set.empty "<,>.?/:;\"'{[}]|\\_-+=) > (*&^%$##@!~`" > > stripTagOrComment [] = [] > stripTagOrComment ('>':rest) = rest > stripTagOrCOmment (c:rest) = stripTagOrComment rest > > pass1 :: String -> String -> String > pass1 left [] = left > pass1 left ('<':right) = pass1 left (stripTagOrComment right) > pass1 left (' ':right) = pass1 left right > pass1 left (c:right) > | Set.member c punct = pass1 (' ':c:' ':left) right > | otherwise = pass1 (c:left) right > > > pass2 :: [String] -> String -> Char -> String -> [String] > pass2 left word ' ' [] = word:left > pass2 left word c [] = (c:word):left > pass2 left word ' ' (' ':right) = pass2 left word ' ' right > pass2 left word ' ' (c:right) = pass2 (word:left) "" c right > pass2 left word l (c:right) = pass2 left (l:word) c right > > tokenize = (pass2 [] "" ' ') . (pass1 []) > > main = do > file <- do FileReader.trecReadFile "trecfile" > print (tokenize (head (tail file))) > > > -- print (length (map (runParser tokenizeDoc [] "") file)) Have you tried profiling? (see section 5 of the GHC manual.) What's your GHC command line? Tail-recursion in Haskell doesn't always work the way you'd expect, but without profiling it's pretty hard to tell what the problem is. Cheers, Kirsten -- Kirsten Chevalier* chevalier(a)alum.wellesley.edu *Often in error, never in doubt "Relax. I'm weird, not violent."--Brad Boesen, _Disturbed_

1 0

Re: [Haskell] Problem compiling happy 1.15
by Kirsten Chevalier 13 Feb '07

13 Feb '07

[redirecting to ghc-users] On 2/13/07, Rob Hoelz <hoelz(a)wisc.edu> wrote: > I downloaded the source for happy 1.15, and when I run make, this pops > up: > > /usr/bin/ghc -H16m -O -cpp -fglasgow-exts -O -c LALR.lhs -o LALR.o > -ohi LALR.hi > > LALR.lhs:626:34: Not in scope: `bounds' > make[3]: *** [LALR.o] Error 1 > make[2]: *** [all] Error 2 > make[1]: *** [all] Error 1 > make[1]: Leaving directory `/home/rob/downloads/happy-1.15/happy' > make: *** [/home/rob/downloads/happy-1.15/happy/src/happy-inplace] > Error 2 > > After erasing hiding (bounds) in these lines: > > import Data.Array hiding (bounds) > import Array hiding (bounds) > > it does some more work, then this error pops up: > > /usr/bin/ghc -H16m -O -cpp -fglasgow-exts -O -c ProduceCode.lhs -o > ProduceCode.o -ohi ProduceCode.hi > > ProduceCode.lhs:31:20: Not in scope: `Data.Array.MArray.indices' > make[3]: *** [ProduceCode.o] Error 1 > make[2]: *** [all] Error 2 > make[1]: *** [all] Error 1 > make[1]: Leaving directory `/home/rob/downloads/happy-1.15/happy' > make: *** [/home/rob/downloads/happy-1.15/happy/src/happy-inplace] > Error 2 > > Is my configuration messed up or something? > What version of ghc are you using? (/usr/bin/ghc --version) Cheers, Kirsten -- Kirsten Chevalier* chevalier(a)alum.wellesley.edu *Often in error, never in doubt "I don't care too much for money/Money can't buy me TeX." -- Jason Reed

1 0

Re: [Haskell-cafe] External Core
by Kirsten Chevalier 09 Feb '07

09 Feb '07

On 2/6/07, Ricky Barefield <aca03rdb(a)sheffield.ac.uk> wrote: > > I've tried running Happy on these files but get the error `Not enough type arguments for the type synonym "P"' when I try to run the resultant Parser.hs in Hugs and similar errors when run in GHC. > > > > What I'm trying to achieve is to read the hcr files into a Haskell data type which I could work with, if anyone could give me any help with using the files for manipulating Core I would be very grateful. > External Core isn't currently working correctly in the HEAD. Aaron Tomb was working on this, I know (as per mailing lists posts on cvs-ghc from November and December), but I don't know if he still is. glasgow-haskell-users is a better place to discuss this. Your best bet if you want to be able to use External Core may be to fix it yourself. I know that's what I had to do! But, people on glasgow-haskell-users and cvs-ghc will probably be happy to discuss it with you. Cheers, Kirsten -- Kirsten Chevalier* chevalier(a)alum.wellesley.edu *Often in error, never in doubt "I saw no reason then why hell should not have, so to speak, visible branch establishments throughout the earth, and I have visited quite a few of them since."--Robertson Davies

3 7

Problem exporting Haskell to C via a DLL in GHC 6.6
by SevenThunders 09 Feb '07

09 Feb '07

Before I post this as a bug, I thought I'd check to make sure I'm not doing something wrong. For this test case, on my windows XP machine I create a simple Haskell routine that counts the characters in a file, create a DLL for that routine and call it from C. The C code gives the correct answer (I think) but then proceeds to hang and never terminate. If the readFile call is removed from this code, and a constant output is assigned to the variable ll, the code works fine and terminates correctly. Thus the bug may possibly be some kind of interaction with the file IO routine, if it's a bug at all. First the Haskell code: baddll.hs: module Bad where import Foreign.Ptr import Foreign.C.String import Foreign.C.Types (CInt, CDouble ) foreign export stdcall badfunc :: CString -> IO (CInt) -- -- | Conversion from Int to CInt mkCInt :: Int -> CInt mkCInt n = fromIntegral n badfunc fstr = do file <- peekCAString fstr sstr <- readFile file let ll = length sstr return $ mkCInt ll The C code: #include <stdio.h> __declspec(dllimport) int __stdcall badfunc(char *outfile) ; int main(int argc, char *argv) { int ll ; ll = badfunc("bad.txt") ; printf("ll = %d\n", ll) ; return(1) ; } The .bat file used to compile everything. (Assumes ghc and MS VC++ 6.0 is in my path) baddll.bat: ghc -O2 -static -c baddll.hs -fglasgow-exts ghc -c dllBad.c ghc --mk-dll -static -fglasgow-exts -o baddll.dll dllBad.o baddll.o baddll_stub.o -L"." -L"." -optdll--def -optdllbaddll.def lib /def:baddll.def /MACHINE:X86 cl baddll.c baddll.lib The .def file used to create the dll export symbols. baddll.def LIBRARY baddll.dll EXPORTS badfunc@4 badfunc = badfunc@4 The boilerplate code to load and unload the Haskell runtime inside the DLL. dllBad.c #include <windows.h> #include <Rts.h> extern void __stginit_Bad(void); static char* args[] = { "ghcDll", NULL }; /* N.B. argv arrays must end with NULL */ BOOL STDCALL DllMain ( HANDLE hModule , DWORD reason , void* reserved ) { if (reason == DLL_PROCESS_ATTACH) { /* By now, the RTS DLL should have been hoisted in, but we need to start it up. */ startupHaskell(1, args, __stginit_Bad); return TRUE; } if (reason == DLL_PROCESS_DETACH) { shutdownHaskell(); return TRUE; } return TRUE; } The text file I read in. bad.txt: Greetings Earthlings If I recall correctly, from another piece of test code, this seemed to work OK in GHC 6.4. However, I'll have to resurrect my GHC 6.4 installation to verify this. If anyone sees an obvious problem with my code I'd love to be informed about this. -- View this message in context: http://www.nabble.com/Problem-exporting-Haskell-to-C-via-a-DLL-in-GHC-6.6-t… Sent from the Haskell - Glasgow-haskell-users mailing list archive at Nabble.com.

4 9

Res: (no subject)
by Tays Soares 08 Feb '07

08 Feb '07

Thank you everyone. I measuring my program using time unix an I going to try to use the GHC profiling too. Tays Cristina do Amaral Pales Soares ----- Mensagem original ---- De: Cristian Perfumo <cperfumo(a)gmail.com> Para: Seth Kurtzberg <seth(a)cql.com> Cc: Tays Soares <tayscristina(a)yahoo.com.br>; glasgow-haskell-users(a)haskell.org Enviadas: Terça-feira, 6 de Fevereiro de 2007 8:21:23 Assunto: Re: (no subject) Hi Tays, If I understood correctly, if your compiler generates Haskell code, then later on you should compile this code (with GHC, for example) and running it implies a main function that is of the tipe IO() (i.e. IO Monad). What you can do is to add (it could be, for example, in debugging mode in your compiler) the code i paste below at the beginning and in the end of your main function. Well, I don't know exactly if this answers your question. If it doesn't, my apologies. Cheers Cristian import System.Time import Text.Printf { ; timeStart <- getClockTime ... your process ; timeEnd <- getClockTime ; let diff = (normalizeTimeDiff (diffClockTimes timeEnd timeStart)) ; print ((((fromIntegral(tdPicosec diff))/(10^12))) + (fromIntegral((tdSec diff) + (60 * (tdMin diff)) + (3600 * (tdHour diff))))) ; return () } On 2/6/07, Seth Kurtzberg <seth(a)cql.com> wrote: GHC has profiling support. (By the way, many mail servers these days discard mail with no subject.) I've seen a number of papers comparing the speed of Haskell code to code of other functional languages; there is a periodic "shoot out" with ocaml. Some probably have comparisons with imperative languages, and, even if they do not, the methodology should help you. Seth Kurtzberg On Mon, 5 Feb 2007 11:28:03 -0800 (PST) Tays Soares < tayscristina(a)yahoo.com.br> wrote: > Hello everyone, > > I did at my master thesis a compiler that generates Haskell code. Now I need to measure the execution time of my generated code and I've been searched and I don't know if I'm looking with the wrong keywords but I could not find anything. I just need to measure the time of simple functions, like Ackermann and Fibonacci. Does anyone know how to measure the execution time of a Haskell program or function? > > Thank you, > Tays > > > > __________________________________________________ > Fale com seus amigos de graça com o novo Yahoo! Messenger > http://br.messenger.yahoo.com/ _______________________________________________ Glasgow-haskell-users mailing list Glasgow-haskell-users(a)haskell.org http://www.haskell.org/mailman/listinfo/glasgow-haskell-users __________________________________________________ Fale com seus amigos de graça com o novo Yahoo! Messenger http://br.messenger.yahoo.com/

1 0

ghc: out of memory error while compiling huge "let"
by David Morse 06 Feb '07

06 Feb '07

I have a machine-generated source-code file that brings my computer to its knees with ghc-6.6. After an hour or so of rummaging around, ghc dies with: "ghc-6.6: out of memory (requested 1048576 bytes)". The linux machine has 1gb RAM and 2gb swap, and I don't have access to a better one. The file is of the form ------------------------------------------- module foo (a,b) where (a,b) = let ...10,300 bindings... ; in ([a1,a2,a3...a300],[b1,b2,b3...b10000]) -------------------------------------------- Is there some simple syntactic refactoring I can do to make this work? E.g. busting the local bindings out of the "let" and into to the global level? The bindings are intertwined, but I could (with some effort) reorder them so that b5000 would only reference b5001...b10000 and never b1...b4999.

5 6

Compiling module using Data.Time with -O fails; can't find HsTime.h
by Alistair Bayley 06 Feb '07

06 Feb '07

If I try to compile this Main.hs: module Main where import Data.Time main = getCurrentTime >>= print with this ghc-6.6 command: ghc --make Main -o test -O ... I get this error: C:\DOCUME~1\bayleya\LOCALS~1\Temp\ghc728_0\ghc728_0.hc:8:20: HsTime.h: No such file or directory Is this me doing something I shouldn't, or is there something wrong with the way the library has been distributed? Alistair

2 1

(no subject)
by Tays Soares 06 Feb '07

06 Feb '07

Hello everyone, I did at my master thesis a compiler that generates Haskell code. Now I need to measure the execution time of my generated code and I've been searched and I don't know if I'm looking with the wrong keywords but I could not find anything. I just need to measure the time of simple functions, like Ackermann and Fibonacci. Does anyone know how to measure the execution time of a Haskell program or function? Thank you, Tays __________________________________________________ Fale com seus amigos de graça com o novo Yahoo! Messenger http://br.messenger.yahoo.com/

4 3

Re: [Haskell-cafe] Become a GHC build slave!
by Simon Marlow 06 Feb '07

06 Feb '07

dgriffi3(a)uiuc.edu wrote: > Here at ACM@UIUC we have the following that we could use: > AIX on PPC > Linux on PPC > Mac OSX on PPC > Mac OSX on x86 > OpenVMS on Alpha > Solaris on Sparc > > If needed we could also set up the following: > Solaris on x86 > BeOS on BeBox > IRIX on MIPS > Linux on Sparc > something on Itanium (Preproduciton-caliber Float support) Thanks - all of these would be useful; only the two Mac OS X builds would be duplicates, but duplicates are useful (as redundancy). Please let us know when you've set up your clients and we'll add you to the setup. Cheers, Simon

1 0

Become a GHC build slave!
by Simon Marlow 06 Feb '07

06 Feb '07

Thanks largely to Ian Lynagh, GHC now has a BuildBot infrastructure to automate nightly builds on multiple platforms. This replaces the old set of shell scripts that we used to run nightly builds; now adding new clients to the setup is relatively easy, instructions are here: http://hackage.haskell.org/trac/ghc/wiki/BuildBot So far we have various Windows builds running, and I'll be moving over the existing Linux nightly builds in due course. If you have a spare machine or a machine that is idle overnight, and you'd like to use it to run automated GHC builds, then please take a look at the above page for how to get started. We especially need platforms that we don't use regularly (i.e. not Windows or Linux/x86/x86_64). Cheers, Simon

6 12