- Haskell-Cafe - Haskell.org

Why does this program eat RAM?
by John Goerzen 13 Sep '06

13 Sep '06

I have the below program, and I'm trying to run it on an input of about 90MB. It eats RAM like crazy, and I can't figure out why. I do know that the problem is not my custwords function (as you can see, I replaced the call to it with a call to the standard words function on the last line). It seems to be wordfreq, but I don't know why. For information about the problem, see http://changelog.complete.org/posts/535-A-Haskell-solution-to-Lars-Problem.… Here's the code: import System.Environment import Data.List import Data.Char import qualified Data.Map as Map custwords = filter (/= "") . lines . map (conv . toLower) where iswordchar x = isAlphaNum x && isAscii x conv x = if iswordchar x then x else '\n' wordfreq inp = Map.toList $ foldl' updatemap (Map.empty::Map.Map String Int) inp where updatemap nm word = Map.insertWith updatefunc word 1 nm updatefunc _ x = x + 1 freqsort (w1, c1) (w2, c2) = if c1 == c2 then compare w1 w2 else compare c2 c1 showit (word, count) = show count ++ " " ++ word main = do args <- getArgs interact $ unlines . map showit . take (read . head $ args) . sortBy freqsort . wordfreq . words

10 13

Retainer Profiling
by Mark Goldman 13 Sep '06

13 Sep '06

Ok, so I've done a biographical profile and gotten what (I think) are the top offenders in creating objects that never get used. (+RTS -hc -hbvoid) The GHC user's guide suggests that the next step is retainer profiling to see why things are being retained instead of trashed. Is anyone out there able to explain retainer profiling in more detail than the GHC user's guide because I've been guessing on both what I've been seeing and what it all means. Any response would be appreciated. -mdg -- Our problems are mostly behind us, now all we have to do is fight the solutions.

1 0

Weak pointers and referential transparency???
by tpledger＠ihug.co.nz 12 Sep '06

12 Sep '06

Brian Hulley wrote: [...] > Ref.write proxiesRef $! (weakProxy : proxies) (This is nothing to do with your main question, but the strict application looks unnecessary there. Its right hand side is already a constructor cell.) [...] > In other words, if the entry for the proxy > in the table stored in the Model dies, can > I be absolutely 100% sure that this means > the proxy no longer exists in any shape or > form in the running program? My reading of the semantics (http://haskell.org/ghc/docs/latest/html/libraries/base/System-Mem-Weak.html…) is that you can be sure the proxy *object* is gone. As for referential transparency... Fan-in: If you create equivalent proxies in different calls to createProxy, it's possible that they'll end up referring to the same object (e.g. if the compiler or RTS does something fancy, or you use a memoised smart constructor). So then a single live proxy object *could* protect many elements of your Weak Proxy list from scavenging. Fan-out: It would seem perverse to cry "referential transparency!" and spontaneously clone one of your proxy objects. That *could* lead to deRefWeak returning Nothing while an *equivalent* Proxy object is still alive. Might you run your program on an avant-garde distributed RTS? ;-) Regards, Tom

2 1

Slow IO
by Daniel Fischer 12 Sep '06

12 Sep '06

Hello all, Now I have an IO-problem, too. SPOJ problem 41 asks basically to determine whether a directed graph allows a path that uses every edge exactly once. The data from which the graphs are to be constructed are contained in a (huge) file, every item (number of test cases, size of test case, edges) on a single line. I've created my own test case file (much smaller, but already 217 MB, 2.2 million lines) to check my programme's performance. Now profiling reveals that over 90% of time and allocation are consumed by reading the file (line by line, reading the whole file as a lazy String and then chopping that to pieces is rather worse). So how do I quickly 1. read an Integer n from the file, 2. read the next n lines and 3. pass the first and last letter of those to the function that builds and checks the graph? When that is achieved, I could see whether my algorithm is good. Thanks for any help, Daniel -- "In My Egotistical Opinion, most people's C programs should be indented six feet downward and covered with dirt." -- Blair P. Houghton

4 5

haskell toolchain for slackware
by Andrea Rossato 12 Sep '06

12 Sep '06

Hello! Since there seems to be very little support for haskell in Slackware Linux, I'm putting together a repository with the most useful (for me) hasekll utilities. For the time being there are: 1. ghc-6.4.2 (precompiled binaries packaged for slackware) 2. haddock 3. darsc 4. hscurses 5. HaXml-1.13.2 6. HXT-6.1 with HTTP-20060707 I'm planning to add, very soon, Hugs, hs-plugins and fps-0.7. The repository should be accessible with slapt-get and swaret. I hope dependency checking is working with slapt-get. Here's the repo: http://gorgias.mine.nu/slack/ You can also grab the SlackBuild scripts (I started using Cabal with HaXml, HXT and HTTP) here: http://gorgias.mine.nu/repos/slackBuild/ or darcs get http://gorgias.mine.nu/repos/slackBuild/ I build my stuff in an almost current slack. Ciao Andrea

1 0

Newbied question on IO Monad
by Sara Kenedy 12 Sep '06

12 Sep '06

Hello all, update :: String -> String update sss = ... main = do writeFile "myFile.txt" sss x <- callSystem "myFile.txt" y <- openFile "result.txt" ReadMode zzz <- hGetContents y return zzz I know that function main returns IO String, function update returns String. And my purpose is to get the string zzz from main for the value return of function update. But I do not know which way I can do. Sorry if the question seems ridiculous. Thanks for any help. S.

6 7

RE: [Haskell] Re: H/Direct (HaskellDirect) still maintained?
by Simon Marlow 12 Sep '06

12 Sep '06

On 08 September 2006 17:35, Andreas Marth wrote: > Now that I used a more recent ghc (6.4.2 which has cabal-1.1.4 > installed) I did install comlib with it. > But I am a bit surprised because it did not generate a ihc. So how do > I get a Proxy from an idl-file now? > > If I look at the files in vsHaskell they state "Automatically > generated by HaskellDirect (ihc.exe) ....". > Does anybody know how to generate ihc.exe? comlib is just the COM interface library, it doesn't include ihc (the IDL compiler, which is part of H/Direct). Some of the the Visual Haskell sources were originally generated by ihc, but since then we have modified the sources by hand, and we're no longer using ihc. You should be able to use these files as example code to see how to write your COM interface code. It's a lot of tedious boilerplate, unfortunately. Maybe someone will resurrect or write a replacement for ihc someday. Cheers, Simon

1 0

Heap profiling
by Mark Goldman 12 Sep '06

12 Sep '06

Does anyone know if there is a way around the 20 charachter identifier limitation when heap profiling? I have a number of identifiers that indistinguishably break that limit. -mdg -- Our problems are mostly behind us, now all we have to do is fight the solutions.

2 1

Re[2]: [Haskell] Proposal: unification of style of function/data/type/class definitions
by Bulat Ziganshin 11 Sep '06

11 Sep '06

Hello Taral, Sunday, September 10, 2006, 9:45:33 PM, you wrote: >> data Expr t = If (Expr Bool) (Expr t) (Expr t) >> Expr Int = Lit Int >> Expr Bool | Eq t = Eq (Expr t) (Expr t) > I find this somewhat unreadable due to the implicit "t" parameter not > showing up on the left-hand side... if you mean last line, i tend to agree. i was just a little impulsive and don't mentioned that we define existential here :) it may look as Expr Bool = Eq (Expr t) (Expr t) | Eq t Brian Hulley developed here an idea about implicit "forall" declaration just before class restrictions involving this variable, so it will be equivalent to: Expr Bool = Eq (Expr t) (Expr t) | forall t . Eq t -- Best regards, Bulat mailto:Bulat.Ziganshin@gmail.com

3 4

HaXml and ghci unresolved symbol
by Andrea Rossato 11 Sep '06

11 Sep '06

Hello! probably it's me, but I cannot understand what I'm doing wrong. I'm trying to learn HaXml. I've never used it before and I never did xml processing in Haskell. So I'm a total newbie!! I downloaded and compiled. Everything seems fine. I'm also able to run some examples in the related directory of the source tree. Then I try doing something myself. Very simply, a document with just one element: module Xml where import Text.XML.HaXml xml = "<a>test</a>" doc = xmlParse "test" xml elemName (Document prolog _ (Elem name _ _) _) = name When I try it: *Xml> elemName doc I get a message I've never got before (I'm a newbie!) and I don't know whether the problem is in my code (this would be my first guess), in HaXml or in GHCi. And so I cannot even start understanding out to solve it: During interactive linking, GHCi couldn't find the following symbol: TextziXMLziHaXmlziParse_xmlParse_closure This may be due to you not asking GHCi to load extra object files, archives or DLLs needed by your current session. Restart GHCi, specifying the missing library using the -L/path/to/object/dir and -lmissinglibname flags, or simply by naming the relevant files on the GHCi command line. Alternatively, this link failure might indicate a bug in GHCi. If you suspect the latter, please send a bug report to: glasgow-haskell-bugs(a)haskell.org *Xml> xmlParse is defined in Text.Xml.HaXml (xmlParse :: String -> String -> Document) and it should be imported by Text.XML.HaXml. Can you give me please some directions? Thanks for your kind attention.

5 7