GHC 6.8.2 and large source files

Dear Haskell users, we have an automated system that generates executable haskell source files. These files have a line count from 1,000 lines up to 28,000 lines. There is only 1 type definition and 5 functions in total in the file. We now can compile into executable code some of these programs but the compiler requires an incredible amount of memory: the 15,000 line programs easily require 2 GByte of RAM and then the compiler dies. Are there hints on how to compile large source files? Would it help, for example to compile each function on its own? On the following webpage you can find a handcrafted program, albeit with very few lines, that shows how one of our source files would look like: http://bibiserv.techfak.uni-bielefeld.de/cgi-bin/adp_MatrixMult We automatically generate type, algebras and the grammar for our application. Thanks, Christian Höner zu Siederdissen

Hi Christian, On Sun, Jun 01, 2008 at 09:55:06PM +0200, Christian Höner zu Siederdissen wrote:
We now can compile into executable code some of these programs but the compiler requires an incredible amount of memory: the 15,000 line programs easily require 2 GByte of RAM and then the compiler dies.
We've been looking into similar problems recently, and hopefully GHC 6.10 will do better.
Are there hints on how to compile large source files? Would it help, for example to compile each function on its own?
Yes, I expect so, although the sweet spot probably has several functions per module. Thanks Ian

Dear Haskell users,
please see ticket 2346 for example code. Note that two of the files will
likely require all available memory upon compilation.
Christian Höner zu Siederdissen
* Christian Höner zu Siederdissen
Dear Haskell users,
we have an automated system that generates executable haskell source files. These files have a line count from 1,000 lines up to 28,000 lines. There is only 1 type definition and 5 functions in total in the file.
We now can compile into executable code some of these programs but the compiler requires an incredible amount of memory: the 15,000 line programs easily require 2 GByte of RAM and then the compiler dies.
Are there hints on how to compile large source files? Would it help, for example to compile each function on its own?
On the following webpage you can find a handcrafted program, albeit with very few lines, that shows how one of our source files would look like: http://bibiserv.techfak.uni-bielefeld.de/cgi-bin/adp_MatrixMult
We automatically generate type, algebras and the grammar for our application.
Thanks, Christian Höner zu Siederdissen
_______________________________________________ Glasgow-haskell-users mailing list Glasgow-haskell-users@haskell.org http://www.haskell.org/mailman/listinfo/glasgow-haskell-users
participants (2)
-
Christian Höner zu Siederdissen
-
Ian Lynagh