Re: [Haskell-cafe] How on Earth Do You Reason about Space?

On Wednesday 01 June 2011 12:28:28, John Lato wrote:

There are a few solutions to this. The first is to make a copy of the bytestring so only the required data is retained. In my experiments this wasn't helpful, but it would depend on your corpus. The second is to start with smaller chunks.

The third, check whether the word is already known, and *make a copy if not*. That should only keep the required parts (including the currently processed chunk) in memory.