I want to write some small toy language using attoparsec.

So I thought, first step tokenize. Let attoparsec consume the input stream and produce a list of tokens.

Second step, parse tokens and produce the AST.

Using parsec this would be possible easily and is documented. But I want to use attoparsec for this task, because I am interested in attoparsecs capability to have the input in chunks.

TIA

Norbert