22 Nov
2010
22 Nov
'10
4:12 p.m.
On 22 November 2010 02:59, Lyndon Maydwell <maydwell@gmail.com> wrote:
I've found that the token library imposes conventions on whitespace that make it difficult to use in many cases.
True - as it can't be made to differentiate between newline and other whitespace it does make writing line oriented parsers difficult. I tend to write my own cut down version of the token modules at that point.