22 Nov
2010
22 Nov
'10
8:12 a.m.
On 22 November 2010 02:59, Lyndon Maydwell
I've found that the token library imposes conventions on whitespace that make it difficult to use in many cases.
True - as it can't be made to differentiate between newline and other whitespace it does make writing line oriented parsers difficult. I tend to write my own cut down version of the token modules at that point.