On Fri, 2005-08-05 at 11:15 +0200, Berke Durak wrote:

> You may also wish to have a look at :
> 
>   Thomas Reps, "Maximal-Munch" Tokenization in Linear Time, ACM Trans.
>   Program. Lang. Syst., vol. 20, num. 2, 1998, pp.259-273
>   http://www.cs.wisc.edu/wpis/papers/toplas98b.pdf

Ah, that is interesting, thanks! 

-- 
John Skaller <skaller at users dot sourceforge dot net>