From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.1.3 (2006-06-01) on yquem.inria.fr X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=AWL autolearn=disabled version=3.1.3 X-Original-To: caml-list@yquem.inria.fr Delivered-To: caml-list@yquem.inria.fr Received: from discorde.inria.fr (discorde.inria.fr [192.93.2.38]) by yquem.inria.fr (Postfix) with ESMTP id 442CDBC85 for ; Sun, 19 Aug 2007 00:45:55 +0200 (CEST) Received: from pih-relay06.plus.net (pih-relay06.plus.net [212.159.14.133]) by discorde.inria.fr (8.13.6/8.13.6) with ESMTP id l7IMjsfR025724 (version=TLSv1/SSLv3 cipher=AES256-SHA bits=256 verify=NO) for ; Sun, 19 Aug 2007 00:45:55 +0200 Received: from [80.229.56.224] (helo=beast.local) by pih-relay06.plus.net with esmtp (Exim) id 1IMX3K-0006aq-9M for caml-list@yquem.inria.fr; Sat, 18 Aug 2007 23:45:54 +0100 From: Jon Harrop Organization: Flying Frog Consultancy Ltd. To: caml-list@yquem.inria.fr Subject: Re: [Caml-list] lexer library Date: Sat, 18 Aug 2007 23:34:44 +0100 User-Agent: KMail/1.9.7 References: <1187462392.23296.5.camel@rosella.wigram> In-Reply-To: <1187462392.23296.5.camel@rosella.wigram> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-15" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200708182334.44751.jon@ffconsultancy.com> X-Miltered: at discorde with ID 46C776A2.001 by Joe's j-chkmail (http://j-chkmail . ensmp . fr)! X-Spam: no; 0.00; lexer:01 lexer:01 parser:01 combinators:01 camlp:01 wiki:01 ocaml:01 ocaml:01 frog:98 wrote:01 ideally:01 dynamically:01 extensible:01 extensible:01 caml-list:01 On Saturday 18 August 2007 19:39:52 skaller wrote: > I am interested in building a dynamically extensible lexer.. can > anyone recommend any libraries or tools that would help? > > I could use Dypgen (extensible GLR parser) for this, but it is > probably too slow. > > A system using combinators (rather than strings) would be preferred, > and Unicode support would be nice too. Ideally the lexer automaton > could be saved with Marshal, in which case the time to build the > automaton isn't important. The new camlp4 looks like it supports this but I'm damned if I can figure out how you use it. There is a beautiful tutorial on the Wiki that fizzles out just when it gets exciting. -- Dr Jon D Harrop, Flying Frog Consultancy Ltd. OCaml for Scientists http://www.ffconsultancy.com/products/ocaml_for_scientists/?e