From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.1.3 (2006-06-01) on yquem.inria.fr X-Spam-Level: X-Spam-Status: No, score=0.0 required=5.0 tests=AWL autolearn=disabled version=3.1.3 X-Original-To: caml-list@yquem.inria.fr Delivered-To: caml-list@yquem.inria.fr Received: from concorde.inria.fr (concorde.inria.fr [192.93.2.39]) by yquem.inria.fr (Postfix) with ESMTP id AF71FBC6B for ; Sat, 18 Aug 2007 20:39:58 +0200 (CEST) Received: from ipmail01.adl2.internode.on.net (ipmail01.adl2.internode.on.net [203.16.214.140]) by concorde.inria.fr (8.13.6/8.13.6) with ESMTP id l7IIduIr003156 for ; Sat, 18 Aug 2007 20:39:57 +0200 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: AgAAAL3YxkZ5LGJp/2dsb2JhbAAM X-IronPort-AV: E=Sophos;i="4.19,280,1183300200"; d="scan'208";a="175185067" Received: from ppp121-44-98-105.lns10.syd6.internode.on.net (HELO [192.168.1.201]) ([121.44.98.105]) by ipmail01.adl2.internode.on.net with ESMTP; 19 Aug 2007 04:09:54 +0930 Subject: lexer library From: skaller To: caml-list@yquem.inria.fr Content-Type: text/plain Date: Sun, 19 Aug 2007 04:39:52 +1000 Message-Id: <1187462392.23296.5.camel@rosella.wigram> Mime-Version: 1.0 X-Mailer: Evolution 2.10.1 Content-Transfer-Encoding: 7bit X-Miltered: at concorde with ID 46C73CFC.000 by Joe's j-chkmail (http://j-chkmail . ensmp . fr)! X-Spam: no; 0.00; lexer:01 lexer:01 parser:01 combinators:01 sourceforge:01 ideally:01 dynamically:01 extensible:01 extensible:01 marshal:01 strings:01 library:03 probably:07 automaton:08 automaton:08 I am interested in building a dynamically extensible lexer.. can anyone recommend any libraries or tools that would help? I could use Dypgen (extensible GLR parser) for this, but it is probably too slow. A system using combinators (rather than strings) would be preferred, and Unicode support would be nice too. Ideally the lexer automaton could be saved with Marshal, in which case the time to build the automaton isn't important. -- John Skaller Felix, successor to C++: http://felix.sf.net