From mboxrd@z Thu Jan  1 00:00:00 1970
Received: (from majordomo@localhost) by pauillac.inria.fr (8.7.6/8.7.3) id IAA04613; Wed, 25 Sep 2002 08:37:32 +0200 (MET DST)
X-Authentication-Warning: pauillac.inria.fr: majordomo set sender to owner-caml-list@pauillac.inria.fr using -f
Received: from nez-perce.inria.fr (nez-perce.inria.fr [192.93.2.78]) by pauillac.inria.fr (8.7.6/8.7.3) with ESMTP id IAA04837 for <caml-list@pauillac.inria.fr>; Wed, 25 Sep 2002 08:37:31 +0200 (MET DST)
Received: from maila.telia.com (maila.telia.com [194.22.194.231])
	by nez-perce.inria.fr (8.11.1/8.11.1) with ESMTP id g8P6bUD04419
	for <caml-list@inria.fr>; Wed, 25 Sep 2002 08:37:31 +0200 (MET DST)
Received: from gateway (h13n2fls34o849.telia.com [217.208.235.13])
	by maila.telia.com (8.12.5/8.12.5) with ESMTP id g8P6bT15001067;
	Wed, 25 Sep 2002 08:37:30 +0200 (CEST)
X-Original-Recipient: caml-list@inria.fr
From: "Mattias Waldau" <mattias.waldau@abc.se>
To: "'Kontra, Gergely'" <kgergely@mlabdial.hit.bme.hu>, <caml-list@inria.fr>
Subject: RE: [Caml-list] Simple full-text search dictionary
Date: Wed, 25 Sep 2002 08:37:11 +0200
Message-ID: <00ba01c2645d$faf08cc0$0600a8c0@gateway>
MIME-Version: 1.0
Content-Type: text/plain;
	charset="us-ascii"
Content-Transfer-Encoding: 7bit
X-Priority: 3 (Normal)
X-MSMail-Priority: Normal
X-Mailer: Microsoft Outlook, Build 10.0.3416
Importance: Normal
X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1106
In-Reply-To: <Pine.LNX.4.21.0209241903260.1966-100000@mlabdial.hit.bme.hu>
Sender: owner-caml-list@pauillac.inria.fr
Precedence: bulk

> I want to implement a simple *full-text* search dictionary.
> I have a textfile with a list of the words.
> 

Suffix arrays are very efficient for fast string searching 
in big texts. 

I year ago I implemented it using O'Caml, which 
took 40 s to run on my P4, when applied to the bible (4.5 MB)

The nice version is at 
http://www.abc.se/~m10217/download/mans.tar.bz2

The fast version is at
http://www.abc.se/~m10217/download/mans.opt.tar.bz2

/mattias

-------------------
To unsubscribe, mail caml-list-request@inria.fr Archives: http://caml.inria.fr
Bug reports: http://caml.inria.fr/bin/caml-bugs FAQ: http://caml.inria.fr/FAQ/
Beginner's list: http://groups.yahoo.com/group/ocaml_beginners