From: Kai.Grossjohann@CS.Uni-Dortmund.DE (Kai Großjohann)
Cc: ding@gnus.org
Subject: Re: Searching a news server
Date: Sun, 17 Feb 2002 11:03:16 +0100 [thread overview]
Message-ID: <vafeljkwhln.fsf@INBOX.auto.gnus.tok.lucy.cs.uni-dortmund.de> (raw)
In-Reply-To: <yl8z9tnn4a.fsf@windlord.stanford.edu> (Russ Allbery's message of "Sat, 16 Feb 2002 13:16:37 -0800")
Russ Allbery <rra@stanford.edu> writes:
> I'll note from experience with things like this that the hard part in
> making full-text searching acceptably fast will be incremental indexing of
> each article as it comes in. Many of the existing search engines suck at
> incremental indexing.
Most of the weighting functions used seem to use normalization of
some kind, so the indexing weight for a given term in a given
document depends on the complete set of documents. So adding a
document means that, strictly speaking, you have to reindex the whole
collection. Hmpf.
There is a hack for freeWAIS-sf which allows you to add N documents
incrementally, with skew of weights. After more than N documents
have been added, it reindexes the whole collection. Maybe that's a
suitable workaround.
freeWAIS-sf seems to be a bear to build...
kai
--
~/.signature is: umop 3p!sdn (Frank Nobis)
prev parent reply other threads:[~2002-02-17 10:03 UTC|newest]
Thread overview: 5+ messages / expand[flat|nested] mbox.gz Atom feed top
2002-01-06 19:24 Lars Magne Ingebrigtsen
2002-01-06 23:39 ` Russ Allbery
2002-01-19 20:46 ` Lars Magne Ingebrigtsen
2002-02-16 21:16 ` Russ Allbery
2002-02-17 10:03 ` Kai Großjohann [this message]
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=vafeljkwhln.fsf@INBOX.auto.gnus.tok.lucy.cs.uni-dortmund.de \
--to=kai.grossjohann@cs.uni-dortmund.de \
--cc=ding@gnus.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).