From mboxrd@z Thu Jan 1 00:00:00 1970 X-Msuck: nntp://news.gmane.io/gmane.emacs.gnus.general/42483 Path: main.gmane.org!not-for-mail From: Lars Magne Ingebrigtsen Newsgroups: gmane.emacs.gnus.general Subject: Re: db-backed mail back end Date: Thu, 24 Jan 2002 02:24:41 +0100 Organization: Programmerer Ingebrigtsen Sender: owner-ding@hpc.uh.edu Message-ID: References: <87g04x7w4q.fsf@inanna.rimspace.net> NNTP-Posting-Host: coloc-standby.netfonds.no Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Trace: main.gmane.org 1035177717 11921 80.91.224.250 (21 Oct 2002 05:21:57 GMT) X-Complaints-To: usenet@main.gmane.org NNTP-Posting-Date: Mon, 21 Oct 2002 05:21:57 +0000 (UTC) Return-Path: Original-Received: (qmail 17570 invoked from network); 24 Jan 2002 01:25:27 -0000 Original-Received: from malifon.math.uh.edu (mail@129.7.128.13) by mastaler.com with SMTP; 24 Jan 2002 01:25:27 -0000 Original-Received: from sina.hpc.uh.edu ([129.7.128.10] ident=lists) by malifon.math.uh.edu with esmtp (Exim 3.20 #1) id 16TYdX-00071X-00; Wed, 23 Jan 2002 19:25:07 -0600 Original-Received: by sina.hpc.uh.edu (TLB v0.09a (1.20 tibbs 1996/10/09 22:03:07)); Wed, 23 Jan 2002 19:25:01 -0600 (CST) Original-Received: from sclp3.sclp.com (qmailr@sclp3.sclp.com [209.196.61.66]) by sina.hpc.uh.edu (8.9.3/8.9.3) with SMTP id TAA12295 for ; Wed, 23 Jan 2002 19:24:49 -0600 (CST) Original-Received: (qmail 17558 invoked by alias); 24 Jan 2002 01:24:48 -0000 Original-Received: (qmail 17546 invoked from network); 24 Jan 2002 01:24:48 -0000 Original-Received: from ingebrigtsen.no (HELO quimby2.netfonds.no) (195.204.10.66) by gnus.org with SMTP; 24 Jan 2002 01:24:48 -0000 Original-Received: from news by quimby2.netfonds.no with local (Exim 3.12 #1 (Debian)) id 16TYeU-0004r9-00 for ; Thu, 24 Jan 2002 02:26:06 +0100 Original-To: ding@gnus.org Original-Path: not-for-mail Original-Newsgroups: gnus.ding Original-Lines: 30 Original-NNTP-Posting-Host: quimbies.gnus.org Original-X-Trace: quimby2.netfonds.no 1011835566 17618 195.204.10.148 (24 Jan 2002 01:26:06 GMT) Original-X-Complaints-To: usenet@quimby2.netfonds.no Original-NNTP-Posting-Date: 24 Jan 2002 01:26:06 GMT Mail-Copies-To: never X-Now-Playing: Mouse On Mars's _Agit Itter It It_: "Repress-End" User-Agent: Gnus/5.090006 (Oort Gnus v0.06) Emacs/21.1 (i686-pc-linux-gnu) X-Face: '1Lerdd6e^0qt@f@>:{bBPaPW7Z7S*9F$$1UM5+Pc^X;WCJw'c"Kf\$DIe;=[mS`[Mff*MI W$8{/tb@L(@>8ep8VSw1Jp+j9_81~M!"f)L6@gO+[V:Ma>SMi)97:n[^^!/jN2;mg$N/+ Cancel-Lock: sha1:dae/5zYg1Safi1n2NcjdDrsQk9A= Precedence: list X-Majordomo: 1.94.jlt7 Xref: main.gmane.org gmane.emacs.gnus.general:42483 X-Report-Spam: http://spam.gmane.org/gmane.emacs.gnus.general:42483 Russ Allbery writes: > Don't store all the articles in one directory; the file system > implementation will kill you. Yup. The obvious solution to that would be using some sort of hierarchy -- using (say) pairs of digits of the article number as directory names. Or something. "d45/d34/d43/4" for the message "4534434". Or perhaps the other way around: "45/34/43/a4" for the message "4534434". > Preindex the stuff that you usually want to search for. .overview > is sort of a basic step in that direction, but for truly vast > archives you need something like Glimpse or htdig or whatnot. Speaking over .overview files -- putting a 20kline .overview file into a buffer and then looking through that buffer for the 2 lines we want is s-l-o-w. I see two obvious solutions. 1) Split the .overview file into an .overview directory with several 1kline .overview files in it 2) Implement the basic .overview "find-the-right-line" thing in C. -- (domestic pets only, the antidote for overdose, milk.) larsi@gnus.org * Lars Magne Ingebrigtsen