From mboxrd@z Thu Jan 1 00:00:00 1970 X-Msuck: nntp://news.gmane.io/gmane.emacs.gnus.general/43866 Path: main.gmane.org!not-for-mail From: Matt Armstrong Newsgroups: gmane.emacs.gnus.general Subject: Re: Maildir backend Date: Wed, 13 Mar 2002 10:33:25 -0700 Sender: owner-ding@hpc.uh.edu Message-ID: <87r8mo1ifu.fsf@squeaker.lickey.com> References: <20020306103130.A4152@fr.thalesgroup.com> <20020307095642.A6244@fr.thalesgroup.com> <20020308131140.A10053@fr.thalesgroup.com> <20020312104127.A22635@fr.thalesgroup.com> <20020313115128.A9018@fr.thalesgroup.com> NNTP-Posting-Host: localhost.gmane.org Mime-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: quoted-printable X-Trace: main.gmane.org 1016041016 32261 127.0.0.1 (13 Mar 2002 17:36:56 GMT) X-Complaints-To: usenet@main.gmane.org NNTP-Posting-Date: Wed, 13 Mar 2002 17:36:56 +0000 (UTC) Original-Received: from malifon.math.uh.edu ([129.7.128.13]) by main.gmane.org with esmtp (Exim 3.33 #1 (Debian)) id 16lCgJ-0008OF-00 for ; Wed, 13 Mar 2002 18:36:55 +0100 Original-Received: from sina.hpc.uh.edu ([129.7.128.10] ident=lists) by malifon.math.uh.edu with esmtp (Exim 3.20 #1) id 16lCdJ-0001hI-00; Wed, 13 Mar 2002 11:33:49 -0600 Original-Received: by sina.hpc.uh.edu (TLB v0.09a (1.20 tibbs 1996/10/09 22:03:07)); Wed, 13 Mar 2002 11:33:54 -0600 (CST) Original-Received: from sclp3.sclp.com (qmailr@sclp3.sclp.com [209.196.61.66]) by sina.hpc.uh.edu (8.9.3/8.9.3) with SMTP id LAA12466 for ; Wed, 13 Mar 2002 11:33:40 -0600 (CST) Original-Received: (qmail 11497 invoked by alias); 13 Mar 2002 17:33:29 -0000 Original-Received: (qmail 11492 invoked from network); 13 Mar 2002 17:33:28 -0000 Original-Received: from hank.lickey.com (ident-is-dumb@64.81.100.235) by gnus.org with SMTP; 13 Mar 2002 17:33:28 -0000 Original-Received: from squeaker.lickey.com (squeaker.lickey.com [192.168.100.10]) by hank.lickey.com (Postfix) with ESMTP id ADD91EE3F for ; Wed, 13 Mar 2002 10:33:27 -0700 (MST) Original-Received: by squeaker.lickey.com (Postfix, from userid 1000) id ABA9ABD3F; Wed, 13 Mar 2002 10:33:26 -0700 (MST) Mail-Copies-To: never Original-To: ding@gnus.org Mail-Followup-To: ding@gnus.org In-Reply-To: (prj@po.cwru.edu's message of "Wed, 13 Mar 2002 11:26:13 -0500") Original-Lines: 34 User-Agent: Gnus/5.090006 (Oort Gnus v0.06) Emacs/21.1 (i386-debian-linux-gnu) Precedence: list X-Majordomo: 1.94.jlt7 Xref: main.gmane.org gmane.emacs.gnus.general:43866 X-Report-Spam: http://spam.gmane.org/gmane.emacs.gnus.general:43866 prj@po.cwru.edu (Paul Jarc) writes: > J=E9r=F4me Marant wrote: >> I'm trying to understand why it is slow on startup. > > I haven't profiled it, but I'm pretty sure it's because it read all > the NOV information at startup. It uses this information to build a > fast mapping among filenames, article numbers, and Message-IDs, > which speeds things up later when we want to find a message by > Message-ID, for example. > > Currently article numbers are only stored in memory, so they change > between Gnus sessions. This messes with the cache, the agent, and > 'seen marks, so I'm going to change it when I have some time. As > part of that revision, I think I can get rid of the slow startup. > E.g., I might create a new subdirectory in .nnmaildir/ which > contains files with names like this: > 154:<20020313115128.A9018@fr.thalesgroup.com>:1016016979.15575.multivac.c= wru.edu > I.e., article-number:message-id:unique-part-of-filename-in-cur. > Then when we're looking for an article, we can just scan this > directory, looking for whichever identification field we happen to > have. Since all the information here is contained in the filename, > the files can be empty, and can even be hard links to a single file > to avoid consuming lots of inodes. Have you considered placing NOV data in a single .overview file like nnml? What is the advantage to keeping nov data in separate files? My guess is that this will be faster for the common case: when folks are running on a traditional unix file system. But it probably boils down to a philosophical argument. Neither nnml nor nnmailder are probably the best tool for storing HUGE mail folders. --=20 matt