From mboxrd@z Thu Jan 1 00:00:00 1970 X-Msuck: nntp://news.gmane.io/gmane.emacs.gnus.user/14474 Path: news.gmane.org!not-for-mail From: prad Newsgroups: gmane.emacs.gnus.user Subject: Re: my vs maildir Date: Fri, 31 Dec 2010 22:21:14 -0800 Message-ID: <87aajl4011.fsf@towardsfreedom.com> References: <87aajmrkgb.fsf@towardsfreedom.com> NNTP-Posting-Host: lo.gmane.org Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Trace: dough.gmane.org 1293862914 16907 80.91.229.12 (1 Jan 2011 06:21:54 GMT) X-Complaints-To: usenet@dough.gmane.org NNTP-Posting-Date: Sat, 1 Jan 2011 06:21:54 +0000 (UTC) To: info-gnus-english@gnu.org Original-X-From: info-gnus-english-bounces+gegu-info-gnus-english=m.gmane.org@gnu.org Sat Jan 01 07:21:50 2011 Return-path: Envelope-to: gegu-info-gnus-english@m.gmane.org Original-Received: from lists.gnu.org ([199.232.76.165]) by lo.gmane.org with esmtp (Exim 4.69) (envelope-from ) id 1PYuqc-0004Bl-ET for gegu-info-gnus-english@m.gmane.org; Sat, 01 Jan 2011 07:21:50 +0100 Original-Received: from localhost ([127.0.0.1]:44332 helo=lists.gnu.org) by lists.gnu.org with esmtp (Exim 4.43) id 1PYuqb-0004Jn-So for gegu-info-gnus-english@m.gmane.org; Sat, 01 Jan 2011 01:21:49 -0500 Original-Received: from [140.186.70.92] (port=56407 helo=eggs.gnu.org) by lists.gnu.org with esmtp (Exim 4.43) id 1PYuqU-0004Ij-Oi for info-gnus-english@gnu.org; Sat, 01 Jan 2011 01:21:46 -0500 Original-Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1PYuqQ-0004k8-2e for info-gnus-english@gnu.org; Sat, 01 Jan 2011 01:21:42 -0500 Original-Received: from lo.gmane.org ([80.91.229.12]:46375) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1PYuqP-0004jT-TH for info-gnus-english@gnu.org; Sat, 01 Jan 2011 01:21:38 -0500 Original-Received: from list by lo.gmane.org with local (Exim 4.69) (envelope-from ) id 1PYuqL-000454-5b for info-gnus-english@gnu.org; Sat, 01 Jan 2011 07:21:33 +0100 Original-Received: from 70.67.160.177 ([70.67.160.177]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Sat, 01 Jan 2011 07:21:33 +0100 Original-Received: from prad by 70.67.160.177 with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Sat, 01 Jan 2011 07:21:33 +0100 X-Injected-Via-Gmane: http://gmane.org/ Original-Lines: 37 Original-X-Complaints-To: usenet@dough.gmane.org X-Gmane-NNTP-Posting-Host: 70.67.160.177 User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/23.2 (gnu/linux) Cancel-Lock: sha1:Kocx3nWkzbDvNptMIUlRUhTt+48= X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6 (newer, 3) X-BeenThere: info-gnus-english@gnu.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: "Announcements and discussions for GNUS, the GNU Emacs Usenet newsreader \(in English\)" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Original-Sender: info-gnus-english-bounces+gegu-info-gnus-english=m.gmane.org@gnu.org Errors-To: info-gnus-english-bounces+gegu-info-gnus-english=m.gmane.org@gnu.org Xref: news.gmane.org gmane.emacs.gnus.user:14474 Archived-At: prad writes: > this exercise is to establish the local storage format for emails over > several years so they can be indexed for the purpose of search and retrieval. thx brett, tassilo and richard. i've been trying out various things all day and think i've found a reasonable solution (even though i had a connection to the remote imap server which worked well yesterday): 1. used clawsmail to turn 40000+ mh emails into mbox 2. used mb2md to make mbox into maildir 3. put the cur new tmp into ~/Mail/inbox 4. served that through dovecot before #4, i first tried to use nnmaildir to go right into the Mail directly and it was very slow. so the imap server must be doing all sorts of stuff behind the scene since things are super quick now! i don't quite understand this because i'd have though direct access would be fast, but i guess it means gnus has to do all the work without dovecot lending a helping hand? the only minor problem i have is that things haven't quite come out sorted by date so when i ask for say 99 items, i don't get the most recent 99 items as i do with the newsgroups or a direct connection to my imap server as i did yesterday. somehow, the dovecot on the remote server presents things ordered by date. so i guess some more studying and tweaking is necessary though presumably gnus can do this as well with something like: (setq gnus-thread-sort-functions '((gnus-thread-sort-by-date))) -- in friendship, prad