From mboxrd@z Thu Jan 1 00:00:00 1970 X-Msuck: nntp://news.gmane.io/gmane.emacs.gnus.general/25188 Path: main.gmane.org!not-for-mail From: Kai.Grossjohann@CS.Uni-Dortmund.DE (Kai =?iso-8859-1?q?Gro=DFjohann?=) Newsgroups: gmane.emacs.gnus.general Subject: Re: overview file access when spooling and nnml/nnimap performance Date: 22 Sep 1999 16:13:36 +0200 Sender: owner-ding@hpc.uh.edu Message-ID: References: <877lljawft.fsf@senstation.vvf.fi> NNTP-Posting-Host: coloc-standby.netfonds.no Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Trace: main.gmane.org 1035162620 12714 80.91.224.250 (21 Oct 2002 01:10:20 GMT) X-Complaints-To: usenet@main.gmane.org NNTP-Posting-Date: Mon, 21 Oct 2002 01:10:20 +0000 (UTC) Return-Path: Original-Received: from bart.math.uh.edu (bart.math.uh.edu [129.7.128.48]) by sclp3.sclp.com (8.8.5/8.8.5) with ESMTP id KAA01753 for ; Wed, 22 Sep 1999 10:16:24 -0400 (EDT) Original-Received: from sina.hpc.uh.edu (lists@Sina.HPC.UH.EDU [129.7.3.5]) by bart.math.uh.edu (8.9.1/8.9.1) with ESMTP id JAB14030; Wed, 22 Sep 1999 09:16:22 -0500 (CDT) Original-Received: by sina.hpc.uh.edu (TLB v0.09a (1.20 tibbs 1996/10/09 22:03:07)); Wed, 22 Sep 1999 09:16:49 -0500 (CDT) Original-Received: from sclp3.sclp.com (root@sclp3.sclp.com [204.252.123.139]) by sina.hpc.uh.edu (8.9.3/8.9.3) with ESMTP id JAA28388 for ; Wed, 22 Sep 1999 09:16:23 -0500 (CDT) Original-Received: from waldorf.cs.uni-dortmund.de (waldorf.cs.uni-dortmund.de [129.217.4.42]) by sclp3.sclp.com (8.8.5/8.8.5) with ESMTP id KAA01700 for ; Wed, 22 Sep 1999 10:14:19 -0400 (EDT) Original-Received: from marcy.cs.uni-dortmund.de (marcy.cs.uni-dortmund.de [129.217.20.159]) by waldorf.cs.uni-dortmund.de with ESMTP id QAA13083 for ; Wed, 22 Sep 1999 16:13:41 +0200 (MES) Original-Received: from lucy.cs.uni-dortmund.de (lucy [129.217.20.160]) by marcy.cs.uni-dortmund.de id QAA07620; Wed, 22 Sep 1999 16:13:40 +0200 (MET DST) Original-Received: (from grossjoh@localhost) by lucy.cs.uni-dortmund.de (8.9.3/8.9.3/Debian/GNU) id QAA27901; Wed, 22 Sep 1999 16:13:36 +0200 Original-To: ding@gnus.org In-Reply-To: Hannu Koivisto's message of "22 Sep 1999 16:48:54 +0300" Original-Lines: 35 User-Agent: Gnus/5.070096 (Pterodactyl Gnus v0.96) Emacs/20.4 Precedence: list X-Majordomo: 1.94.jlt7 Xref: main.gmane.org gmane.emacs.gnus.general:25188 X-Report-Spam: http://spam.gmane.org/gmane.emacs.gnus.general:25188 I think nnimap is even slower than nnml because the NOV parsing done by Gnus is so fast. In fact, nnimap now includes a NOV cache feature which fetches overview info from the IMAP server only once. After that, the overview information is stored in a file in ~/News and subsequently fetched from there. I use a Cyrus server and I do server-side splitting with Sieve. So getting new mail is real fast -- O(n) where n is the number of subscribed groups. The splitting happens in the background. That's a nice feature of the Gnus/nnimap combination. You're right, it seems strange that operations on large groups are so slow. Recently, I moved all articles from one 3500 message nnml group to an 8000 message group, and that was real slow. Towards the end, moving got a lot faster. I'm not sure how Gnus' speed could be improved here. One could try to read ever larger chunks from the end of the file until the beginning of the last line is found. And writing new lines could happen by appending to the existing file. Yes, that might be faster for large overview files, but what's the size where it starts winning. As to displaying large summary buffers, I find that I normally get by with just displaying few messages. I switched from total-expire to auto-expire, and most old messages are marked as read. So when entering a group, I normally see just a few ticked messages, plus the new ones, plus the old ones that are parents of the other shown ones. Rather than displaying thousands of messages to search for an old one, I use nnir to search for it. (Should use nnir much more often, though.) kai -- I like BOTH kinds of music.