From mboxrd@z Thu Jan 1 00:00:00 1970 X-Msuck: nntp://news.gmane.io/gmane.emacs.gnus.general/66217 Path: news.gmane.org!not-for-mail From: Tassilo Horn Newsgroups: gmane.emacs.gnus.general Subject: Re: Slowdowns with big nnmaildir groups Date: Fri, 01 Feb 2008 14:57:06 +0100 Message-ID: <8763x83hl9.fsf@member.fsf.org> References: <87d4rhm5vv.fsf@member.fsf.org> <87zluk3mws.fsf@member.fsf.org> <87wsporh0k.fsf@rimspace.net> NNTP-Posting-Host: lo.gmane.org Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Trace: ger.gmane.org 1201874281 5320 80.91.229.12 (1 Feb 2008 13:58:01 GMT) X-Complaints-To: usenet@ger.gmane.org NNTP-Posting-Date: Fri, 1 Feb 2008 13:58:01 +0000 (UTC) To: ding@gnus.org Original-X-From: ding-owner+M14708@lists.math.uh.edu Fri Feb 01 14:58:23 2008 Return-path: Envelope-to: ding-account@gmane.org Original-Received: from util0.math.uh.edu ([129.7.128.18]) by lo.gmane.org with esmtp (Exim 4.50) id 1JKwPL-00078J-Ry for ding-account@gmane.org; Fri, 01 Feb 2008 14:58:20 +0100 Original-Received: from localhost ([127.0.0.1] helo=lists.math.uh.edu) by util0.math.uh.edu with smtp (Exim 4.63) (envelope-from ) id 1JKwON-0000dO-98; Fri, 01 Feb 2008 07:57:19 -0600 Original-Received: from mx2.math.uh.edu ([129.7.128.33]) by util0.math.uh.edu with esmtps (TLSv1:AES256-SHA:256) (Exim 4.63) (envelope-from ) id 1JKwOL-0000ct-0F for ding@lists.math.uh.edu; Fri, 01 Feb 2008 07:57:17 -0600 Original-Received: from quimby.gnus.org ([80.91.231.51]) by mx2.math.uh.edu with esmtp (Exim 4.67) (envelope-from ) id 1JKwOF-0003mP-1a for ding@lists.math.uh.edu; Fri, 01 Feb 2008 07:57:16 -0600 Original-Received: from out2.smtp.messagingengine.com ([66.111.4.26]) by quimby.gnus.org with esmtp (Exim 3.35 #1 (Debian)) id 1JKwOH-00074L-00 for ; Fri, 01 Feb 2008 14:57:13 +0100 Original-Received: from compute1.internal (compute1.internal [10.202.2.41]) by out1.messagingengine.com (Postfix) with ESMTP id 4D7B78E21B for ; Fri, 1 Feb 2008 08:57:09 -0500 (EST) Original-Received: from heartbeat2.messagingengine.com ([10.202.2.161]) by compute1.internal (MEProxy); Fri, 01 Feb 2008 08:57:09 -0500 X-Sasl-enc: j0iYZOF4pBmKF5Yqj7FvVFvgsi6bbvnu3o9ggbKSAAlf 1201874228 Original-Received: from baldur (dslb-084-063-027-234.pools.arcor-ip.net [84.63.27.234]) by mail.messagingengine.com (Postfix) with ESMTP id 9826C25A9B for ; Fri, 1 Feb 2008 08:57:08 -0500 (EST) Mail-Followup-To: ding@gnus.org In-Reply-To: <87wsporh0k.fsf@rimspace.net> (Daniel Pittman's message of "Fri, 01 Feb 2008 23:35:39 +1100") User-Agent: Gnus/5.110007 (No Gnus v0.7) Emacs/23.0.50 (gnu/linux) X-Spam-Score: -2.6 (--) List-ID: Precedence: bulk Xref: news.gmane.org gmane.emacs.gnus.general:66217 Archived-At: Daniel Pittman writes: Hi Daniel, > You probably want to instrument nnmaildir, or possibly nn, as well as > gnus. I did that (with nnmaildir) and the results are in <87abmk3k1f.fsf@member.fsf.org>. > IIRC the nnmaildir code tries to play nice with other Maildir clients, > which means reading all the (giant) filenames from disk, which > probably works the poor kernel quite hard, especially with such a > large directory. Indeed, the filenames are quite big, like: 1201848492_1.4393.baldur,U=10600,FMD5=72a62f382d4bdeb4a771c2d3ea493c5d:2,:2, > Ensuring your Maildir is on a filesystem that handles large > directories well is probably the best bet for improving performance. Hm, it's on a ext3 filesystem. Maybe I can improve speed with the dir_index option... OfflineIMAP has the possibility to sync an IMAP group to a mbox instead of a maildir, but I guess that wouldn't improve the situation. Currently the emacs-devel folder is about 140M big, which would exceed the buffer size limit on my 30Bit machine. Bye, Tassilo