From mboxrd@z Thu Jan 1 00:00:00 1970 X-Msuck: nntp://news.gmane.io/gmane.emacs.gnus.general/74616 Path: news.gmane.org!not-for-mail From: Daniel Pittman Newsgroups: gmane.emacs.gnus.general Subject: Re: expiry taking "forever" in both cpu time and real time when the IMAP UID is high Date: Thu, 02 Dec 2010 23:59:59 +1100 Message-ID: References: <874od8fjcc.fsf@nemi.mork.no> <1291291383-18946-1-git-send-email-bjorn@mork.no> <871v609xny.fsf_-_@nemi.mork.no> NNTP-Posting-Host: lo.gmane.org Mime-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-Trace: dough.gmane.org 1291294904 24180 80.91.229.12 (2 Dec 2010 13:01:44 GMT) X-Complaints-To: usenet@dough.gmane.org NNTP-Posting-Date: Thu, 2 Dec 2010 13:01:44 +0000 (UTC) To: ding@gnus.org Original-X-From: ding-owner+M22972@lists.math.uh.edu Thu Dec 02 14:01:39 2010 Return-path: Envelope-to: ding-account@gmane.org Original-Received: from util0.math.uh.edu ([129.7.128.18]) by lo.gmane.org with esmtp (Exim 4.69) (envelope-from ) id 1PO8n5-0002Dt-8k for ding-account@gmane.org; Thu, 02 Dec 2010 14:01:39 +0100 Original-Received: from localhost ([127.0.0.1] helo=lists.math.uh.edu) by util0.math.uh.edu with smtp (Exim 4.63) (envelope-from ) id 1PO8me-0002oF-BO; Thu, 02 Dec 2010 07:01:12 -0600 Original-Received: from mx1.math.uh.edu ([129.7.128.32]) by util0.math.uh.edu with esmtps (TLSv1:AES256-SHA:256) (Exim 4.63) (envelope-from ) id 1PO8md-0002o5-8b for ding@lists.math.uh.edu; Thu, 02 Dec 2010 07:01:11 -0600 Original-Received: from quimby.gnus.org ([80.91.231.51]) by mx1.math.uh.edu with esmtp (Exim 4.72) (envelope-from ) id 1PO8mY-0001gr-5B for ding@lists.math.uh.edu; Thu, 02 Dec 2010 07:01:11 -0600 Original-Received: from lo.gmane.org ([80.91.229.12]) by quimby.gnus.org with esmtp (Exim 3.36 #1 (Debian)) id 1PO8mX-0000nK-00 for ; Thu, 02 Dec 2010 14:01:05 +0100 Original-Received: from list by lo.gmane.org with local (Exim 4.69) (envelope-from ) id 1PO8mX-0001yZ-AT for ding@gnus.org; Thu, 02 Dec 2010 14:01:05 +0100 Original-Received: from ppp59-167-189-244.static.internode.on.net ([59.167.189.244]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Thu, 02 Dec 2010 14:01:05 +0100 Original-Received: from daniel by ppp59-167-189-244.static.internode.on.net with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Thu, 02 Dec 2010 14:01:05 +0100 X-Injected-Via-Gmane: http://gmane.org/ Original-Lines: 27 Original-X-Complaints-To: usenet@dough.gmane.org X-Gmane-NNTP-Posting-Host: ppp59-167-189-244.static.internode.on.net User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/23.2 (darwin) Cancel-Lock: sha1:hN/cjyTjsi2QyGy0y52RYRWdOt4= X-Spam-Score: -1.9 (-) List-ID: Precedence: bulk Xref: news.gmane.org gmane.emacs.gnus.general:74616 Archived-At: Bjørn Mork writes: > And then after having implemented the IMAP internal copy speedup, I noticed > that the "fetch all articles which are about to be expired one by one" code > isn't the worst part of the expiration process... > > After copying the articles, Gnus does "something" which evidently depends on > the UID value. When expiring from my work INBOX, which now is using UIDs in > the 280000s although it usually only has a few hundred messages, emacs will > eat 100% of one CPU core for a loooong time (several minutes). [...] > Any hints? Anyone else seen this? Oh, yeah. Gnus is expanding a range that includes that high number, so it can walk through it, then compress it back into a range. I /think/ this is the stuff that Larsi was just talking about fixing up with the "range tree" stuff and all. I mostly ran into it on Zimbra which used a sparse UID space, so could legitimately have gaps of 100 or even 1000 between consecutive message UIDs. Daniel -- ✣ Daniel Pittman ✉ daniel@rimspace.net ☎ +61 401 155 707 ♽ made with 100 percent post-consumer electrons