From mboxrd@z Thu Jan 1 00:00:00 1970 X-Msuck: nntp://news.gmane.io/gmane.emacs.gnus.general/70455 Path: news.gmane.org!not-for-mail From: James Cloos Newsgroups: gmane.emacs.gnus.general Subject: Re: Faster, lolcat. Faster! Date: Sat, 04 Sep 2010 18:01:24 -0400 Message-ID: References: <87sk1rlqrk.fsf@elegiac.orebokech.com> <877hj12ssi.fsf@elegiac.orebokech.com> NNTP-Posting-Host: lo.gmane.org Mime-Version: 1.0 Content-Type: text/plain X-Trace: dough.gmane.org 1283638252 21245 80.91.229.12 (4 Sep 2010 22:10:52 GMT) X-Complaints-To: usenet@dough.gmane.org NNTP-Posting-Date: Sat, 4 Sep 2010 22:10:52 +0000 (UTC) To: ding@gnus.org Original-X-From: ding-owner+M18830@lists.math.uh.edu Sun Sep 05 00:10:50 2010 Return-path: Envelope-to: ding-account@gmane.org Original-Received: from util0.math.uh.edu ([129.7.128.18]) by lo.gmane.org with esmtp (Exim 4.69) (envelope-from ) id 1Os0wh-00035W-75 for ding-account@gmane.org; Sun, 05 Sep 2010 00:10:47 +0200 Original-Received: from localhost ([127.0.0.1] helo=lists.math.uh.edu) by util0.math.uh.edu with smtp (Exim 4.63) (envelope-from ) id 1Os0wT-0007Rg-MF; Sat, 04 Sep 2010 17:10:33 -0500 Original-Received: from mx1.math.uh.edu ([129.7.128.32]) by util0.math.uh.edu with esmtps (TLSv1:AES256-SHA:256) (Exim 4.63) (envelope-from ) id 1Os0wS-0007RU-3w for ding@lists.math.uh.edu; Sat, 04 Sep 2010 17:10:32 -0500 Original-Received: from quimby.gnus.org ([80.91.231.51]) by mx1.math.uh.edu with esmtp (Exim 4.72) (envelope-from ) id 1Os0wQ-0006oN-S9 for ding@lists.math.uh.edu; Sat, 04 Sep 2010 17:10:32 -0500 Original-Received: from eagle.jhcloos.com ([207.210.242.212]) by quimby.gnus.org with esmtp (Exim 3.36 #1 (Debian)) id 1Os0wQ-0007bQ-00 for ; Sun, 05 Sep 2010 00:10:30 +0200 Original-Received: by eagle.jhcloos.com (Postfix, from userid 10) id 55278401E5; Sat, 4 Sep 2010 22:09:59 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=jhcloos.com; s=eagle; t=1283638223; bh=8MLHQRpx4DndyTQhouepoqykxNxD+eE/PSBpp3wuygk=; h=From:To:Subject:In-Reply-To:References:Date:Message-ID: MIME-Version:Content-Type; b=SCZiLoO1BbzJQ/BEo0LjoBEdcEDlhppEmYW5mvN0TXfmta+utJCqIAPeHZntwdlMW G4vbunLYVu1wnDGaD1Ik5Wpe4V7+p+O1eXfqD9jhKugFKaJ+a1brDpWM6yvgZ0O0QL GM2BMTTWc1r90trRRi0WoYX/glW9sTFo0vAHarts= Original-Received: from carbon.jhcloos.org (localhost [127.0.0.1]) by carbon.jhcloos.org (Postfix) with ESMTP id 600EA1D75E0 for ; Sat, 4 Sep 2010 22:01:24 +0000 (UTC) In-Reply-To: (Lars Magne Ingebrigtsen's message of "Sat, 04 Sep 2010 22:17:38 +0200") User-Agent: Gnus/5.110011 (No Gnus v0.11) Emacs/24.0.50 (gnu/linux) Face: iVBORw0KGgoAAAANSUhEUgAAABAAAAAQCAYAAAAf8/9hAAAABHNCSVQICAgIfAhkiAAAAI1J REFUOE+lU9ESgCAIg64P1y+ngUdxhl5H8wFbbM0OmUiEhKkCYaZThXCo6KE5sCbA1DDX3genvO4d eBQgEMaM5qy6uWk4SfBYfdu9jvBN9nSVDOKRtwb+I3epboOsOX5pZbJNsBJFvmQQ05YMfieIBnYX FK2N6dOawd97r/e8RjkTLzmMsiVgrAoEugtviCM3v2WzjgAAAABJRU5ErkJggg== Copyright: Copyright 2009 James Cloos OpenPGP: ED7DAEA6; url=http://jhcloos.com/public_key/0xED7DAEA6.asc OpenPGP-Fingerprint: E9E9 F828 61A4 6EA9 0F2B 63E7 997A 9F17 ED7D AEA6 Original-Lines: 35 X-Hashcash: 1:30:100904:ding@gnus.org::aXFfFrsgfrpByt75:000PTPtb X-Spam-Score: -2.0 (--) List-ID: Precedence: bulk Xref: news.gmane.org gmane.emacs.gnus.general:70455 Archived-At: [Replying to a random article in the thread] With imap startup now takes about twice as long as it used to. And emacs must be sending the imap commands slower, too, since there is more idle time. The backend psql process used to max out a core (as seen in top(1); it is really waiting on ram for most of that time) and take about 4/9 seconds per group between the initial run thorugh, the lsub, and the second run through. Now it only hits about 85% in top(1), and it still ran through the groups twice. (The mean was 5.5 imap commands per group. The startup runs an EXAMIME and a STATUS on each group and, if there are messages, a FETCH to get the list of message UIDs. If it went through twice, that suggests that about half of the groups were empty. That sounds reasonable.) One speedup would be to do the EXAMINE/STATUS/FETCH all on one packet, instead of one packet per command. But it still needs to learn to do the lsub first, when collecting the list of groups, and then do a single EXAMINE/STATUS/FETCH tuple for each group. And then subscribe the new ones if that option is set. I've looked at the code in the past, but although some parts of gnus are easy to follow, some are very much not. I never saw the proper solution, code-wise, when I looked at it.... -JimC -- James Cloos OpenPGP: 1024D/ED7DAEA6