From mboxrd@z Thu Jan 1 00:00:00 1970 X-Msuck: nntp://news.gmane.io/gmane.emacs.gnus.general/73385 Path: news.gmane.org!not-for-mail From: James Cloos Newsgroups: gmane.emacs.gnus.general Subject: Re: fast list Date: Wed, 20 Oct 2010 14:47:34 -0400 Message-ID: References: NNTP-Posting-Host: lo.gmane.org Mime-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: quoted-printable X-Trace: dough.gmane.org 1287611531 660 80.91.229.12 (20 Oct 2010 21:52:11 GMT) X-Complaints-To: usenet@dough.gmane.org NNTP-Posting-Date: Wed, 20 Oct 2010 21:52:11 +0000 (UTC) To: ding@gnus.org Original-X-From: ding-owner+M21756@lists.math.uh.edu Wed Oct 20 23:52:08 2010 Return-path: Envelope-to: ding-account@gmane.org Original-Received: from util0.math.uh.edu ([129.7.128.18]) by lo.gmane.org with esmtp (Exim 4.69) (envelope-from ) id 1P8gZr-0001Pu-MY for ding-account@gmane.org; Wed, 20 Oct 2010 23:52:08 +0200 Original-Received: from localhost ([127.0.0.1] helo=lists.math.uh.edu) by util0.math.uh.edu with smtp (Exim 4.63) (envelope-from ) id 1P8gZj-0007rE-Ai; Wed, 20 Oct 2010 16:51:59 -0500 Original-Received: from mx2.math.uh.edu ([129.7.128.33]) by util0.math.uh.edu with esmtps (TLSv1:AES256-SHA:256) (Exim 4.63) (envelope-from ) id 1P8gZh-0007qu-8b for ding@lists.math.uh.edu; Wed, 20 Oct 2010 16:51:57 -0500 Original-Received: from quimby.gnus.org ([80.91.231.51]) by mx2.math.uh.edu with esmtp (Exim 4.72) (envelope-from ) id 1P8gZd-0000Y4-2B for ding@lists.math.uh.edu; Wed, 20 Oct 2010 16:51:57 -0500 Original-Received: from eagle.jhcloos.com ([207.210.242.212]) by quimby.gnus.org with esmtp (Exim 3.36 #1 (Debian)) id 1P8gZc-0002Av-00 for ; Wed, 20 Oct 2010 23:51:52 +0200 Original-Received: by eagle.jhcloos.com (Postfix, from userid 10) id 7BF3E400CF; Wed, 20 Oct 2010 21:51:16 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=jhcloos.com; s=eagle; t=1287611500; bh=1OPAGnO2F3TaCrkLDTouR0Gkn81M3+UjhBYPfpz7Bjw=; h=From:To:Subject:In-Reply-To:References:Date:Message-ID: MIME-Version:Content-Type:Content-Transfer-Encoding; b=uoqIRpAWKOjlVt7DAFc3nY16By56al9OWo+Z67fkmLgPEgr6ZIHs78CPxlDNF2xGl H+ZGp//7D+uuf8nwa8WCRjL2voZeAiv+HVLwV7f5hxlm5CBfCpeli+bdGpOLV6lvJH ++4IbMMoUIRbRiVwtzL9j9dYTu+Fn8h5RpdDFYsw= Original-Received: from carbon.jhcloos.org (localhost [127.0.0.1]) by carbon.jhcloos.org (Postfix) with ESMTP id 8BC0A1E7E2C for ; Wed, 20 Oct 2010 18:47:34 +0000 (UTC) In-Reply-To: (Lars Magne Ingebrigtsen's message of "Wed, 20 Oct 2010 02:07:25 +0200") User-Agent: Gnus/5.110011 (No Gnus v0.11) Emacs/24.0.50 (gnu/linux) Face: iVBORw0KGgoAAAANSUhEUgAAABAAAAAQCAYAAAAf8/9hAAAABHNCSVQICAgIfAhkiAAAAI1J REFUOE+lU9ESgCAIg64P1y+ngUdxhl5H8wFbbM0OmUiEhKkCYaZThXCo6KE5sCbA1DDX3genvO4d eBQgEMaM5qy6uWk4SfBYfdu9jvBN9nSVDOKRtwb+I3epboOsOX5pZbJNsBJFvmQQ05YMfieIBnYX FK2N6dOawd97r/e8RjkTLzmMsiVgrAoEugtviCM3v2WzjgAAAABJRU5ErkJggg== Copyright: Copyright 2009 James Cloos OpenPGP: ED7DAEA6; url=http://jhcloos.com/public_key/0xED7DAEA6.asc OpenPGP-Fingerprint: E9E9 F828 61A4 6EA9 0F2B 63E7 997A 9F17 ED7D AEA6 Original-Lines: 29 X-Hashcash: 1:30:101020:ding@gnus.org::qyJ5k7t9A2VW4Zo4:000Vimqx X-Spam-Score: -0.2 (/) List-ID: Precedence: bulk Xref: news.gmane.org gmane.emacs.gnus.general:73385 Archived-At: >>>>> "LMI" =3D=3D Lars Magne Ingebrigtsen writes: LMI> What do you mean by "20k vs 2k"? The amount of data returned would = be LMI> the same, anyway, wouldn't it? 20000 groups vs 2000 groups. The amount of data is the same, it just takes longer to grab it one group at a time than all at once. Part of the extra delay is the extra round trips. Part of it is that scanning the tables and indices for one group takes nearly as long as scanning them for all of the groups. Even if I create a sql fucntion which grabs the list of groups (the UIDVALIDITY values in IMAP) and then iterates through that list one UIDVALIDITY at a time, grabbing that groups data, it still takes on the order of 20ms per group. But grabbing all of that data at once takes something like 25=B5s per group. I did get working list-status support added to my dbmail. I now want to add a TAGS return type to list all of the tags, too. I think I can follow you new nnimap well enough to propose a patch to use list-status and list-tags. (I prefer C or Perl, am far from illiterate in lisp, but the old nnimap.el/imap.el bested me when I tried to debug the two or three non-speed-related bugs which I hit.) -JimC --=20 James Cloos OpenPGP: 1024D/ED7DAEA6