Gnus development mailing list
 help / color / mirror / Atom feed
From: James Cloos <cloos@jhcloos.com>
To: ding@gnus.org
Subject: Re: fast list
Date: Wed, 20 Oct 2010 14:47:34 -0400	[thread overview]
Message-ID: <m3wrpc3dlt.fsf@carbon.jhcloos.org> (raw)
In-Reply-To: <m3tykhsp4y.fsf@quimbies.gnus.org> (Lars Magne Ingebrigtsen's message of "Wed, 20 Oct 2010 02:07:25 +0200")

>>>>> "LMI" == Lars Magne Ingebrigtsen <larsi@gnus.org> writes:

LMI> What do you mean by "20k vs 2k"?  The amount of data returned would be
LMI> the same, anyway, wouldn't it?

20000 groups vs 2000 groups.

The amount of data is the same, it just takes longer to grab it one
group at a time than all at once.  Part of the extra delay is the extra
round trips.  Part of it is that scanning the tables and indices for
one group takes nearly as long as scanning them for all of the groups.

Even if I create a sql fucntion which grabs the list of groups (the
UIDVALIDITY values in IMAP) and then iterates through that list one
UIDVALIDITY at a time, grabbing that groups data, it still takes on
the order of 20ms per group.  But grabbing all of that data at once
takes something like 25µs per group.

I did get working list-status support added to my dbmail.  I now want
to add a TAGS return type to list all of the tags, too.

I think I can follow you new nnimap well enough to propose a patch to
use list-status and list-tags.  (I prefer C or Perl, am far from
illiterate in lisp, but the old nnimap.el/imap.el bested me when I
tried to debug the two or three non-speed-related bugs which I hit.)

-JimC
-- 
James Cloos <cloos@jhcloos.com>         OpenPGP: 1024D/ED7DAEA6



  reply	other threads:[~2010-10-20 18:47 UTC|newest]

Thread overview: 21+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2010-10-17  5:15 James Cloos
2010-10-17 22:02 ` Lars Magne Ingebrigtsen
2010-10-17 22:58   ` James Cloos
2010-10-18 19:10     ` Lars Magne Ingebrigtsen
2010-10-18 20:49       ` James Cloos
2010-10-18 21:03         ` Lars Magne Ingebrigtsen
2010-10-18 23:17           ` James Cloos
2010-10-18 23:38             ` Lars Magne Ingebrigtsen
2010-10-19 16:00               ` James Cloos
2010-10-19 16:13                 ` Steinar Bang
2010-10-19 18:12                   ` Lars Magne Ingebrigtsen
2010-10-19 20:56                   ` James Cloos
2010-10-19 18:12                 ` Lars Magne Ingebrigtsen
2010-10-19 21:05                   ` James Cloos
2010-10-20  0:07                     ` Lars Magne Ingebrigtsen
2010-10-20 18:47                       ` James Cloos [this message]
2010-10-21 15:59                         ` Lars Magne Ingebrigtsen
2010-10-21 19:13                           ` James Cloos
2010-10-22 14:51                             ` Lars Magne Ingebrigtsen
2010-10-19  5:58           ` Steinar Bang
2010-10-19 18:11             ` Lars Magne Ingebrigtsen

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=m3wrpc3dlt.fsf@carbon.jhcloos.org \
    --to=cloos@jhcloos.com \
    --cc=ding@gnus.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).