Gnus development mailing list
 help / color / mirror / Atom feed
From: James Cloos <cloos@jhcloos.com>
To: ding@gnus.org
Subject: Re: Faster, lolcat.  Faster!
Date: Sat, 04 Sep 2010 18:01:24 -0400	[thread overview]
Message-ID: <m3eid9uq0j.fsf@carbon.jhcloos.org> (raw)
In-Reply-To: <m3occd9sbh.fsf@quimbies.gnus.org> (Lars Magne Ingebrigtsen's message of "Sat, 04 Sep 2010 22:17:38 +0200")

[Replying to a random article in the thread]

With imap startup now takes about twice as long as it used to.

And emacs must be sending the imap commands slower, too, since there is
more idle time.

The backend psql process used to max out a core (as seen in top(1); it
is really waiting on ram for most of that time) and take about 4/9
seconds per group between the initial run thorugh, the lsub, and the
second run through.

Now it only hits about 85% in top(1), and it still ran through the
groups twice.  (The mean was 5.5 imap commands per group.  The startup
runs an EXAMIME and a STATUS on each group and, if there are messages,
a FETCH to get the list of message UIDs.  If it went through twice,
that suggests that about half of the groups were empty.  That sounds
reasonable.)

One speedup would be to do the EXAMINE/STATUS/FETCH all on one packet,
instead of one packet per command.

But it still needs to learn to do the lsub first, when collecting the
list of groups, and then do a single EXAMINE/STATUS/FETCH tuple for
each group.  And then subscribe the new ones if that option is set.

I've looked at the code in the past, but although some parts of gnus are
easy to follow, some are very much not.  I never saw the proper solution,
code-wise, when I looked at it....

-JimC
-- 
James Cloos <cloos@jhcloos.com>         OpenPGP: 1024D/ED7DAEA6





  reply	other threads:[~2010-09-04 22:01 UTC|newest]

Thread overview: 79+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2010-09-02  2:22 Lars Magne Ingebrigtsen
2010-09-02  2:41 ` Ted Zlatanov
2010-09-02  2:52   ` Lars Magne Ingebrigtsen
2010-09-02  4:48 ` Daniel Pittman
2010-09-02 14:26   ` Lars Magne Ingebrigtsen
2010-09-02 19:44   ` Russ Allbery
2010-09-02  5:20 ` David Engster
2010-09-02 14:15   ` Lars Magne Ingebrigtsen
2010-09-15 22:53   ` Tom Tromey
2010-09-02  7:29 ` Steinar Bang
2010-09-02 10:36 ` Ted Zlatanov
2010-09-02 11:10   ` Julien Danjou
2010-09-02 11:44     ` Frank Schmitt
2010-09-02 13:00       ` David Engster
2010-09-02 13:27         ` Ted Zlatanov
2010-09-02 14:23           ` Lars Magne Ingebrigtsen
2010-09-02 14:39             ` David Engster
2010-09-03 12:49               ` request-group-articles for nnimap (was: Faster, lolcat. Faster!) Ted Zlatanov
2010-09-03 18:10                 ` request-group-articles for nnimap David Engster
2010-09-03 18:27                   ` Lars Magne Ingebrigtsen
2010-09-07 15:45                   ` Ted Zlatanov
2010-09-02 14:17   ` Faster, lolcat. Faster! Lars Magne Ingebrigtsen
2010-09-03 12:44     ` Ted Zlatanov
2010-09-03 13:08       ` Lars Magne Ingebrigtsen
2010-09-02 11:13 ` Julien Danjou
2010-09-02 12:44   ` Ted Zlatanov
2010-09-02 13:04     ` Julien Danjou
2010-09-02 13:15       ` Adam Sjøgren
2010-09-02 13:23       ` Ted Zlatanov
2010-09-02 13:25       ` Steinar Bang
2010-09-02 17:10 ` James Cloos
2010-09-03 16:59   ` Lars Magne Ingebrigtsen
2010-09-02 22:33 ` Romain Francoise
2010-09-03 17:01   ` Lars Magne Ingebrigtsen
2010-09-04 17:20     ` Lars Magne Ingebrigtsen
2010-09-04 17:57       ` Lars Magne Ingebrigtsen
2010-09-04 18:31         ` Adam Sjøgren
2010-09-04 18:34           ` Lars Magne Ingebrigtsen
2010-09-04 18:45             ` Adam Sjøgren
2010-09-04 18:48               ` Adam Sjøgren
2010-09-04 18:53                 ` Lars Magne Ingebrigtsen
2010-09-04 21:30                   ` Lars Magne Ingebrigtsen
2010-09-04 21:36                     ` Lars Magne Ingebrigtsen
2010-09-04 21:57                       ` Lars Magne Ingebrigtsen
2010-09-04 22:45                         ` Lars Magne Ingebrigtsen
2010-09-04 22:50                           ` Lars Magne Ingebrigtsen
2010-09-04 23:03                             ` Adam Sjøgren
2010-09-05  0:19                               ` Lars Magne Ingebrigtsen
2010-09-05 11:58                                 ` Adam Sjøgren
2010-09-05  9:10                             ` Romain Francoise
2010-09-05  9:59                               ` Steinar Bang
2010-09-05  9:06                     ` Romain Francoise
2010-09-05 11:31                       ` Lars Magne Ingebrigtsen
2010-09-05 12:44                         ` Romain Francoise
2010-09-05 12:58                           ` Lars Magne Ingebrigtsen
2010-09-04 18:50               ` Adam Sjøgren
2010-09-04 19:31                 ` Adam Sjøgren
2010-09-04 19:49       ` Romain Francoise
2010-09-04 19:57         ` Lars Magne Ingebrigtsen
2010-09-04 20:08           ` Lars Magne Ingebrigtsen
2010-09-04 20:17             ` Lars Magne Ingebrigtsen
2010-09-04 22:01               ` James Cloos [this message]
2010-09-04 22:14                 ` Lars Magne Ingebrigtsen
2010-09-05 21:25                   ` James Cloos
2010-09-05 22:21                     ` Lars Magne Ingebrigtsen
2010-09-06 19:05                       ` James Cloos
2010-09-06 19:58                         ` Lars Magne Ingebrigtsen
2010-09-05 22:41                     ` Lars Magne Ingebrigtsen
2010-09-05 22:48                       ` Lars Magne Ingebrigtsen
2010-09-04 23:10                 ` Steinar Bang
2010-09-04 22:44               ` Romain Francoise
2010-09-04 22:47                 ` Lars Magne Ingebrigtsen
2010-09-04 20:12           ` Adam Sjøgren
2010-09-04 22:16           ` Romain Francoise
2010-09-04 23:00             ` Lars Magne Ingebrigtsen
2010-09-05  8:59               ` Romain Francoise
2010-09-05 11:29                 ` Lars Magne Ingebrigtsen
2010-09-04 22:37       ` Steinar Bang
2010-09-04 22:44         ` Lars Magne Ingebrigtsen

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=m3eid9uq0j.fsf@carbon.jhcloos.org \
    --to=cloos@jhcloos.com \
    --cc=ding@gnus.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).