Gnus development mailing list
 help / color / mirror / Atom feed
From: Karl Kleinpaste <karl@charcoal.com>
Subject: Re: db-backed mail back end
Date: Thu, 24 Jan 2002 06:58:48 -0500	[thread overview]
Message-ID: <vxkelkgm03r.fsf@cinnamon.vanillaknot.com> (raw)
In-Reply-To: <Pine.LNX.4.44.0201241230021.14891-100000@slipsten.extundo.com> (Simon Josefsson's message of "Thu, 24 Jan 2002 12:32:38 +0100 (CET)")

Simon Josefsson <jas@extundo.com> writes:
> NNML scales linearly with the number of messages in the group, does
> it not?  Gnus definitely doesn't scale linearly, so redesigning
> something to get support for large mail/news backends should go into
> Gnus, I think.

I have been wondering about this since this discussion started.  The
slowness of entering a large group of 10K messages, or 100K, has very
little to do with getting at either the overview data or the message
files.  It has to do with threading, scoring, and sorting.  I don't
know what Gnus' threading algorithm is, but I suspect its performance
is at least as poor as O(n log n) and may even be as bad as O(n^2).
It is not clear to me that it is possible to do better than O(n log n)
in the first place, though I haven't contemplated the matter very long.

These are not problems that are addressed at all by the manner in
which articles and indices (overviews or otherwise) are stored, but
rather in how threading is computed, and how scoring is managed.



  reply	other threads:[~2002-01-24 11:58 UTC|newest]

Thread overview: 102+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2002-01-22 23:33 Lars Magne Ingebrigtsen
2002-01-23  0:23 ` Daniel Pittman
2002-01-23  0:36   ` Lars Magne Ingebrigtsen
2002-01-23  0:49     ` Henrik Enberg
2002-01-23  1:36       ` Jorge Godoy
2002-01-23  1:34     ` Jorge Godoy
2002-01-23  2:39     ` John S. J. Anderson
2002-01-24  1:18       ` Lars Magne Ingebrigtsen
2002-01-25 14:37         ` Randal L. Schwartz
2002-01-23  3:46     ` Daniel Pittman
2002-01-24  0:51       ` Russ Allbery
2002-01-23  8:52     ` Simon Josefsson
2002-01-26 20:55       ` Steinar Bang
2002-01-23 11:45     ` Per Abrahamsen
2002-01-23 14:11       ` Kai Großjohann
2002-01-23 14:26     ` Mark Milhollan
2002-01-24  1:19       ` Lars Magne Ingebrigtsen
2002-01-23 17:50     ` Paul Jarc
2002-01-24  0:50     ` Russ Allbery
2002-01-24  1:24       ` Lars Magne Ingebrigtsen
2002-01-24  1:49         ` Daniel Pittman
2002-01-24  8:36           ` Lars Magne Ingebrigtsen
2002-01-24  8:58             ` Kai Großjohann
2002-01-24  9:28               ` Lars Magne Ingebrigtsen
2002-01-24 10:37                 ` Kai Großjohann
2002-01-24 17:11         ` Paul Jarc
2002-01-24 17:58           ` nnmaildir (was: db-backed mail back end) Josh Huber
2002-01-24 18:14             ` Harry Putnam
2002-01-24 18:43               ` Paul Jarc
2002-01-24 22:05                 ` Harry Putnam
2002-01-24 22:51                   ` nnmaildir Paul Jarc
2002-01-24 18:39             ` nnmaildir Paul Jarc
2002-01-24  9:14       ` db-backed mail back end Sean Neakums
2002-01-24  9:59         ` Per Abrahamsen
2002-01-24 10:03           ` Lars Magne Ingebrigtsen
2002-01-24 10:24           ` Sean Neakums
2002-01-24 11:49             ` Jorge Godoy
2002-01-24 11:32           ` Simon Josefsson
2002-01-24 11:58             ` Karl Kleinpaste [this message]
2002-01-24 12:11               ` Lars Magne Ingebrigtsen
2002-01-24 12:15                 ` Lars Magne Ingebrigtsen
2002-01-24 12:54                   ` Karl Kleinpaste
2002-01-24 15:05                     ` Lars Magne Ingebrigtsen
2002-01-24 20:40                       ` Karl Kleinpaste
2002-01-25  1:28                         ` Lars Magne Ingebrigtsen
2002-01-25  2:17                           ` Karl Kleinpaste
2002-01-25  2:42                             ` Lars Magne Ingebrigtsen
2002-01-25  3:23                               ` Karl Kleinpaste
2002-01-25  3:34                                 ` Lars Magne Ingebrigtsen
2002-01-25  3:37                                 ` Daniel Pittman
2002-01-25  4:19                                   ` Karl Kleinpaste
2002-01-25  4:47                                     ` Lars Magne Ingebrigtsen
2002-01-25  9:23                                       ` Kai Großjohann
2002-01-25  9:30                                         ` Kai Großjohann
2002-01-25  9:35                                           ` Lars Magne Ingebrigtsen
2002-01-25  9:58                                             ` Kai Großjohann
2002-01-25 10:04                                               ` Kai Großjohann
2002-01-25 10:15                                                 ` Lars Magne Ingebrigtsen
2002-01-25 12:12                                                   ` Kai Großjohann
2002-01-25 12:19                                                     ` Lars Magne Ingebrigtsen
2002-01-25 13:15                                                       ` Kai Großjohann
2002-01-25 13:59                                                         ` Lars Magne Ingebrigtsen
2002-01-25 15:43                                                           ` Kai Großjohann
     [not found]                                                             ` <m3y9immn0r.fsf@quimbies.gnus.org>
     [not found]                                                               ` <m3u1tammvs.fsf@quimbies.gnus.org>
2002-01-25 17:01                                                                 ` Kai Großjohann
     [not found]                                                               ` <2nbsfitmtx.fsf@zsh.cs.rochester.edu>
2002-01-25 17:19                                                                 ` Lars Magne Ingebrigtsen
2002-01-25 17:33                                                                   ` Lars Magne Ingebrigtsen
2002-01-26 11:12                                                                     ` Lars Magne Ingebrigtsen
2002-01-26 11:31                                                                       ` Lars Magne Ingebrigtsen
2002-01-26 19:03                                                                         ` Lars Magne Ingebrigtsen
2002-01-27  1:29                                                                           ` Raja R Harinath
2002-01-27  1:39                                                                             ` Lars Magne Ingebrigtsen
2002-01-26 22:17                                                                         ` Christoph Conrad
2002-01-28 14:25                                                                       ` Jan Vroonhof
2002-01-29  2:34                                                                         ` Russ Allbery
2002-01-26 21:10                                                                     ` Kai Großjohann
2002-01-25  5:32                                     ` Daniel Pittman
2002-01-25  4:29                                   ` Lars Magne Ingebrigtsen
2002-01-25  5:16                                     ` Lars Magne Ingebrigtsen
2002-01-25  5:29                                       ` Lars Magne Ingebrigtsen
2002-01-25  5:39                                       ` Daniel Pittman
2002-01-25  5:48                                         ` Lars Magne Ingebrigtsen
2002-01-25  7:05                                 ` Justin Sheehy
2002-01-28 12:56                                 ` Jorge Godoy
2002-01-24 16:13                     ` Frank Schmitt
2002-01-24 18:36                       ` Simon Josefsson
2002-01-24 12:29               ` Simon Josefsson
2002-01-25 14:40                 ` Randal L. Schwartz
2002-01-24 13:50               ` Zlatko Calusic
2002-01-24 22:27                 ` Zlatko Calusic
2002-01-25  2:57                 ` Lars Magne Ingebrigtsen
2002-01-25  4:42                   ` Lars Magne Ingebrigtsen
2002-01-24 14:51               ` Kai Großjohann
2002-01-24 17:14           ` Paul Jarc
2002-01-24 17:52             ` Per Abrahamsen
2002-01-23  0:53 ` Nevin Kapur
2002-01-23  1:29 ` Jorge Godoy
2002-01-23  1:45   ` Lars Magne Ingebrigtsen
2002-01-23  2:33     ` Jorge Godoy
2002-01-24  1:13       ` Lars Magne Ingebrigtsen
2002-01-24  2:05         ` Jorge Godoy
2002-01-24  8:39           ` Lars Magne Ingebrigtsen
2002-01-27 22:32 ` Rob Browning

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=vxkelkgm03r.fsf@cinnamon.vanillaknot.com \
    --to=karl@charcoal.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).