Gnus development mailing list
 help / color / mirror / Atom feed
From: Jorge Godoy <godoy@conectiva.com>
Subject: Re: db-backed mail back end
Date: Tue, 22 Jan 2002 23:34:57 -0200	[thread overview]
Message-ID: <conectiva-linux.kp1yghetoe.fsf@godoy.laptop> (raw)
In-Reply-To: <m3665tvr7g.fsf@quimbies.gnus.org> (Lars Magne Ingebrigtsen's message of "Wed, 23 Jan 2002 01:36:19 +0100")

[-- Attachment #1: Type: text/plain, Size: 1083 bytes --]

Lars Magne Ingebrigtsen <larsi@gnus.org> writes:

> If we were to design a mail back end that's supposed to scale to
> several hundred thousands of messages in thousands of groups -- how
> would we do that?  Perhaps somebody has pondered this question
> before.  :-)

The biggest problem to me seems to be disk access and memory usage
(this is in fact an Emacs problem and it's not restricted to
Gnus...). I'd go for some optimization in the way informatio is stored
and retrieved, trying to minimize I/O in big groups (I feel the
performance problem with groups in the 40K+ messages range...). 

Storing the marks on a separate file and using indices for messages
was indeed a good idea. We should try separating all the information
of a group into it's subdirectory (I use nnml).

Implementing Maildir support would also be interesting, since it would
prevent Gnus from copying all the messages to a temporary file before
splitting them. 

-- 
Godoy. <godoy@conectiva.com>

Escritório de Projetos		-- 	  Conectiva S.A.
Projects Office			--	  Conectiva Inc.

[-- Attachment #2: Type: application/pgp-signature, Size: 268 bytes --]

  parent reply	other threads:[~2002-01-23  1:34 UTC|newest]

Thread overview: 102+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2002-01-22 23:33 Lars Magne Ingebrigtsen
2002-01-23  0:23 ` Daniel Pittman
2002-01-23  0:36   ` Lars Magne Ingebrigtsen
2002-01-23  0:49     ` Henrik Enberg
2002-01-23  1:36       ` Jorge Godoy
2002-01-23  1:34     ` Jorge Godoy [this message]
2002-01-23  2:39     ` John S. J. Anderson
2002-01-24  1:18       ` Lars Magne Ingebrigtsen
2002-01-25 14:37         ` Randal L. Schwartz
2002-01-23  3:46     ` Daniel Pittman
2002-01-24  0:51       ` Russ Allbery
2002-01-23  8:52     ` Simon Josefsson
2002-01-26 20:55       ` Steinar Bang
2002-01-23 11:45     ` Per Abrahamsen
2002-01-23 14:11       ` Kai Großjohann
2002-01-23 14:26     ` Mark Milhollan
2002-01-24  1:19       ` Lars Magne Ingebrigtsen
2002-01-23 17:50     ` Paul Jarc
2002-01-24  0:50     ` Russ Allbery
2002-01-24  1:24       ` Lars Magne Ingebrigtsen
2002-01-24  1:49         ` Daniel Pittman
2002-01-24  8:36           ` Lars Magne Ingebrigtsen
2002-01-24  8:58             ` Kai Großjohann
2002-01-24  9:28               ` Lars Magne Ingebrigtsen
2002-01-24 10:37                 ` Kai Großjohann
2002-01-24 17:11         ` Paul Jarc
2002-01-24 17:58           ` nnmaildir (was: db-backed mail back end) Josh Huber
2002-01-24 18:14             ` Harry Putnam
2002-01-24 18:43               ` Paul Jarc
2002-01-24 22:05                 ` Harry Putnam
2002-01-24 22:51                   ` nnmaildir Paul Jarc
2002-01-24 18:39             ` nnmaildir Paul Jarc
2002-01-24  9:14       ` db-backed mail back end Sean Neakums
2002-01-24  9:59         ` Per Abrahamsen
2002-01-24 10:03           ` Lars Magne Ingebrigtsen
2002-01-24 10:24           ` Sean Neakums
2002-01-24 11:49             ` Jorge Godoy
2002-01-24 11:32           ` Simon Josefsson
2002-01-24 11:58             ` Karl Kleinpaste
2002-01-24 12:11               ` Lars Magne Ingebrigtsen
2002-01-24 12:15                 ` Lars Magne Ingebrigtsen
2002-01-24 12:54                   ` Karl Kleinpaste
2002-01-24 15:05                     ` Lars Magne Ingebrigtsen
2002-01-24 20:40                       ` Karl Kleinpaste
2002-01-25  1:28                         ` Lars Magne Ingebrigtsen
2002-01-25  2:17                           ` Karl Kleinpaste
2002-01-25  2:42                             ` Lars Magne Ingebrigtsen
2002-01-25  3:23                               ` Karl Kleinpaste
2002-01-25  3:34                                 ` Lars Magne Ingebrigtsen
2002-01-25  3:37                                 ` Daniel Pittman
2002-01-25  4:19                                   ` Karl Kleinpaste
2002-01-25  4:47                                     ` Lars Magne Ingebrigtsen
2002-01-25  9:23                                       ` Kai Großjohann
2002-01-25  9:30                                         ` Kai Großjohann
2002-01-25  9:35                                           ` Lars Magne Ingebrigtsen
2002-01-25  9:58                                             ` Kai Großjohann
2002-01-25 10:04                                               ` Kai Großjohann
2002-01-25 10:15                                                 ` Lars Magne Ingebrigtsen
2002-01-25 12:12                                                   ` Kai Großjohann
2002-01-25 12:19                                                     ` Lars Magne Ingebrigtsen
2002-01-25 13:15                                                       ` Kai Großjohann
2002-01-25 13:59                                                         ` Lars Magne Ingebrigtsen
2002-01-25 15:43                                                           ` Kai Großjohann
     [not found]                                                             ` <m3y9immn0r.fsf@quimbies.gnus.org>
     [not found]                                                               ` <m3u1tammvs.fsf@quimbies.gnus.org>
2002-01-25 17:01                                                                 ` Kai Großjohann
     [not found]                                                               ` <2nbsfitmtx.fsf@zsh.cs.rochester.edu>
2002-01-25 17:19                                                                 ` Lars Magne Ingebrigtsen
2002-01-25 17:33                                                                   ` Lars Magne Ingebrigtsen
2002-01-26 11:12                                                                     ` Lars Magne Ingebrigtsen
2002-01-26 11:31                                                                       ` Lars Magne Ingebrigtsen
2002-01-26 19:03                                                                         ` Lars Magne Ingebrigtsen
2002-01-27  1:29                                                                           ` Raja R Harinath
2002-01-27  1:39                                                                             ` Lars Magne Ingebrigtsen
2002-01-26 22:17                                                                         ` Christoph Conrad
2002-01-28 14:25                                                                       ` Jan Vroonhof
2002-01-29  2:34                                                                         ` Russ Allbery
2002-01-26 21:10                                                                     ` Kai Großjohann
2002-01-25  5:32                                     ` Daniel Pittman
2002-01-25  4:29                                   ` Lars Magne Ingebrigtsen
2002-01-25  5:16                                     ` Lars Magne Ingebrigtsen
2002-01-25  5:29                                       ` Lars Magne Ingebrigtsen
2002-01-25  5:39                                       ` Daniel Pittman
2002-01-25  5:48                                         ` Lars Magne Ingebrigtsen
2002-01-25  7:05                                 ` Justin Sheehy
2002-01-28 12:56                                 ` Jorge Godoy
2002-01-24 16:13                     ` Frank Schmitt
2002-01-24 18:36                       ` Simon Josefsson
2002-01-24 12:29               ` Simon Josefsson
2002-01-25 14:40                 ` Randal L. Schwartz
2002-01-24 13:50               ` Zlatko Calusic
2002-01-24 22:27                 ` Zlatko Calusic
2002-01-25  2:57                 ` Lars Magne Ingebrigtsen
2002-01-25  4:42                   ` Lars Magne Ingebrigtsen
2002-01-24 14:51               ` Kai Großjohann
2002-01-24 17:14           ` Paul Jarc
2002-01-24 17:52             ` Per Abrahamsen
2002-01-23  0:53 ` Nevin Kapur
2002-01-23  1:29 ` Jorge Godoy
2002-01-23  1:45   ` Lars Magne Ingebrigtsen
2002-01-23  2:33     ` Jorge Godoy
2002-01-24  1:13       ` Lars Magne Ingebrigtsen
2002-01-24  2:05         ` Jorge Godoy
2002-01-24  8:39           ` Lars Magne Ingebrigtsen
2002-01-27 22:32 ` Rob Browning

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=conectiva-linux.kp1yghetoe.fsf@godoy.laptop \
    --to=godoy@conectiva.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).