From mboxrd@z Thu Jan 1 00:00:00 1970 X-Msuck: nntp://news.gmane.io/gmane.emacs.gnus.general/42563 Path: main.gmane.org!not-for-mail From: Lars Magne Ingebrigtsen Newsgroups: gmane.emacs.gnus.general Subject: Re: db-backed mail back end Date: Fri, 25 Jan 2002 05:29:53 +0100 Organization: Programmerer Ingebrigtsen Sender: owner-ding@hpc.uh.edu Message-ID: References: <87hepbdrsj.fsf@inanna.rimspace.net> NNTP-Posting-Host: coloc-standby.netfonds.no Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Trace: main.gmane.org 1035177787 12505 80.91.224.250 (21 Oct 2002 05:23:07 GMT) X-Complaints-To: usenet@main.gmane.org NNTP-Posting-Date: Mon, 21 Oct 2002 05:23:07 +0000 (UTC) Return-Path: Original-Received: (qmail 406 invoked from network); 25 Jan 2002 04:31:21 -0000 Original-Received: from malifon.math.uh.edu (mail@129.7.128.13) by mastaler.com with SMTP; 25 Jan 2002 04:31:21 -0000 Original-Received: from sina.hpc.uh.edu ([129.7.128.10] ident=lists) by malifon.math.uh.edu with esmtp (Exim 3.20 #1) id 16Ty0i-00059r-00; Thu, 24 Jan 2002 22:30:44 -0600 Original-Received: by sina.hpc.uh.edu (TLB v0.09a (1.20 tibbs 1996/10/09 22:03:07)); Thu, 24 Jan 2002 22:30:36 -0600 (CST) Original-Received: from sclp3.sclp.com (qmailr@sclp3.sclp.com [209.196.61.66]) by sina.hpc.uh.edu (8.9.3/8.9.3) with SMTP id WAA20351 for ; Thu, 24 Jan 2002 22:30:02 -0600 (CST) Original-Received: (qmail 370 invoked by alias); 25 Jan 2002 04:30:01 -0000 Original-Received: (qmail 358 invoked from network); 25 Jan 2002 04:30:00 -0000 Original-Received: from ingebrigtsen.no (HELO quimby2.netfonds.no) (195.204.10.66) by gnus.org with SMTP; 25 Jan 2002 04:30:00 -0000 Original-Received: from news by quimby2.netfonds.no with local (Exim 3.12 #1 (Debian)) id 16Ty1m-00073v-00 for ; Fri, 25 Jan 2002 05:31:50 +0100 Original-To: ding@gnus.org Original-Path: not-for-mail Original-Newsgroups: gnus.ding Original-Lines: 33 Original-NNTP-Posting-Host: quimbies.gnus.org Original-X-Trace: quimby2.netfonds.no 1011933110 26854 195.204.10.148 (25 Jan 2002 04:31:50 GMT) Original-X-Complaints-To: usenet@quimby2.netfonds.no Original-NNTP-Posting-Date: 25 Jan 2002 04:31:50 GMT Mail-Copies-To: never X-Now-Playing: Various's _Chihuahuas And Chinese Noodles_: "Steward - The Last Wasps Of Summer (remixed by Downpour)" User-Agent: Gnus/5.090006 (Oort Gnus v0.06) Emacs/21.1 (i686-pc-linux-gnu) X-Face: <{2!n(s"B#k?bxKIiyRm\;DUFZRAzd:|A}g7B#^^0{^[^[e@p^8j#AW1#iH6x9qXrN3sfPPeu)QP('DcC((aPU-w@(/*i]a$wrs;U.D Cancel-Lock: sha1:AEjXKWIfYkE0C5JeC2WtuYAnZWU= Precedence: list X-Majordomo: 1.94.jlt7 Xref: main.gmane.org gmane.emacs.gnus.general:42563 X-Report-Spam: http://spam.gmane.org/gmane.emacs.gnus.general:42563 Daniel Pittman writes: >> There's certainly no harm to making Gnus able to handle the storage >> needs of gargantuan archives. Sure, knock yourself out. But that's >> not a problem currently being faced by more than maybe 5 people on the >> planet, whereas every single Gnus user has to worry over the entry >> time cost of a busy group with 900 new messages. > > That would be something that would be good to address first. Don't > mistake it for the only problem, though. It's not really an area that's been addressed before, either, so it's an area that can be done something with. Scoring and threading have already been optimized several times. There are lots of new things in Gnus that haven't been particularly optimized. For instance, I just did a new batch of elping, and saw that the `seen' code called `gnus-member-of-range' once per article displayed, which is a hight linear cost. I separated that thing out into its own function and saw that the `gnus-newsgroup-unseen' computation (in a 1000 article summary buffer) took 1 second. So I wrote `gnus-inverse-list-range-intersection', and the computation now takes 0.001426 seconds, says elp. There's a lot of computational complexity in Gnus that needs more eyes. I think it's a safe bet that normal group entry can easily be made a few orders of magnitude faster. (And the view-one-article-in-a- 200K-group can be made hundreds of orders of magnitudes faster.) -- (domestic pets only, the antidote for overdose, milk.) larsi@gnus.org * Lars Magne Ingebrigtsen