From mboxrd@z Thu Jan  1 00:00:00 1970
X-Msuck: nntp://news.gmane.io/gmane.emacs.gnus.general/13696
Path: main.gmane.org!not-for-mail
From: Steinar Bang <sb@metis.no>
Newsgroups: gmane.emacs.gnus.general
Subject: Re: Huge groups
Date: 22 Jan 1998 17:38:41 +0100
Sender: owner-ding@hpc.uh.edu
Message-ID: <when20ihv2.fsf@norne.oslo.metis.no>
References: <yfqiurf3ia3.fsf@acm.org> <ufak9bv7h1g.fsf@sina.hpc.uh.edu> <byvhvfcu5j.fsf@bolzano.math.ethz.ch> <ufa67ne7ids.fsf@sina.hpc.uh.edu> <whvhvec79b.fsf@norne.oslo.metis.no> <m1n2goycge.fsf@no482lin1.aventura.no>
NNTP-Posting-Host: coloc-standby.netfonds.no
Mime-Version: 1.0 (generated by tm-edit 7.105)
Content-Type: text/plain; charset=US-ASCII
X-Trace: main.gmane.org 1035153015 10607 80.91.224.250 (20 Oct 2002 22:30:15 GMT)
X-Complaints-To: usenet@main.gmane.org
NNTP-Posting-Date: Sun, 20 Oct 2002 22:30:15 +0000 (UTC)
Return-Path: <owner-ding@hpc.uh.edu>
Original-Received: from xemacs.org (xemacs.cs.uiuc.edu [128.174.252.16])
	by altair.xemacs.org (8.8.8/8.8.8) with ESMTP id JAA03095
	for <steve@altair.xemacs.org>; Thu, 22 Jan 1998 09:07:03 -0800
Original-Received: from sina.hpc.uh.edu (Sina.HPC.UH.EDU [129.7.3.5])
	by xemacs.org (8.8.5/8.8.5) with ESMTP id LAA04746
	for <steve@xemacs.org>; Thu, 22 Jan 1998 11:04:57 -0600 (CST)
Original-Received: from sina.hpc.uh.edu (Sina.HPC.UH.EDU [129.7.3.5]) by sina.hpc.uh.edu (8.7.3/8.7.3) with ESMTP id KAO02486; Thu, 22 Jan 1998 11:04:55 -0600 (CST)
Original-Received: by sina.hpc.uh.edu (TLB v0.09a (1.20 tibbs 1996/10/09 22:03:07)); Thu, 22 Jan 1998 10:46:24 -0600 (CST)
Original-Received: from claymore.vcinet.com (claymore.vcinet.com [208.205.12.23]) by sina.hpc.uh.edu (8.7.3/8.7.3) with SMTP id KAA02433 for <ding@hpc.uh.edu>; Thu, 22 Jan 1998 10:46:11 -0600 (CST)
Original-Received: (qmail 11741 invoked by uid 504); 22 Jan 1998 16:45:26 -0000
Original-Received: (qmail 11738 invoked from network); 22 Jan 1998 16:45:25 -0000
Original-Received: from abel.metis.no (HELO gw.metis.no) (193.90.64.1)
  by claymore.vcinet.com with SMTP; 22 Jan 1998 16:45:24 -0000
Original-Received: by gw.metis.no (8.8.6/8.8.6) with ESMTP id RAA15437; Thu, 22 Jan 1998 17:44:05 +0100 (MET)
Original-Received: by metis.no (8.8.6/8.8.6) with ESMTP id RAA14786; Thu, 22 Jan 1998 17:44:01 +0100 (MET)
Original-Received: by norne.oslo.metis.no (8.8.4/8.8.4) id RAA26886; Thu, 22 Jan 1998 17:38:41 +0100 (MET)
Original-To: ding@gnus.org
In-Reply-To: Lars Syrstad's message of "22 Jan 1998 12:28:49 +0100"
Original-Lines: 18
X-Mailer: Quassia Gnus v0.15/Emacs 19.34
Precedence: list
X-Majordomo: 1.94.jlt7
Xref: main.gmane.org gmane.emacs.gnus.general:13696
X-Report-Spam: http://spam.gmane.org/gmane.emacs.gnus.general:13696

>>>>> Lars Syrstad <lars@no482rs1.aventura.no>:

>> (I suspect that with the current backend interface this won't give any
>> speedups, since Gnus needs to hold the entire Summary buffer
>> information in memory to do the threading and scoring and stuff. And
>> even without doing any sort of profiling I'm gueesing that there is a
>> performance bottle neck here)

> Any reason why the necessary information to do threading and scoring
> could not go into the Overview-file, which in turns goes into a DBM
> file?

The necessary information is there already.  I just think that the
bottleneck is after this information has been turned into lisp lists
so that Gnus can process it, not in the file format itself, and not in
the reading and the parsing of the .overview file format.

But I haven't profiled anything, so I'm just guessing at this.