From mboxrd@z Thu Jan 1 00:00:00 1970 X-Msuck: nntp://news.gmane.io/gmane.emacs.gnus.general/41628 Path: main.gmane.org!not-for-mail From: Steinar Bang Newsgroups: gmane.emacs.gnus.general Subject: Re: large .overview files in agentized nntp groups Date: Sat, 05 Jan 2002 17:31:42 +0100 Organization: Denizens of Doom, Norway Chapter Sender: owner-ding@hpc.uh.edu Message-ID: <87vgegrc7l.fsf@bang.priv.no> References: <87r8p9es7w.fsf@bang.priv.no> <871yh8emp7.fsf@bang.priv.no> <874rm1srjo.fsf@bang.priv.no> NNTP-Posting-Host: coloc-standby.netfonds.no Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Trace: main.gmane.org 1035176995 7196 80.91.224.250 (21 Oct 2002 05:09:55 GMT) X-Complaints-To: usenet@main.gmane.org NNTP-Posting-Date: Mon, 21 Oct 2002 05:09:55 +0000 (UTC) Return-Path: Original-Received: (qmail 6569 invoked from network); 5 Jan 2002 16:33:58 -0000 Original-Received: from malifon.math.uh.edu (mail@129.7.128.13) by mastaler.com with SMTP; 5 Jan 2002 16:33:58 -0000 Original-Received: from sina.hpc.uh.edu ([129.7.128.10] ident=lists) by malifon.math.uh.edu with esmtp (Exim 3.20 #1) id 16MtlT-0003He-00; Sat, 05 Jan 2002 10:33:47 -0600 Original-Received: by sina.hpc.uh.edu (TLB v0.09a (1.20 tibbs 1996/10/09 22:03:07)); Sat, 05 Jan 2002 10:33:40 -0600 (CST) Original-Received: from sclp3.sclp.com (qmailr@sclp3.sclp.com [209.196.61.66]) by sina.hpc.uh.edu (8.9.3/8.9.3) with SMTP id KAA14367 for ; Sat, 5 Jan 2002 10:33:29 -0600 (CST) Original-Received: (qmail 6565 invoked by alias); 5 Jan 2002 16:33:31 -0000 Original-Received: (qmail 6560 invoked from network); 5 Jan 2002 16:33:30 -0000 Original-Received: from c96s55h3.upc.chello.no (HELO biaggi) (213.46.211.96) by gnus.org with SMTP; 5 Jan 2002 16:33:30 -0000 Original-Received: from sb by biaggi with local (Exim 3.32 #1 (Debian)) id 16MtkZ-0006Gh-00 for ; Sat, 05 Jan 2002 17:32:51 +0100 Original-To: ding@gnus.org In-Reply-To: (Lars Magne Ingebrigtsen's message of "Sat, 05 Jan 2002 06:24:41 +0100") User-Agent: Gnus/5.090005 (Oort Gnus v0.05) Emacs/20.7 (i386-debian-linux-gnu) Original-Lines: 66 Precedence: list X-Majordomo: 1.94.jlt7 Xref: main.gmane.org gmane.emacs.gnus.general:41628 X-Report-Spam: http://spam.gmane.org/gmane.emacs.gnus.general:41628 >>>>> Lars Magne Ingebrigtsen : > Steinar Bang writes: >> 22MB is pretty big. Maybe it's a problem that only occur with very >> large NOV files? There were some 9000-odd cached articles in that >> directory after the expiry, and that's more than a week's worth, >> even on no.alt.motorsykler. > I've got agentized groups with more than 15000 articles in them, and > they seem to be cleaned up OK by the expiry function... Something very strange seem to have happened to my no.alt.motorsykler agent cache on December 30 01:33 through 01:52. 9898 of the currently 10115 articles are dated from 01:33 to 01:52, with the ones around 01:33 being from December 29 and thereabouts, and the ones around 01:52 being from May 2000. > Could you try running it again and look at .overview files > before/after running it, to see whether it works at all for you? I checked some groups. Before After no.alt.motorsykler Articles: 10115 Articles: 2570 .overview: 72118 bytes .overview: 72948 bytes gnu.emacs.gnus Articles: 594 Articles: 578 .overview: 173498 bytes .overview: 81711 bytes ding.gnus Articles: 751 Articles: 578 .overview: 241243 bytes .overview: 190562 The behaviour seems normal, except for that the .overview file of no.alt.motorsykler, which has actually increased in size. I'm guessing that the reason for this is that it has had added the articles from Dec 30, which hasn't yet expired (remember I just removed the NOV file at that point). The reason the NOV file didn't decrease in size on my attempted expiration, was probably that there was no files to expire at that point (ie. the oldest articles were the ones from 01:33 on Dec 30). So I guess the big mystery is what made agent download those 9898 articles. Maybe the 22MB NOV file held some clues? Or maybe it was just to large for my old laptop? Unfortunately I just deleted it in irritation instead of gzip'ing it...:-/ Oh well! Since it isn't reproducible, we'll just have to call it a fluke. BTW what's supposed to happen if you have some old articles ticked in a group, and then agentize it, and then download articles? Is agent supposed to download all the intervening articles between the ticked ones and the current ones? This is what seemed to happen when I agentized the anonymous info-cyrus group on cyrus.andrew.cmu.edu. Or should agent only download the ticked articles? That's what I expected (ie. hoped for).