From mboxrd@z Thu Jan 1 00:00:00 1970 X-Msuck: nntp://news.gmane.io/gmane.emacs.gnus.general/58399 Path: main.gmane.org!not-for-mail From: Harry Putnam Newsgroups: gmane.emacs.gnus.general Subject: Re: OT [Archive techniques] What to do when it gets massive Date: Sat, 04 Sep 2004 14:37:41 -0500 Organization: Still searching... Sender: ding-owner@lists.math.uh.edu Message-ID: References: <86acw8om36.fsf@ketchup.de.uu.net> NNTP-Posting-Host: deer.gmane.org Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Trace: sea.gmane.org 1094326768 26025 80.91.224.253 (4 Sep 2004 19:39:28 GMT) X-Complaints-To: usenet@sea.gmane.org NNTP-Posting-Date: Sat, 4 Sep 2004 19:39:28 +0000 (UTC) Original-X-From: ding-owner+M6941@lists.math.uh.edu Sat Sep 04 21:39:20 2004 Return-path: Original-Received: from malifon.math.uh.edu ([129.7.128.13]) by deer.gmane.org with esmtp (Exim 3.35 #1 (Debian)) id 1C3gNc-0001FH-00 for ; Sat, 04 Sep 2004 21:39:20 +0200 Original-Received: from localhost ([127.0.0.1] helo=lists.math.uh.edu ident=lists) by malifon.math.uh.edu with smtp (Exim 3.20 #1) id 1C3gMs-0006II-00; Sat, 04 Sep 2004 14:38:34 -0500 Original-Received: from util2.math.uh.edu ([129.7.128.23]) by malifon.math.uh.edu with esmtp (Exim 3.20 #1) id 1C3gMk-0006IC-00 for ding@lists.math.uh.edu; Sat, 04 Sep 2004 14:38:26 -0500 Original-Received: from justine.libertine.org ([66.139.78.221] ident=postfix) by util2.math.uh.edu with esmtp (Exim 4.30) id 1C3gMk-0006II-VM for ding@lists.math.uh.edu; Sat, 04 Sep 2004 14:38:26 -0500 Original-Received: from main.gmane.org (main.gmane.org [80.91.224.249]) by justine.libertine.org (Postfix) with ESMTP id 863033A003C for ; Sat, 4 Sep 2004 14:38:24 -0500 (CDT) Original-Received: from list by main.gmane.org with local (Exim 3.35 #1 (Debian)) id 1C3gMh-0002We-00 for ; Sat, 04 Sep 2004 21:38:23 +0200 Original-Received: from adsl-68-74-68-202.dsl.emhril.ameritech.net ([68.74.68.202]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Sat, 04 Sep 2004 21:38:23 +0200 Original-Received: from reader by adsl-68-74-68-202.dsl.emhril.ameritech.net with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Sat, 04 Sep 2004 21:38:23 +0200 X-Injected-Via-Gmane: http://gmane.org/ Original-To: ding@gnus.org Original-Lines: 24 Original-X-Complaints-To: usenet@sea.gmane.org X-Gmane-NNTP-Posting-Host: adsl-68-74-68-202.dsl.emhril.ameritech.net User-Agent: Gnus/5.110003 (No Gnus v0.3) Emacs/21.3.50 (gnu/linux) Cancel-Lock: sha1:Z1VJBhxpN2SZJUvT/rpdLloAqwI= Precedence: bulk Xref: main.gmane.org gmane.emacs.gnus.general:58399 X-Report-Spam: http://spam.gmane.org/gmane.emacs.gnus.general:58399 Kai Grossjohann writes: > Harry Putnam writes: > >> At some point the size is so large as to make any commands run against >> the massive heap of data take a long time. I'd like to break this >> pile up somehow, but will work on that later. > > Does it help to index this stuff with a search engine? Namazu seems > to be good. > > I have a small dataset only, but I really like it. I also started > using Namazu on my nnml folders, using gnus-namazu.el, and it seems to > be nice. Of courese any indexing would have to be faster for searching. But what I'm after is a way to break up the heap of data by mnths. As I stated that is something that may take some thought and time and was not really the subject here. Ted has offered an applicaton called rsnapshot that looks as if it might be just the ticket. Thanks for your reply.