From mboxrd@z Thu Jan 1 00:00:00 1970 X-Msuck: nntp://news.gmane.io/gmane.emacs.gnus.general/31052 Path: main.gmane.org!not-for-mail From: Harry Putnam Newsgroups: gmane.emacs.gnus.general Subject: generate nov data from the command line Date: 17 May 2000 21:16:58 -0700 Sender: owner-ding@hpc.uh.edu Message-ID: NNTP-Posting-Host: coloc-standby.netfonds.no Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Trace: main.gmane.org 1035167506 11862 80.91.224.250 (21 Oct 2002 02:31:46 GMT) X-Complaints-To: usenet@main.gmane.org NNTP-Posting-Date: Mon, 21 Oct 2002 02:31:46 +0000 (UTC) Return-Path: Original-Received: from lisa.math.uh.edu (lisa.math.uh.edu [129.7.128.49]) by mailhost.sclp.com (Postfix) with ESMTP id D2D4CD051E for ; Thu, 18 May 2000 00:18:00 -0400 (EDT) Original-Received: from sina.hpc.uh.edu (lists@Sina.HPC.UH.EDU [129.7.3.5]) by lisa.math.uh.edu (8.9.1/8.9.1) with ESMTP id XAB09056; Wed, 17 May 2000 23:17:55 -0500 (CDT) Original-Received: by sina.hpc.uh.edu (TLB v0.09a (1.20 tibbs 1996/10/09 22:03:07)); Wed, 17 May 2000 23:17:13 -0500 (CDT) Original-Received: from mailhost.sclp.com (postfix@sclp3.sclp.com [204.252.123.139]) by sina.hpc.uh.edu (8.9.3/8.9.3) with ESMTP id XAA07215 for ; Wed, 17 May 2000 23:17:03 -0500 (CDT) Original-Received: from mail.networkone.net (mail.networkone.net [209.144.112.75]) by mailhost.sclp.com (Postfix) with SMTP id B0FABD051E for ; Thu, 18 May 2000 00:17:15 -0400 (EDT) Original-Received: (qmail 18978 invoked from network); 18 May 2000 04:17:13 -0000 Original-Received: from adsl-117-113.ln.networkone.net (HELO reader.ptw.com) (root@209.144.117.113) by mail.networkone.net with SMTP; 18 May 2000 04:17:13 -0000 Original-Received: (from reader@localhost) by reader.ptw.com (8.9.3/8.9.3) id VAA27126; Wed, 17 May 2000 21:17:11 -0700 Original-To: ding@gnus.org User-Agent: Gnus/5.0804 (Gnus v5.8.4) Emacs/20.5 Original-Lines: 40 Precedence: list X-Majordomo: 1.94.jlt7 Xref: main.gmane.org gmane.emacs.gnus.general:31052 X-Report-Spam: http://spam.gmane.org/gmane.emacs.gnus.general:31052 I asked this question a while back, on gnu.emacs.gnus but never got any suggestions. Here is my delima: I set up a couple of extra nnml servers a while back and have been rsyncing my agent downloads into that hierarchy. It accumulates lots of files, thousands of them. The nnml server handles them well, getting the groups and etc has all worked nicely. The problem comes from the way I'm putting the new messages in behind gnus back. Since there is no fast way to do that job with gnus, I'm doing it with `rsync' then generating the nov data with: nnml-generate-nov-databases by pressing 'g' on the proper server in trhe server buffer. This can be time consuming with this many files, but wouldn't be a problem with cron or just in the backgroud while I do other stuff. I had visions of coming up with a batch command that could be called by an rsync wrapper script. So when rsync is finished, gnus is called in to straighten out the stealth attack. And make crispy new nov data. All this at 2:30am. I see how to call functions in batchmode with the -f flag and how to load files etc, but this is a bit more complicated I think. How can I tell gnus which server to use? These are not the default ones. The line below seems to work on the default nnml server but how to evaluate something to set a different one ... on the command line. emacs -batch -l .emacs -l .gnus -f nnml-generate-nov-databases Two major archives are involved: 330MB and 418MB and 114898 files Gnus can do this in less than 15 minutes, I've never timed it but it's well under 15, but still not something you'd want to wait for.