From mboxrd@z Thu Jan 1 00:00:00 1970 X-Msuck: nntp://news.gmane.io/gmane.emacs.gnus.general/31407 Path: main.gmane.org!not-for-mail From: Harry Putnam Newsgroups: gmane.emacs.gnus.general Subject: Re: extreme cpu usage with nndir (on specific files) Date: 12 Jun 2000 16:35:24 -0700 Sender: owner-ding@hpc.uh.edu Message-ID: References: <20000612064603.A28095@reader.ptw.com> NNTP-Posting-Host: coloc-standby.netfonds.no Mime-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: quoted-printable X-Trace: main.gmane.org 1035167819 13777 80.91.224.250 (21 Oct 2002 02:36:59 GMT) X-Complaints-To: usenet@main.gmane.org NNTP-Posting-Date: Mon, 21 Oct 2002 02:36:59 +0000 (UTC) Return-Path: Original-Received: from karazm.math.uh.edu (karazm.math.uh.edu [129.7.128.1]) by mailhost.sclp.com (Postfix) with ESMTP id 26F58D051E for ; Mon, 12 Jun 2000 19:59:08 -0400 (EDT) Original-Received: from sina.hpc.uh.edu (lists@Sina.HPC.UH.EDU [129.7.3.5]) by karazm.math.uh.edu (8.9.3/8.9.3) with ESMTP id SAC14716; Mon, 12 Jun 2000 18:58:43 -0500 (CDT) Original-Received: by sina.hpc.uh.edu (TLB v0.09a (1.20 tibbs 1996/10/09 22:03:07)); Mon, 12 Jun 2000 18:57:48 -0500 (CDT) Original-Received: from mailhost.sclp.com (postfix@sclp3.sclp.com [204.252.123.139]) by sina.hpc.uh.edu (8.9.3/8.9.3) with ESMTP id SAA00267 for ; Mon, 12 Jun 2000 18:57:36 -0500 (CDT) Original-Received: from mail.networkone.net (mail.networkone.net [209.144.112.75]) by mailhost.sclp.com (Postfix) with SMTP id 0B142D051E for ; Mon, 12 Jun 2000 19:58:01 -0400 (EDT) Original-Received: (qmail 9741 invoked from network); 12 Jun 2000 23:57:59 -0000 Original-Received: from adsl-117-113.ln.networkone.net (HELO reader.ptw.com) (209.144.117.113) by mail.networkone.net with SMTP; 12 Jun 2000 23:57:59 -0000 Original-Received: (from reader@localhost) by reader.ptw.com (8.9.3/8.9.3) id QAA30262; Mon, 12 Jun 2000 16:57:56 -0700 X-Authentication-Warning: reader.ptw.com: reader set sender to reader@newsguy.com using -f Original-To: ding@gnus.org In-Reply-To: Kai.Grossjohann@CS.Uni-Dortmund.DE's message of "Mon, 12 Jun 2000 22:49:25 +0200" User-Agent: Gnus/5.0807 (Gnus v5.8.7) Emacs/20.5 Original-Lines: 50 Precedence: list X-Majordomo: 1.94.jlt7 Xref: main.gmane.org gmane.emacs.gnus.general:31407 X-Report-Spam: http://spam.gmane.org/gmane.emacs.gnus.general:31407 Kai.Grossjohann@CS.Uni-Dortmund.DE (Kai Gro=DFjohann) writes: > One way to find out what the heck Emacs is doing is to M-x > toggle-debug-on-quit RET, then hit C-g when it takes the long time. > Do this several times, and you might get an idea what takes so long. >=20 > Hm. >=20 > Or maybe M-x elp-instrument-package RET nndir RET? Anybody out there > who groks elp? I found out a little by a different method. First I stripped the=20 `^#! rnews ' line replaced it with `From gnus@rnews'. That didn't help so it wasn't the header with the #! causing the trouble. Next I stripped the Xref header. That helped a lot so that header was causing trouble. Then I began to notice that gnus had created a number of messages from my archive with `nobody' as sender and `no subject'. Checking those messages in the actual archive I found those particular messages had the `From: ' line above the `Path: ' line. Finally I made a small awk program that puts `X-' in front of: X-#! rnews X-Xref: X-Path: Adds my own Path: line with a blank line before it: fix.awk: --------- /^#! / {a=3D1} /^$/ {a=3D0} /^#! rnews/ && a=3D1 \ {print "\nPath: harrys.news.service!verygood!at.home.now\nX-"$0;next} /^Xref: / && a=3D1 {print "X-"$0;next} /^Path: / && a=3D1 {print "X-"$0;next}{print} Gnus liked it... pulled the unsorted complete archive in as a nndoc and sorted it by date and copied to the desired nnml+n2m groups. All handling of these files now take normal amounts of time and I was able to preserver the original headers (sort of). I think the main problem was the Xref: header. Is that likely to give gnus a problem? This all took so long that I think I'll wait till next time to try the approach you suggested.