From mboxrd@z Thu Jan 1 00:00:00 1970 X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on inbox.vuxu.org X-Spam-Level: X-Spam-Status: No, score=-2.1 required=5.0 tests=DKIM_INVALID,DKIM_SIGNED, RCVD_IN_DNSWL_MED,RCVD_IN_MSPIKE_H3,RCVD_IN_MSPIKE_WL autolearn=ham autolearn_force=no version=3.4.4 Received: (qmail 27482 invoked from network); 26 Jan 2021 22:06:46 -0000 Received: from mx1.math.uh.edu (129.7.128.32) by inbox.vuxu.org with ESMTPUTF8; 26 Jan 2021 22:06:46 -0000 Received: from lists1.math.uh.edu ([129.7.128.208]) by mx1.math.uh.edu with esmtps (TLS1.3) tls TLS_AES_256_GCM_SHA384 (Exim 4.94) (envelope-from ) id 1l4WU0-003zNP-Ma for ml@inbox.vuxu.org; Tue, 26 Jan 2021 16:06:44 -0600 Received: from localhost ([127.0.0.1] helo=lists.math.uh.edu) by lists1.math.uh.edu with smtp (Exim 4.94) (envelope-from ) id 1l4WU0-008jRc-41 for ml@inbox.vuxu.org; Tue, 26 Jan 2021 16:06:44 -0600 Received: from mx1.math.uh.edu ([129.7.128.32]) by lists1.math.uh.edu with esmtps (TLS1.3) tls TLS_AES_256_GCM_SHA384 (Exim 4.94) (envelope-from ) id 1l4WSR-008jQV-VN for ding@lists.math.uh.edu; Tue, 26 Jan 2021 16:05:07 -0600 Received: from quimby.gnus.org ([95.216.78.240]) by mx1.math.uh.edu with esmtps (TLS1.3) tls TLS_AES_256_GCM_SHA384 (Exim 4.94) (envelope-from ) id 1l4WSQ-003zMd-42 for ding@lists.math.uh.edu; Tue, 26 Jan 2021 16:05:07 -0600 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnus.org; s=20200322; h=Content-Type:MIME-Version:Message-ID:Date:Subject:To:From: Sender:Reply-To:Cc:Content-Transfer-Encoding:Content-ID:Content-Description: Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID: In-Reply-To:References:List-Id:List-Help:List-Unsubscribe:List-Subscribe: List-Post:List-Owner:List-Archive; bh=9HNTnGEQQyKMMT2MVaDYOvgZXFFN5RzsvKREUWOO0BU=; b=SMuB2nJU7y0EcLavnKFtBX+4tB iprgRXhfg7dEyx1iZNSNpjW7Xhf51NhzivtS8CiwCVX6IIlTHI5ET956kEtQhUly+K2cY03tJ6Yk/ W8iayzBsZ4EOM2/nm32fZWCwoeE9TMDVRTmPPO6QjLyK4A1tk1YXcXI8ZbI+gcExdzF4=; Received: from jfimail.uchicago.edu ([128.135.10.37]) by quimby.gnus.org with esmtp (Exim 4.92) (envelope-from ) id 1l4WSH-0005l3-6M for ding@gnus.org; Tue, 26 Jan 2021 23:05:01 +0100 Received: from jfimail (jfimail.uchicago.edu [128.135.10.37]) by jfimail.uchicago.edu (Postfix) with ESMTP id 5CE91B63403A for ; Tue, 26 Jan 2021 16:04:55 -0600 (CST) X-Virus-Scanned: amavisd-new at jfi.uchicago.edu Received: from jfimail.uchicago.edu ([128.135.10.37]) by jfimail (jfimail.uchicago.edu [128.135.10.37]) (amavisd-new, port 10024) with ESMTP id TGIIJZlDvREy for ; Tue, 26 Jan 2021 16:04:54 -0600 (CST) Received: from village (c-67-165-190-190.hsd1.il.comcast.net [67.165.190.190]) by jfimail.uchicago.edu (Postfix) with ESMTPSA id BA072B634033 for ; Tue, 26 Jan 2021 16:04:54 -0600 (CST) From: Brent Busby To: ding@gnus.org Subject: X-Gnus-Article-Number cleanup Organization: The James Franck Institute Date: Tue, 26 Jan 2021 16:04:40 -0600 Message-ID: <8xxr1m7iccn.fsf@jfi.uchicago.edu> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.1 (gnu/linux) MIME-Version: 1.0 Content-Type: multipart/signed; boundary="=-=-="; micalg=pgp-sha256; protocol="application/pgp-signature" List-ID: Precedence: bulk --=-=-= Content-Type: text/plain Content-Transfer-Encoding: quoted-printable I'm writing a small Perl script (which would probably be more apropos in Lisp, but I'm not good at Lisp) to cleanup Berkeley mbox format mailboxes for Gnus after they've been edited by other mailreaders like Alpine and Mutt. Sometimes I find this is necessary even when other mailreaders haven't done anything to the mailbox, as when copying a message into an nnfolder within Gnus that came from elsewhere in Gnus, like copying a message from a Usenet newsgroup or a different nnfolder, using the gnus-summary-move-article or gnus-summary-copy-article commands (B m or B c). The problem seems to be that if a message doesn't have the X-Gnus-Article-Number header in a mailbox where all the preceeding messages before it all _did_ have that header, the message that's missing it and all messages after that will be invisible in Gnus. This also seems to happen if a message somehow gets a X-Gnus-Article-Number that's out of sequence, lower in number than its preceeding messages in the same mailbox. The Xref header seems to be correlated here too. Using 'B m' or 'B c' seems to have a very high likelyhood of messages retaining their old metadata in the destination, and becoming invisible in the destination folder because the old header contains data that's now inapplicable or wrong in the new one. I've been trying to figure out what to do to repair mailboxes like this so Gnus will see all of them again. Using sed to completely get rid of all X-Gnus-Article-Number and/or Xref lines and then doing meta-g on the group seems to work, but also seems a little brutal. All of this makes it very hazardous to move messages around between mailboxes, especially if copying into an existing nnfolder, even within Gnus, with no involvement from any other mailreaders. It becomes necessary to do header cleanup afterward to make all messages visible again. What do you think would be the recommended way to hammer a mailbox's Gnus metadata back into shape in situations like these? =2D-=20 + Brent A. Busby + "We've all heard that a million monkeys + Sr. UNIX Systems Admin + banging on a million typewriters will + University of Chicago + eventually reproduce the entire works of + James Franck Institute + Shakespeare. Now, thanks to the Internet, + Materials Research Ctr + we know this is not true." -Robert Wilensky --=-=-= Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQHLBAEBCAA1FiEE9U2VYkjghZBPQ2fODYoMhip6u7UFAmAQkfgXHGJyZW50QGpm aS51Y2hpY2Fnby5lZHUACgkQDYoMhip6u7XH4wv/XmT7vIi4he2wXA5vfk4+5bCh KTHpOzaXTf8VeBpuoNVmq5e+o9LoeeFWtXZ5qKXqGFxtZdBHqjJRd56Q4BeCfB8b pwPJmbuGqhce07Q4pnbg7x7gtH10fBRJPjl34tbbx5F/RWOPDtOIzB0TbmJ/J/VO fLUj6Zv1vNwecOr6VPQmzKa/JTJRk0LzYwbFK2JMgh3ExhcBjdRwEpCvFSzo3Jm4 vFjfZ9XGKhb0ODD6nvaN4P2TTIMDN9+o/pNyy9wq/2E0g8pxjdaTWS3iv+jnThNT kg9tYK6onl1JzE7R8PBg24Wngl6qGvawptZfQFgIZctVrf0nEEf3IRprtRQdsE1V XORHX9QpzXUJ8JOuY4GqRCOE50EdKaPq3zfKscdWI4gxrZIKjzHAo8KOfi3JVbvk grOwYILvpKSBqmhMVS9pnpdQb77AKOqmcCdal8UQGysbUVnUj+D/5W+ylUxyhrOu n4BRzfm3XPCx4OLlYFj2xLHzlPaAbd8bOY9FnlPn =cCpq -----END PGP SIGNATURE----- --=-=-=--