From mboxrd@z Thu Jan  1 00:00:00 1970
X-Msuck: nntp://news.gmane.io/gmane.emacs.gnus.user/5147
Path: news.gmane.org!not-for-mail
From: David Z Maze <dmaze@mit.edu>
Newsgroups: gmane.emacs.gnus.user
Subject: Duplicate suppression, other processing at split time
Date: Wed, 01 Jun 2005 15:41:11 -0400
Organization: Massachusetts Institute of Technology
Message-ID: <y68d5r5rhk8.fsf@biohazard-cafe.mit.edu>
NNTP-Posting-Host: main.gmane.org
Mime-Version: 1.0
Content-Type: text/plain; charset=us-ascii
X-Trace: sea.gmane.org 1138670942 26266 80.91.229.2 (31 Jan 2006 01:29:02 GMT)
X-Complaints-To: usenet@sea.gmane.org
NNTP-Posting-Date: Tue, 31 Jan 2006 01:29:02 +0000 (UTC)
Original-X-From: nobody Tue Jan 17 17:34:51 2006
Original-Path: quimby.gnus.org!news.ccs.neu.edu!news.dfci.harvard.edu!news.cis.ohio-state.edu!news.ems.psu.edu!news.cse.psu.edu!elk.ncren.net!news2.wam.umd.edu!bloom-beacon.mit.edu!senator-bedfellow.mit.edu!dreaderd!not-for-mail
Original-Newsgroups: gnu.emacs.gnus
Face: iVBORw0KGgoAAAANSUhEUgAAADAAAAAwBAMAAAClLOS0AAAAFVBMVEUGBgS83KhoOivUeFmC
 pXj4o39qeFZD1JPmAAACOklEQVR4nE2UQY/bIBCFkVPlbpX0bA2tz7sQcl5SlnsWc7cclv//
 E/oGjNNxokjz8eYxA7HwR9xLKQGRC4eQezqUj7KWnDOzAOB3EjaBKDl4KPARzkvpAIqoUTwI
 a2op6WVoeXHOlfgsnJPM1kl0SdMIFEJ0AaIJshiRhkCsHbC/51LycKDmgiw2jVJy9B9IDPNN
 U5NkSMQoR+c5/zTW3qjZgwg5ylpJ2YT4wubO7FEVEs0NhvPJaqzxDaDS2gUpGUjyDkau9NxB
 fKsmu4Ir2XSpwAjxYwfsfeqlbJwqcAwwcLINxGRWtIhhMEB7ZLoAJudd4aE42e4RCQDjYMXK
 CpS6XOBtNM7EVfPAbRgihfU08Sg9jqIr9G9JJuo70cCty66gwY6kzJ9xIygyJs7mDNQcSEUV
 iPSE1qt5mLgUkcGj8ExTbrvii2CwG3UCQkxUXDUPE03KIqPw8Iq33IBfUcbw/Ez9eeo8VvPr
 qrRNj2RU1DjeaN6cG8c6RKVNnTg+GIDWfAkPBVdK2jC84fCq4n4yik+VNICNtoPlPkScrKmh
 bPw+FIGSYmBrOUPeNfATjajPpFXtMl0Hvyt4imfzqDvC9zZ3cAEYvlt/ADq7rvDbNKj3RuxC
 B7gsZRWzbSAaymNXSPxjia8id1GmV6kUyjDMf9vd3daXAiYFd4GvXNzmaT7AspRyJnoif6Nn
 Ob8UC94fN6KybTSbvB0e46d3Tyzm+I7v4QWW5WGswZulXFNyv/4DGFvqYRv4BxSm28ZwQ4mv
 AAAAAElFTkSuQmCC
X-Face: &OO..E]'&$Q?jm[7H$]lCS"t#FD[|jK.HfvP#![KZ`/,O)lQ(pE<2QS1i~K3+u\{B<n'%(d
 d|ja|1t%=%_:].7%l)O;PM:\cxIW-R^|>h"(4h4G0W#R-F<w'W=/nTBJ;[JQ22WOTpdRFb(D5h(DDu
 Dbg|$2Q8PO#;{s\WB1m&p@k]+Av_E[o78|`D)9{riNWG##4N0b@/id>2zZNO6n\!8bk;tu%)f>y{C`
 P*^7yM`e/x"b1q[?^-9zxT<CwoP1xRL>p
User-Agent: Gnus/5.110004 (No Gnus v0.4) Emacs/21.3 (usg-unix-v)
Cancel-Lock: sha1:mgn+tJvUQCC0ORyKyVa9Lc3VvgU=
Original-NNTP-Posting-Host: BIOHAZARD-CAFE.MIT.EDU
Original-X-Trace: 1117654871 senator-bedfellow.mit.edu 567 18.7.16.75
Original-Xref: bridgekeeper.physik.uni-ulm.de gnus-emacs-gnus:5289
Original-Lines: 22
X-Gnus-Article-Number: 5289   Tue Jan 17 17:34:51 2006
Xref: news.gmane.org gmane.emacs.gnus.user:5147
Archived-At: <http://permalink.gmane.org/gmane.emacs.gnus.user/5147>

If I wind up with the same message delivered to me twice, can I cause
the second message to get dropped at split time?  (In particular using
nnimap-split-fancy, but I could probably adapt other techniques people
have for doing this.)  Is other processing possible?

The particular problem I have is people sending messages without
Message-Id to multiple lists that I'm on.  Then Gnus sorts each of the
copies into each of the lists in the To: line.  But, since there's no
Message-Id, duplicate suppression never trips, and I wind up seeing
n^2 copies of the message; if n is 3 or 4 this gets really annoying.
Another part of our local mail pipeline inserts a string that has the
right properties to be the Message-Id, so first I'd like to copy that
header value to Message-Id if there isn't already one, then do dup
suppression by Message-Id, *then* split.

(Procmail scares me -- I understand what Gnus does, and
nn*-split-fancy is kind of elegant in its own way -- but I think it is
an option, if this is something easy to do there.)

Thanks,

  --dzm