From mboxrd@z Thu Jan 1 00:00:00 1970 X-Msuck: nntp://news.gmane.io/gmane.emacs.gnus.general/57531 Path: main.gmane.org!not-for-mail From: "Ted Zlatanov" Newsgroups: gmane.emacs.gnus.general Subject: Re: Spam splitting and multiple nnimap methods Date: 19 May 2004 10:48:44 -0400 Organization: =?koi8-r?q?=F4=C5=CF=C4=CF=D2=20=FA=CC=C1=D4=C1=CE=CF=D7?= @ Cienfuegos Sender: ding-owner@lists.math.uh.edu Message-ID: <4nhduch3qr.fsf@lifelogs.com> References: <20040517175042.B23864@gwyn.tux.org> <20040518085316.A4024@gwyn.tux.org> <4nr7thble2.fsf@lifelogs.com> <20040518181911.A3167@gwyn.tux.org> NNTP-Posting-Host: deer.gmane.org Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Trace: sea.gmane.org 1084979161 26616 80.91.224.253 (19 May 2004 15:06:01 GMT) X-Complaints-To: usenet@sea.gmane.org NNTP-Posting-Date: Wed, 19 May 2004 15:06:01 +0000 (UTC) Cc: ding@gnus.org Original-X-From: ding-owner+M6071@lists.math.uh.edu Wed May 19 17:05:54 2004 Return-path: Original-Received: from malifon.math.uh.edu ([129.7.128.13]) by deer.gmane.org with esmtp (Exim 3.35 #1 (Debian)) id 1BQSdl-0006Ta-00 for ; Wed, 19 May 2004 17:05:53 +0200 Original-Received: from localhost ([127.0.0.1] helo=lists.math.uh.edu) by malifon.math.uh.edu with smtp (Exim 3.20 #1) id 1BQSdb-0000oK-00; Wed, 19 May 2004 10:05:43 -0500 Original-Received: from util2.math.uh.edu ([129.7.128.23]) by malifon.math.uh.edu with esmtp (Exim 3.20 #1) id 1BQSdV-0000oF-00 for ding@lists.math.uh.edu; Wed, 19 May 2004 10:05:37 -0500 Original-Received: from justine.libertine.org ([66.139.78.221] ident=postfix) by util2.math.uh.edu with esmtp (Exim 4.30) id 1BQSdU-0006aj-MQ for ding@lists.math.uh.edu; Wed, 19 May 2004 10:05:36 -0500 Original-Received: from mail.bwh.harvard.edu (sysblade0.bwh.harvard.edu [134.174.9.44]) by justine.libertine.org (Postfix) with ESMTP id 87DA43A01FF for ; Wed, 19 May 2004 10:05:35 -0500 (CDT) Original-Received: (qmail 20427 invoked from network); 19 May 2004 14:59:55 -0000 Envelope-Sender: tzz@lifelogs.com Envelope-Recipients: tim@tux.org, ding@gnus.org, Original-Received: from asimov.bwh.harvard.edu (HELO asimov) ([134.174.9.63]) (envelope-sender ) by mail.bwh.harvard.edu (qmail-ldap-1.03) with SMTP for ; 19 May 2004 14:59:39 -0000 Mail-Followup-To: "Timothy Brown" , ding@gnus.org Original-To: "Timothy Brown" X-Face: bd.DQ~'29fIs`T_%O%C\g%6jW)yi[zuz6;d4V0`@y-~$#3P_Ng{@m+e4o<4P'#(_GJQ%TT= D}[Ep*b!\e,fBZ'j_+#"Ps?s2!4H2-Y"sx" In-Reply-To: <20040518181911.A3167@gwyn.tux.org> (Timothy Brown's message of "Tue, 18 May 2004 18:19:11 -0400") User-Agent: Gnus/5.110003 (No Gnus v0.3) Emacs/21.3.50 (gnu/linux) Precedence: bulk Xref: main.gmane.org gmane.emacs.gnus.general:57531 X-Report-Spam: http://spam.gmane.org/gmane.emacs.gnus.general:57531 On Tue, 18 May 2004, tim@tux.org wrote: On Tue, May 18, 2004 at 03:11:49PM -0400, Ted Zlatanov wrote: >> I actually meant to write cross-server splitting, which would allow >> "nnimap+server.com:externalgroup" but I keep forgetting about it. >> No one seems to be clamoring for it, so I guess it's not that >> important. > > Clamor! Clamor! That would be good stuff. You know, the reason I moved > to Gnus is it really handled multiple mailboxes and IMAP servers "well", > and it was the only client to do so and have everything displayed in a > way that made sense, other than Thunderbird which doesn't work for me > due to my reliance on text-based terminals, etc. Cross-server splitting > would, for instance, allow me to treat all messages universally as part > of a single server, thus creating a kind of "IMAP proxy" setup. But perhaps > kibozed groups offer me the same functionality(?) - haven't looked into > this. They don't. If anyone else would like cross-server splitting, speak up. >> > This is one area where Gnus' flexibility is giving me a huge >> > headache - the manual just isn't clear enough. >> >> This is my fault, since I wrote most of the spam support >> documentation. I've had help from several volunteers with the >> manual; if you would like to help as well that would be great. > > I didn't mean to point fingers, but the information you've provided here > has really helped to clarify the process. (But see below...) I'm saying that I would appreciate any volunteer help with the manuals, not that you are being too critical. I often feel like I'm too close to spam.el, so I don't realize how strange and complex its features are to most people. >> You should not split back into INBOX. It's been done, but it's >> unnecessary. Make your last split group "mail" for example and >> you'll be happier. > > The behavior I really want is: > > 1) Go through INBOX, detect whether mail is bogo-spammed or in a blacklist. > a) Move this mail to the spam folder. > > 2) Read the INBOX, and manually mark what bogofilter didn't clue in on as > spam. > > 3) Leave INBOX, and have the remaining mail that's there trained > as ham. I do this, but instead of INBOX I use "mail," and I only train on ham that's misidentified as spam. Your approach to training and spam detection is just as valid. > You mention that I shouldn't split back into INBOX; can you explain why this > is unnecessary and/or bad? I'm trying to figure out why it makes sense > to have to have a different folder as my INBOX (although i'm not against > the idea, i'd like to leave INBOX to its intended purpose and expire mail > into INBOX.mail later) Splitting back into INBOX is, in fact, possible - Uwe Brauer reported back in October 2003 that it works: http://groups.google.com/groups?selm=m3ekxv2ufx.fsf%40maport01.mat.ucm.es&output=gplain but I think you'll do yourself a disservice if you respool back into INBOX. At the very least, you will be respooling the same messages again and again if you don't clear them out of INBOX. Also, all Gnus splitting is oriented towards splitting things out of the INBOX, not filtering in place. But if you want to use INBOX, you can. Just make sure to report any bugs that you observe in the process. >> Each IMAP server with a nnimap server entry in your Gnus setup can >> have its own split rules. This is my setup, for instance: >> >> (setq nnimap-split-rule '( >> ("lifelogs" ("INBOX" nnimap-split-fancy)) >> ("imap" ("INBOX" nnimap-courier-split-fancy)))) >> >> as opposed to the simpler but less useful: >> >> (setq nnimap-split-rule 'nnimap-split-fancy) > > This sheds a ton of light on how nnimap can fancy split using individual > servers, thanks. In these rulesets, you're only specifying folder names > and not fully qualified nn+etc. stuff, right? This really needs > to go into the fancy splitting section or the IMAP section of the > manual. I got the information from C-h v nnimap-split-rule, but it's also in the manual. Maybe it should be more prominent, but I don't know that multiple IMAP servers are a very common configuration. > I follow all this. What isn't clear is what the 'Spam Autodetection' > feature is used for, and/or if it needs to be enabled (in G c), etc. This was answered by Jonas Steverud. It's also in the manual. > This has all been really helpful. To summarize and make this as clear > as possible: > > - I want to scan for spam in every IMAP mailbox I have. > > - If mail appears as spam based on what bogofilter and/or the blackholes rule > knows, then dump it in a spam folder that is individual to that IMAP > server. Later SpamAssassin (via spamc) will be added to the mix. > > - I'll also scan through this folder after it's done, read the mail I want to > read, mark certain things as spam, and treat everything else as ham. > > - Spam and ham will be processed on group exit. > > - It would be great if that folder was 'INBOX', but I understand if it has to > be 'mail'. > > - I don't care about other folders at the moment. > > My only real concerns at this point about the above are the > weirdness i've seen with splitting back to INBOX and never seeing > the messages in Gnus, but I'll bet that is a small problem. OK, I hope you'll come through unscathed :) Remember you can set topic parameters that work just like group parameters. So you can say, for a whole topic, "the spam and ham exit processor is bogofilter" instead of specifying it for each group. That simplifies things. Make sure to keep backups of your INBOX! You can use something like my ifrom tool at http://lifelogs.com/source/ifrom.txt or whatever is appropriate on the server side. In theory no mail should be lost but there's only you and Uwe splitting back into INBOX that I know of. Ted