Re: [Q]: Gmane groups and spam filtering

[Xavier Maillard <zedek@gnu-rox.org>]

Kevin Greiner <kgreiner <at> xpediantsolutions.com> writes:

> > Now I just want to know if my spam-use-gmane-xref is correct since I
> > don't see any difference when set and when not.
> 
> You might find it more informative, and faster, to simply look at the code.

Ok I finally found why it didn't work. Setting it this way: 

              (spam-autodetect-methods spam-use-gmane-xref spam-use-BBDB)
              (spam-autodetect . t)
              (spam-process '(spam spame-use-gmane))
;;               (gnus-group-spam-exit-processor-report-gmane)) ;; obsoleted
              (gnus-agent-consider-all-articles . t)
              (gnus-agent-enable-expiration . (quote (DISABLE)))
              (spam-contents gnus-group-spam-classification-ham)
              (agent-predicate . true) ;; and (not spam) (not old))

But now I see many messages like this one:

/------------------------------------------------------------- 
|Fetching headers for nntp+news.gmane.org:gmane.linux.debian.user...done
|Dictionary used: american in group nntp+news.gmane.org:gmane.linux.debian.user
|[2 times]
|Scoring...done
|Making sparse threads...done
|Sorting threads...done
|Generating summary...done
|spam-split: widening the buffer (spam-use-bogofilter requires it)
|spam-split: calling the spam-check-gmane-xref function
|spam-split: calling the spam-check-BBDB function
|Article 138023 has a nil data header [3 times]
|Article 138023 has no message ID!
|spam-generate-fake-headers: article 138023 didn't have a valid header
|spam-split: widening the buffer (spam-use-bogofilter requires it)
|spam-split: calling the spam-check-gmane-xref function
|spam-split: calling the spam-check-BBDB function
|Article 138024 has a nil data header [3 times]
|Article 138024 has no message ID!
|spam-generate-fake-headers: article 138024 didn't have a valid header
|spam-split: widening the buffer (spam-use-bogofilter requires it)
|spam-split: calling the spam-check-gmane-xref function
|spam-split: calling the spam-check-BBDB function
|spam-split: widening the buffer (spam-use-bogofilter requires it)
|spam-split: calling the spam-check-gmane-xref function
|spam-split: calling the spam-check-BBDB function
|Article 138026 has a nil data header [3 times]
|Article 138026 has no message ID!
\-------------------------------------------------------------

First I would like to know wether I can deactivate spam-use-bogofilter method
temporary. I thought (wrongly) that setting `spam-autodetect-methods` in a group
parameters would overload it but it seems it is not.

Secondly I don't know why gnus (or spam.el) is complaining about headers. I
didn't try to see a message header but I surely will since it increase spam.el
load and processing time.

> However, since you asked, it appears that gnus-agent-spam-p (the
> function that implements the span predicate) is a rather misleading
> placeholder.  It does a gnus-gethash on gnus-agent-spam-hashtb so it
> seems to do something yet I can't find any code, anywhere, that
> populates gnus-agent-spam-hashtb.

So did I.
 
> On the other hand, if your spam processing results in an article
> score, you could set the agent predicate to select articles higher
> than that score.

Hmm, problem is spam scores are ones that come from bogofilter check and I can
predicate which message is a good (i.e. interesting or not spam) based only on
its score ;)

Regards,

zeDek