Re: duplicates with offlineimap+dovecot

[gallego@cri.ensmp.fr (Emilio Jesús Gallego Arias)]

[-- Attachment #1: Type: text/plain, Size: 1676 bytes --]

Hi all,

Malcolm Purvis <malcolmp@xemacs.org> writes:

>>>>>> "Julien" == Julien Cubizolles <j.cubizolles@free.fr> writes:
>
> Julien> I have Gnus doing some splitting (including the detection of
> Julien> duplicates) on the local IMAP folders and some spam
> Julien> autodetection. Since the duplicates are not synced back to the
> Julien> remote server, could it be a problem with Gnus accessing the
> Julien> same message a second time and thinking it's a duplicate of the
> Julien> first one ?
>
> I have been experiencing a related problem for some time a direct
> connection to a dovecot IMAP server.  In my case Gnus performs the local
> splitting but occasionally does not delete the message from the INBOX.
> A second fetch splits the messages again (causing duplicates) and
> generally deletes the messages from the INBOX.

I am seeing exactly the same issue in my setup, very often messages get
delivered to the proper group but a copy remains in the INBOX.

On a second press of 'g', the messages get correctly split, so I end
with a duplicate in the corresponding folder.

I'm using my own mailserver with dovecot, so there is no mbsync,
etc... involved.

I'd say this bug first appeared around 3 months ago, so a bisect should
be possible, ideas on what commit to try?

Dovecot doesn't complain of anything weird. A transcript with the
gnus-log showing the problem is attached, note the double move to
folder5.

More details:

Ma Gnus v0.16
GNU Emacs 25.1.50.2 (x86_64-pc-linux-gnu, GTK+ Version 3.16.7)
 of 2016-02-08

Thanks,
Emilio

p.s: Now that gnus is in emacs trunk bisecting seems a bit more
complicated.


[-- Attachment #2: gnus-log-imap-dup.txt --]
[-- Type: text/plain, Size: 3087 bytes --]

09:00:13 [host] 5455 LIST "" "*"
09:00:14 [host] 5456 SELECT "INBOX"
09:00:14 [host] 5457 UID FETCH 1:* FLAGS
09:00:14 [host] 5458 UID FETCH 10775:10795 (UID BODY.PEEK[HEADER])
09:00:14 [host] 5459 UID MOVE 10779 "folder1"
09:00:14 [host] 5460 UID MOVE 10780 "folder2"
09:00:14 [host] 5461 UID MOVE 10791 "folder3"
09:00:14 [host] 5462 UID MOVE 10775:10777,10781:10790,10792:10794 "folder5"
09:00:14 [host] 5463 UID MOVE 10795 "folder4"
[... lots of examine]
09:00:14 [host] 5483 EXAMINE "folder5" (QRESYNC (1410936766 273))
[... end  of examine]
09:00:31 [host] 5684 LIST "" "*"
09:00:31 [host] 5685 SELECT "INBOX"
09:00:32 [host] 5686 UID FETCH 1:* FLAGS
09:00:32 [host] 5687 UID FETCH 10775:10778,10781:10790 (UID BODY.PEEK[HEADER])
09:00:32 [host] 5688 UID MOVE 10775:10777,10781:10790 "folder5"
09:00:32 [host] 5708 EXAMINE "folder5" (QRESYNC (1410936766 276))
09:00:32 [host] 5709 EXAMINE "folder6" (QRESYNC (1417814776 85))
[...]
09:00:32 [host] 5776 EXAMINE "ircam/concat" (QRESYNC (1435708727 32))
09:00:48 [host] 5796 SELECT "INBOX"
09:00:48 [host] 5797 SELECT "INBOX"
09:00:48 [host] 5798 UID FETCH 2717,2903,5925,7532,7540,9061,9806,9812,9815,9821,9824,9835:9836,9876,9879,9882,9926:9927,9932,9993,10063,10107,10189:10190,10195,10203,10210,10274,10279,10368,10408,10464,10469,10490,10563,10574,10586,10604,10607,10612,10614:10615,10618,10639,10643,10649,10651,10656,10667:10669,10674,10778 (UID RFC822.SIZE BODYSTRUCTURE BODY.PEEK[HEADER.FIELDS (Subject From Date Message-Id References In-Reply-To Xref To Newsgroups Cc)])
09:00:48 [host] 5799 SELECT "INBOX"
09:00:48 [host] 5800 UID FETCH 10778 BODY.PEEK[]
09:01:06 [host] 5801 SELECT "INBOX"
09:01:06 [host] 5802 UID SEARCH SENTBEFORE 11-JAN-2016
09:01:06 [host] 5803 UID STORE 10512:10513,10515:10517,10519,10523,10532:10534 +FLAGS.SILENT (\Deleted)
09:01:06 [host] 5804 UID EXPUNGE 10512:10513,10515:10517,10519,10523,10532:10534
09:01:06 [host] 5805 SELECT "INBOX"
09:01:06 [host] 5806 UID STORE 10778 +FLAGS.SILENT (\Seen)
09:01:07 [host] 5807 SELECT "INBOX"
09:01:07 [host] 5808 UID STORE 10778 +FLAGS.SILENT (\Flagged)
09:02:09 [host] 5809 NOOP
09:02:09 [host] 5810 NOOP
09:02:09 [host] 5811 NOOP
09:02:09 [host] 5812 NOOP
09:02:09 [host] 5813 NOOP
09:02:09 [host] 5814 NOOP
09:02:09 [host] 5815 NOOP
09:02:09 [host] 5816 NOOP
09:02:09 [host] 5817 NOOP
09:06:21 [host] 5818 SELECT "folder5"
09:06:21 [host] 5819 SELECT "folder5"
09:06:21 [host] 5820 UID FETCH 440:468 (UID RFC822.SIZE BODYSTRUCTURE BODY.PEEK[HEADER.FIELDS (Subject From Date Message-Id References In-Reply-To Xref To Newsgroups Cc)])
09:06:21 [host] 5821 SELECT "folder5"
09:06:22 [host] 5822 UID FETCH 440 BODY.PEEK[]
09:06:29 [host] 5823 SELECT "folder5"
09:06:29 [host] 5824 UID FETCH 466 BODY.PEEK[]
09:06:39 [host] 5825 SELECT "folder5"
09:06:39 [host] 5826 UID SEARCH SENTBEFORE 11-JAN-2016
09:06:39 [host] 5827 SELECT "folder5"
09:06:39 [host] 5828 UID STORE 440:441,458:468 +FLAGS.SILENT (\Seen)
09:06:39 [host] 5829 SELECT "folder5"
09:06:39 [host] 5830 UID STORE 441,458,459,460,461,462,463,464,465,466,467,468 +FLAGS.SILENT (gnus-expire)