Losing tickmarks in nnimap groups

Losing tickmarks in nnimap groups

[Steinar Bang]

Has anyone else experienced problems with losing tickmarks in nnimap
groups? 

This has happened to me twice now, in the same folder.  The folder is
read by two machines:
 - One running a CVS version of Gnus from March 11 in XEmacs 21.4.6,
   no agent on the server with the problem folder
 - One running a CVS version of Gnus from March 19 in GNU Emacs 21.3,
   with agent on the server with the problem folder (but reading
   online all the time)

Both times I have lost the tickmarks on the latter machine (a laptop
at work), but they have been gone on the other machine as well, when I
got home.

The server is Cyrus imapd 2.1.16 on debian testing/unstable, on a PII
machine. 

Re: Losing tickmarks in nnimap groups

[Wes Hardaker]

>>>>> On Fri, 02 Apr 2004 08:22:26 +0200, Steinar Bang <sb@dod.no> said:

Steinar> Has anyone else experienced problems with losing tickmarks in
Steinar> nnimap groups?

Yes.  I haven't seen many tick marks disappear, as I don't use them
with incredible frequency.  However, I've seen many other marks
disappear (expired being the most annoying as I use that one a lot ;-).

-- 
"In the bathtub of history the truth is harder to hold than the soap,
 and much more difficult to find."  -- Terry Pratchett

Re: Losing tickmarks in nnimap groups

[Simon Josefsson]

Steinar Bang <sb@dod.no> writes:

> Has anyone else experienced problems with losing tickmarks in nnimap
> groups? 
>
> This has happened to me twice now, in the same folder.  The folder is
> read by two machines:
>  - One running a CVS version of Gnus from March 11 in XEmacs 21.4.6,
>    no agent on the server with the problem folder
>  - One running a CVS version of Gnus from March 19 in GNU Emacs 21.3,
>    with agent on the server with the problem folder (but reading
>    online all the time)
>
> Both times I have lost the tickmarks on the latter machine (a laptop
> at work), but they have been gone on the other machine as well, when I
> got home.
>
> The server is Cyrus imapd 2.1.16 on debian testing/unstable, on a PII
> machine. 

I recall seeing similar reports from time to time, and I'm not sure it
has ever been fully tracked down.  FWIW, I use CVS Gnus on CVS Emacs,
Cyrus IMAPD 2.1.15, agent enabled (and typically always online), many
client instances (although only one of them is Gnus), and I use tick
marks extensively and have never seen this.

Finding a recipe, and *imap-log* traces, on reproducing this would
help.

Re: Losing tickmarks in nnimap groups

[Wes Hardaker]

>>>>> On Fri, 02 Apr 2004 13:18:28 +0200, Simon Josefsson <jas@extundo.com> said:

Simon> Finding a recipe

That's the kicker...  I've never been able to reproduce it.

I'm pretty sure it had to do with the agent for me, which I simply
don't use with IMAP (even though I'd like to) as every time I try
something bad happens eventually.

-- 
"In the bathtub of history the truth is harder to hold than the soap,
 and much more difficult to find."  -- Terry Pratchett

Re: Losing tickmarks in nnimap groups

[Steinar Bang]

>>>>> Wes Hardaker <wes@hardakers.net>:

>>>>> On Fri, 02 Apr 2004 13:18:28 +0200, Simon Josefsson <jas@extundo.com> said:

> I'm pretty sure it had to do with the agent for me, which I simply
> don't use with IMAP (even though I'd like to) as every time I try
> something bad happens eventually.

I've only seen this, since I started using the agent.  I started using
the agent on nnimap in mid-March (on March 19 to be exact), and have
seen it twice since then.

I usually run in plugged mode (ie. the agent cache is only used for
speedup). 

I never encountered it when I used the agent regularily from
1999-2001.  But then I mostly ran in unplugged mode.  Maybe there's
something there...?

Re: Losing tickmarks in nnimap groups

[Steinar Bang]

>>>>> Steinar Bang <sb@dod.no>:

> I've only seen this since I started using the agent.  I started
> using the agent on nnimap in mid-March (on March 19 to be exact),
> and have seen it twice since then.

I saw this happen on the same nnimap group twice.  This group had a
lot of _old_ (as in early 2002) ticked articles, and a lot of read
articles between the ticked articles.

After the second loss of tickmarks, I walked through all the old
articles, and ticked the ones I wanted, and then moved all the ticked
articles to an archive group.

So if the ticking pattern was the problem, I won't see it again.

Re: Losing tickmarks in nnimap groups

[Steinar Bang]

[-- Attachment #0: Type: message/rfc822, Size: 1972 bytes --]

From: Gleb Arshinov <email@removed>
To: Steinar Bang <sb@dod.no>
Subject: Re: Losing tickmarks in nnimap groups
Date: Thu, 15 Apr 2004 17:27:37 -0700
Message-ID: <86hdvkdax2.fsf@badger.barsook.com>

>>>>> Steinar Bang <sb@dod.no>:
    >> I've only seen this since I started using the agent.  I started
    >> using the agent on nnimap in mid-March (on March 19 to be
    >> exact), and have seen it twice since then.

    Steinar> I saw this happen on the same nnimap group twice.  This
    Steinar> group had a lot of _old_ (as in early 2002) ticked
    Steinar> articles, and a lot of read articles between the ticked
    Steinar> articles.

[Can't seem to post for some reason, hence email followup.  Feel free
to post this to gnus.ding, just withOUT my email]

Steinar,

I've investigated and reported this bug before.  "Holey" mailboxes
like you describe will trigger it.

    The root cause seems that when UID SEARCH UID fails, nnimap ends
    up deleting/expiring all articles involed in this UID SEARCH UID
    command.  UID SEARCH UID seems to fail on large lists of
    sequences.  In Exchange case "large" is pretty small :-), but I've
    seen similar problems on very large "holey" mailboxes on uw-imapd.

See
http://groups.google.com/groups?selm=86u1c37rwi.fsf%40badger.barsook.com
for full description/trace/etc.

Gleb

Re: Losing tickmarks in nnimap groups

[Wes Hardaker]

>>>>> On Fri, 16 Apr 2004 07:49:20 +0200, Steinar Bang <sb@dod.no> said:

Steinar> The root cause seems that when UID SEARCH UID fails, nnimap
Steinar> ends up deleting/expiring all articles involed in this UID
Steinar> SEARCH UID command.  UID SEARCH UID seems to fail on large
Steinar> lists of sequences.  In Exchange case "large" is pretty small
Steinar> :-), but I've seen similar problems on very large "holey"
Steinar> mailboxes on uw-imapd.

FYI, I use uw-imapd and I've definitely seen the problems...

-- 
"In the bathtub of history the truth is harder to hold than the soap,
 and much more difficult to find."  -- Terry Pratchett

Re: Losing tickmarks in nnimap groups

[Steinar Bang]

[-- Attachment #0: Type: message/rfc822, Size: 1972 bytes --]

From: Gleb Arshinov <email@removed>
To: Steinar Bang <sb@dod.no>
Subject: Re: Losing tickmarks in nnimap groups
Date: Thu, 15 Apr 2004 17:27:37 -0700
Message-ID: <86hdvkdax2.fsf@badger.barsook.com>

>>>>> Steinar Bang <sb@dod.no>:
    >> I've only seen this since I started using the agent.  I started
    >> using the agent on nnimap in mid-March (on March 19 to be
    >> exact), and have seen it twice since then.

    Steinar> I saw this happen on the same nnimap group twice.  This
    Steinar> group had a lot of _old_ (as in early 2002) ticked
    Steinar> articles, and a lot of read articles between the ticked
    Steinar> articles.

[Can't seem to post for some reason, hence email followup.  Feel free
to post this to gnus.ding, just withOUT my email]

Steinar,

I've investigated and reported this bug before.  "Holey" mailboxes
like you describe will trigger it.

    The root cause seems that when UID SEARCH UID fails, nnimap ends
    up deleting/expiring all articles involed in this UID SEARCH UID
    command.  UID SEARCH UID seems to fail on large lists of
    sequences.  In Exchange case "large" is pretty small :-), but I've
    seen similar problems on very large "holey" mailboxes on uw-imapd.

See
http://groups.google.com/groups?selm=86u1c37rwi.fsf%40badger.barsook.com
for full description/trace/etc.

Gleb

Re: Losing tickmarks in nnimap groups

[Steinar Bang]

>>>>> Simon Josefsson <jas@extundo.com>:

> Finding a recipe, and *imap-log* traces, on reproducing this would
> help.

Is there some logging I can switch on that can help trace the cause,
if it should happen again?

Re: Losing tickmarks in nnimap groups

[Simon Josefsson]

Steinar Bang <sb@dod.no> writes:

>>>>>> Simon Josefsson <jas@extundo.com>:
>
>> Finding a recipe, and *imap-log* traces, on reproducing this would
>> help.
>
> Is there some logging I can switch on that can help trace the cause,
> if it should happen again?

I always run with `imap-log' enabled, so I can look at what happened
if something weird happens.  It might not help reproduce the problem,
but could give some hints to help pin point a pattern or something.

Re: Losing tickmarks in nnimap groups

[Chris Green]

Simon Josefsson <jas@extundo.com> writes:

> I always run with `imap-log' enabled, so I can look at what happened
> if something weird happens.  It might not help reproduce the problem,
> but could give some hints to help pin point a pattern or something.

I'm using Oort 5.10.6.  This message isn't flagged because I can't get
gnus to display it no matter the value I pass to the group open
function. I have a plugged agent doing imap over openssl and I think
that's about the only notable gnus config.

I've not included the output from the * 477 fetch commands.  If they
are important to you, I can send them in private, I just don't want to
sign up all my friends for spam :).

I'm willing to try most commands and I can atleast plod at lisp but
debugging this problem (it's not the first message to have that happen
to ) is close to impossible for me without guidance. If I do an nnir
search for flight, it does display.

Maildir/cur/1081245048.27012_3.lilly:2,S

Maildir/courierimapuiddb has

2173 1081245048.27012_3.lilly

(2188 is the highest number I have right now so C-u 30 should pull
that out )

0:nnimap+csoft:INBOX 
C-u 30 Enter

This mail is flight information from my wife on where to pick up my
mother in law... a really bad mail to have had problem with :)

I have the imap.log for this from the C-u 30 Enter 

The only time I see 2173 as a UID in this log is on the initial search
seen command.

Here's the output from reentering the INBOX

381 UID SEARCH UNSEEN UNDELETED
* SEARCH
381 OK SEARCH done.
382 UID SEARCH SEEN
* SEARCH 58 59 64 65 71 72 73 74 75 76 78 79 80 81 82 83 85 87 89 92 100 103 104 106 107 110 111 116 117 118 119 123 128 135 136 137 141 145 146 149 152 153 154 155 170 174 175 180 192 200 225 231 239 240 244 245 258 260 268 270 271 272 273 274 281 286 288 289 290 293 312 314 330 334 335 336 337 346 349 350 357 359 361 366 370 372 375 376 377 378 380 382 383 391 396 398 399 403 414 421 422 425 440 444 449 450 451 452 453 466 470 478 484 493 495 496 528 543 551 554 560 577 589 591 592 593 594 596 597 607 627 629 637 640 641 645 647 654 664 670 671 684 685 687 690 696 697 698 700 701 702 706 707 708 709 711 713 720 724 730 733 747 751 753 771 773 783 785 786 787 788 789 794 796 797 798 801 802 804 808 819 821 822 828 854 855 856 859 860 861 865 872 880 893 895 900 901 903 905 906 907 908 915 917 951 958 964 975 983 985 986 987 995 1009 1015 1019 1025 1026 1029 1031 1037 1044 1056 1061 1062 1064 1065 1066 1067 1069 1070 1071 1072 1074 1094 1097 1098 1100 1103 1104 1105 1106 1107 1109 1112 1113 1114 1122 1125 1133 1136 1138 1139 1142 1146 1147 1148 1149 1151 1154 1156 1157 1158 1159 1163 1164 1165 1167 1170 1172 1182 1183 1184 1190 1195 1197 1208 1210 1222 1224 1227 1254 1266 1324 1325 1329 1330 1339 1341 1353 1382 1393 1402 1417 1440 1534 1543 1546 1547 1551 1552 1553 1554 1560 1573 1578 1580 1588 1612 1614 1617 1634 1640 1648 1655 1660 1661 1663 1667 1670 1671 1677 1685 1690 1692 1710 1739 1799 1800 1802 1803 1804 1805 1808 1810 1813 1816 1822 1824 1828 1830 1835 1837 1838 1843 1846 1852 1853 1854 1863 1865 1868 1869 1870 1871 1872 1873 1874 1875 1876 1877 1883 1884 1887 1889 1890 1892 1893 1894 1895 1898 1900 1902 1905 1913 1914 1915 1916 1917 1918 1922 1923 1924 1930 1935 1936 1942 1946 1947 1948 1950 1951 1952 1957 1961 1964 1969 1993 2044 2046 2048 2049 2050 2051 2053 2056 2062 2066 2067 2069 2071 2072 2073 2074 2075 2077 2078 2079 2080 2081 2082 2087 2088 2090 2091 2093 2094 2101 2102 2103 2108 2110 2111 2112 2113 2117 2118 2122 2125 2126 2127 2128 2129 2131 2132 2133 2136 2137 2138 2139 2140 2141 2142 2143 2144 2145 2146 2147 2148 2149 2150 2151 2152 2153 2154 2155 2156 2157 2158 2159 2160 2164 2165 2166 2167 2168 2169 2170 2173 2174 2175 2176 2177 2178 2179 2180 2181 2182 2183 2184 2185 2186 2187 2188
382 OK SEARCH done.
383 UID SEARCH FLAGGED
* SEARCH 92 145 270 274 281 293 314 337 361 370 398 551 645 654 671 696 700 724 783 794 819 855 901 905 906 1009 1025 1031 1037 1069 1072 1074 1103 1107 1112 1125 1133 1182 1183 1339 1534 1573 1670 1800 1803 1853 1854 1868 1870 1871 1898 1905 1936 1948 1950 2046 2048 2050 2077 2093 2102 2103 2126 2128 2136 2147 2152 2165 2166 2188
383 OK SEARCH done.
384 UID SEARCH ANSWERED
* SEARCH 87 110 118 137 174 245 270 271 286 288 289 336 349 359 378 380 383 391 396 399 414 444 450 451 594 671 684 690 697 698 700 702 706 707 708 711 788 821 822 854 856 859 860 865 893 900 901 917 951 983 985 987 1015 1044 1056 1061 1062 1064 1094 1114 1139 1142 1146 1151 1157 1172 1190 1254 1324 1382 1393 1552 1560 1612 1634 1648 1660 1661 1685 1710 1739 1799 1810 1828 1843 1863 1865 1874 1877 1890 1892 1900 1914 1917 1930 1946 1947 1951 1952 1957 1969 1993 2044 2046 2049 2051 2062 2075 2078 2082 2088 2090 2103 2113 2117 2118 2146 2150 2154 2155 2164 2167 2168 2177 2181 2186
384 OK SEARCH done.
385 UID SEARCH RECENT
* SEARCH
385 OK SEARCH done.


<I'm only including grep FETCH imap.log from this point on>

386 UID FETCH 2159:2164,2167:2172,2174:2187 (UID RFC822.SIZE BODY BODY.PEEK[HEADER.FIELDS (Subject From Date Message-Id References In-Reply-To Xref To Newsgroups Comments)])
* 470 FETCH (UID 2159 RFC822.SIZE 3148 BODY ("text" "plain" NIL NIL NIL "8bit" 1134 30) BODY[HEADER.FIELDS ("Subject" "From" "Date" "Message-Id" "References" "In-Reply-To" "Xref" "To" "Newsgroups" "Comments")] {363}
386 UID FETCH 2159:2164,2167:2172,2174:2187 (UID RFC822.SIZE BODY BODY.PEEK[HEADER.FIELDS (Subject From Date Message-Id References In-Reply-To Xref To Newsgroups Comments)])
* 470 FETCH (UID 2159 RFC822.SIZE 3148 BODY ("text" "plain" NIL NIL NIL "8bit" 1134 30) BODY[HEADER.FIELDS ("Subject" "From" "Date" "Message-Id" "References" "In-Reply-To" "Xref" "To" "Newsgroups" "Comments")] {363}
* 471 FETCH (UID 2160 RFC822.SIZE 28685 BODY ("text" "plain" NIL NIL NIL "8bit" 25881 563) BODY[HEADER.FIELDS ("Subject" "From" "Date" "Message-Id" "References" "In-Reply-To" "Xref" "To" "Newsgroups" "Comments")] {192}
* 472 FETCH (UID 2164 RFC822.SIZE 2305 BODY ("text" "plain" ("charset" "us-ascii") NIL NIL "8bit" 513 17) BODY[HEADER.FIELDS ("Subject" "From" "Date" "Message-Id" "References" "In-Reply-To" "Xref" "To" "Newsgroups" "Comments")] {175}
* 475 FETCH (UID 2167 RFC822.SIZE 2643 BODY ("text" "plain" ("charset" "iso-8859-1") NIL NIL "quoted-printable" 443 12) BODY[HEADER.FIELDS ("Subject" "From" "Date" "Message-Id" "References" "In-Reply-To" "Xref" "To" "Newsgroups" "Comments")] {211}
* 476 FETCH (UID 2168 RFC822.SIZE 6126 BODY (("text" "plain" ("charset" "us-ascii") NIL NIL "7bit" 1346 43)("text" "html" ("charset" "iso-8859-1") NIL "HTML" "8bit" 2203 35) "alternative") BODY[HEADER.FIELDS ("Subject" "From" "Date" "Message-Id" "References" "In-Reply-To" "Xref" "To" "Newsgroups" "Comments")] {223}
* 477 FETCH (UID 2169 RFC822.SIZE 4155 BODY (("text" "plain" ("charset" "us-ascii") NIL NIL "8bit" 694 7)("text" "html" ("charset" "us-ascii") NIL NIL "8bit" 1327 3) "alternative") BODY[HEADER.FIELDS ("Subject" "From" "Date" "Message-Id" "References" "In-Reply-To" "Xref" "To" "Newsgroups" "Comments")] {198}
* 478 FETCH (UID 2170 RFC822.SIZE 2721 BODY ("text" "plain" ("charset" "us-ascii") NIL NIL "7bit" 480 16) BODY[HEADER.FIELDS ("Subject" "From" "Date" "Message-Id" "References" "In-Reply-To" "Xref" "To" "Newsgroups" "Comments")] {186}
* 480 FETCH (UID 2174 RFC822.SIZE 9193 BODY (("text" "plain" ("charset" "us-ascii") NIL NIL "8bit" 687 26)("text" "html" ("charset" "us-ascii") NIL NIL "8bit" 6102 91) "alternative") BODY[HEADER.FIELDS ("Subject" "From" "Date" "Message-Id" "References" "In-Reply-To" "Xref" "To" "Newsgroups" "Comments")] {220}
* 481 FETCH (UID 2175 RFC822.SIZE 9296 BODY (("text" "plain" ("charset" "us-ascii") NIL NIL "8bit" 718 26)("text" "html" ("charset" "us-ascii") NIL NIL "8bit" 6141 91) "alternative") BODY[HEADER.FIELDS ("Subject" "From" "Date" "Message-Id" "References" "In-Reply-To" "Xref" "To" "Newsgroups" "Comments")] {229}
* 482 FETCH (UID 2176 RFC822.SIZE 2478 BODY ("text" "plain" ("charset" "us-ascii" "format" "flowed") NIL NIL "7bit" 233 15) BODY[HEADER.FIELDS ("Subject" "From" "Date" "Message-Id" "References" "In-Reply-To" "Xref" "To" "Newsgroups" "Comments")] {196}
* 483 FETCH (UID 2177 RFC822.SIZE 2957 BODY (("text" "plain" ("charset" "us-ascii" "format" "flowed") NIL NIL "7bit" 280 12)("application" "pgp-signature" ("name" "signature.asc") NIL "OpenPGP digital signature" "8bit" 257) "signed") BODY[HEADER.FIELDS ("Subject" "From" "Date" "Message-Id" "References" "In-Reply-To" "Xref" "To" "Newsgroups" "Comments")] {182}
* 484 FETCH (UID 2178 RFC822.SIZE 2199 BODY ("text" "plain" ("charset" "us-ascii" "format" "flowed") NIL NIL "7bit" 426 10) BODY[HEADER.FIELDS ("Subject" "From" "Date" "Message-Id" "References" "In-Reply-To" "Xref" "To" "Newsgroups" "Comments")] {187}
* 485 FETCH (UID 2179 RFC822.SIZE 2238 BODY ("text" "plain" ("charset" "us-ascii") NIL NIL "8bit" 430 15) BODY[HEADER.FIELDS ("Subject" "From" "Date" "Message-Id" "References" "In-Reply-To" "Xref" "To" "Newsgroups" "Comments")] {193}
* 486 FETCH (UID 2180 RFC822.SIZE 7855 BODY (("text" "plain" ("charset" "us-ascii") NIL NIL "8bit" 668 26)("text" "html" ("charset" "us-ascii") NIL NIL "8bit" 4809 78) "alternative") BODY[HEADER.FIELDS ("Subject" "From" "Date" "Message-Id" "References" "In-Reply-To" "Xref" "To" "Newsgroups" "Comments")] {195}
* 487 FETCH (UID 2181 RFC822.SIZE 2755 BODY ("text" "plain" ("charset" "us-ascii" "format" "flowed") NIL NIL "7bit" 517 16) BODY[HEADER.FIELDS ("Subject" "From" "Date" "Message-Id" "References" "In-Reply-To" "Xref" "To" "Newsgroups" "Comments")] {189}
* 488 FETCH (UID 2182 RFC822.SIZE 59776 BODY ("text" "plain" NIL NIL NIL "8bit" 57011 1212) BODY[HEADER.FIELDS ("Subject" "From" "Date" "Message-Id" "References" "In-Reply-To" "Xref" "To" "Newsgroups" "Comments")] {189}
* 489 FETCH (UID 2183 RFC822.SIZE 5842 BODY ("text" "plain" ("charset" "us-ascii") NIL NIL "7bit" 564 22) BODY[HEADER.FIELDS ("Subject" "From" "Date" "Message-Id" "References" "In-Reply-To" "Xref" "To" "Newsgroups" "Comments")] {3164}
* 490 FETCH (UID 2184 RFC822.SIZE 2636 BODY ("text" "plain" ("charset" "us-ascii" "format" "flowed") NIL NIL "7bit" 500 19) BODY[HEADER.FIELDS ("Subject" "From" "Date" "Message-Id" "References" "In-Reply-To" "Xref" "To" "Newsgroups" "Comments")] {352}
* 491 FETCH (UID 2185 RFC822.SIZE 2289 BODY ("text" "plain" ("charset" "us-ascii") NIL NIL "8bit" 354 20) BODY[HEADER.FIELDS ("Subject" "From" "Date" "Message-Id" "References" "In-Reply-To" "Xref" "To" "Newsgroups" "Comments")] {299}
* 492 FETCH (UID 2186 RFC822.SIZE 2247 BODY ("text" "plain" NIL NIL NIL "8bit" 350 13) BODY[HEADER.FIELDS ("Subject" "From" "Date" "Message-Id" "References" "In-Reply-To" "Xref" "To" "Newsgroups" "Comments")] {302}
* 493 FETCH (UID 2187 RFC822.SIZE 2271 BODY ("text" "plain" NIL NIL NIL "8bit" 345 12) BODY[HEADER.FIELDS ("Subject" "From" "Date" "Message-Id" "References" "In-Reply-To" "Xref" "To" "Newsgroups" "Comments")] {313}
386 OK FETCH completed.

-- 
Chris Green <cmg@dok.org>
A good pun is its own reword.

Re: Losing tickmarks in nnimap groups

[Simon Josefsson]

Chris Green <cmg@dok.org> writes:

> Simon Josefsson <jas@extundo.com> writes:
>
>> I always run with `imap-log' enabled, so I can look at what happened
>> if something weird happens.  It might not help reproduce the problem,
>> but could give some hints to help pin point a pattern or something.
>
> I'm using Oort 5.10.6.  This message isn't flagged because I can't get
> gnus to display it no matter the value I pass to the group open
> function. I have a plugged agent doing imap over openssl and I think
> that's about the only notable gnus config.
>
> I've not included the output from the * 477 fetch commands.  If they
> are important to you, I can send them in private, I just don't want to
> sign up all my friends for spam :).
>
> I'm willing to try most commands and I can atleast plod at lisp but
> debugging this problem (it's not the first message to have that happen
> to ) is close to impossible for me without guidance. If I do an nnir
> search for flight, it does display.
>
> Maildir/cur/1081245048.27012_3.lilly:2,S
>
> Maildir/courierimapuiddb has
>
> 2173 1081245048.27012_3.lilly
>
> (2188 is the highest number I have right now so C-u 30 should pull
> that out )
>
> 0:nnimap+csoft:INBOX 
> C-u 30 Enter
>
> This mail is flight information from my wife on where to pick up my
> mother in law... a really bad mail to have had problem with :)
>
> I have the imap.log for this from the C-u 30 Enter 
>
> The only time I see 2173 as a UID in this log is on the initial search
> seen command.

So let me see if I understand the problem first: you press ! on the
article, it becomes ticked in the summary buffer, but when you press
'q' to save the tick mark, it doesn't work because when you re-enter
the group with C-u 30 enter (or just enter, which should display all
ticked articles) the article isn't marked as ticked.  Right?

The IMAP trace you showed indicate the server doesn't think the
article is ticked, so Gnus is simply displaying this information to
you.  So the interesting part would be if you can get the IMAP trace
starting when you press ! (followed by q), continuing through when you
and re-enter the group and notice the article isn't marked ticked any
more.  It sounds to me that either the flag setting procedure is buggy
in Gnus, or the server forget about flag.

Re: Losing tickmarks in nnimap groups

[Chris Green]

Simon Josefsson <jas@extundo.com> writes:

> So let me see if I understand the problem first: you press ! on the
> article, it becomes ticked in the summary buffer, but when you press
> 'q' to save the tick mark, it doesn't work because when you re-enter
> the group with C-u 30 enter (or just enter, which should display all
> ticked articles) the article isn't marked as ticked.  Right?

No, sorry I put too much commentary in there.  This is an article
that's invisble to gnus.  I can't tick it because it doesn't show up
in the *Summary nnimap+csoft:INBOX* buffer.

No matter how many articles I try to fetch at once, it will never
appear.  
-- 
Chris Green <cmg@dok.org>
Let not the sands of time get in your lunch.

Invisible articles (was: Re: Losing tickmarks in nnimap groups)

[Simon Josefsson]

Chris Green <cmg@dok.org> writes:

> Simon Josefsson <jas@extundo.com> writes:
>
>> So let me see if I understand the problem first: you press ! on the
>> article, it becomes ticked in the summary buffer, but when you press
>> 'q' to save the tick mark, it doesn't work because when you re-enter
>> the group with C-u 30 enter (or just enter, which should display all
>> ticked articles) the article isn't marked as ticked.  Right?
>
> No, sorry I put too much commentary in there.  This is an article
> that's invisble to gnus.  I can't tick it because it doesn't show up
> in the *Summary nnimap+csoft:INBOX* buffer.
>
> No matter how many articles I try to fetch at once, it will never
> appear.  

Ah, I see.  This sounds like a completely different bug, then.  In
your case, I suspect the Agent cache is playing tricks on you, does it
help to remove the directory corresponding to the group?  E.g., 'rm
-rf ~/News/agent/nnimap/mail.example.org/INBOX.whatever'?

Re: Invisible articles

[Chris Green]

Simon Josefsson <jas@extundo.com> writes:

> Ah, I see.  This sounds like a completely different bug, then.  In
> your case, I suspect the Agent cache is playing tricks on you, does it
> help to remove the directory corresponding to the group?  E.g., 'rm
> -rf ~/News/agent/nnimap/mail.example.org/INBOX.whatever'?

I didn't have a directory there.  I probably didn't bless with the
agentize command when I added the new server. 

However, I did have a ~/News/cache/nnimap+csoft:INBOX/

nnimap+csoft:INBOX/2173

My active file line is:

nnimap+csoft:INBOX 2188 270 y
-- 
Chris Green <cmg@dok.org>
"Yeah, but you're taking the universe out of context."

Re: Invisible articles

[Simon Josefsson]

Chris Green <cmg@dok.org> writes:

> Simon Josefsson <jas@extundo.com> writes:
>
>> Ah, I see.  This sounds like a completely different bug, then.  In
>> your case, I suspect the Agent cache is playing tricks on you, does it
>> help to remove the directory corresponding to the group?  E.g., 'rm
>> -rf ~/News/agent/nnimap/mail.example.org/INBOX.whatever'?
>
> I didn't have a directory there.  I probably didn't bless with the
> agentize command when I added the new server.

Ah, if you don't use the agent on the server, I don't know what is
causing it.  Maybe the cache...

> However, I did have a ~/News/cache/nnimap+csoft:INBOX/
>
> nnimap+csoft:INBOX/2173
>
> My active file line is:
>
> nnimap+csoft:INBOX 2188 270 y

...so try removing the cache (and restart)?

If, after removing the agent data and the cache and a restart, C-u RET
doesn't see the article, post a new *imap-log* dump containing the
output from C-u RET on the group.  The last one you sent seem to be
partial, so it was probably using cached data from somewhere.

Hm.  Do you frob nnimap-nov-is-evil in any way?  What is the value of
gnus-agent?

Re: Losing tickmarks in nnimap groups

[Chris Green]

Simon Josefsson <jas@extundo.com> writes:

> I always run with `imap-log' enabled, so I can look at what happened
> if something weird happens.  It might not help reproduce the problem,
> but could give some hints to help pin point a pattern or something.

I'm using Oort 5.10.6.  This message isn't flagged because I can't get
gnus to display it no matter the value I pass to the group open
function. I have a plugged agent doing imap over openssl and I think
that's about the only notable gnus config.

I've not included the output from the * 477 fetch commands.  If they
are important to you, I can send them in private, I just don't want to
sign up all my friends for spam :).

I'm willing to try most commands and I can atleast plod at lisp but
debugging this problem (it's not the first message to have that happen
to ) is close to impossible for me without guidance. If I do an nnir
search for flight, it does display.

Maildir/cur/1081245048.27012_3.lilly:2,S

Maildir/courierimapuiddb has

2173 1081245048.27012_3.lilly

(2188 is the highest number I have right now so C-u 30 should pull
that out )

0:nnimap+csoft:INBOX 
C-u 30 Enter

This mail is flight information from my wife on where to pick up my
mother in law... a really bad mail to have had problem with :)

I have the imap.log for this from the C-u 30 Enter 

The only time I see 2173 as a UID in this log is on the initial search
seen command.

Here's the output from reentering the INBOX

381 UID SEARCH UNSEEN UNDELETED
* SEARCH
381 OK SEARCH done.
382 UID SEARCH SEEN
* SEARCH 58 59 64 65 71 72 73 74 75 76 78 79 80 81 82 83 85 87 89 92 100 103 104 106 107 110 111 116 117 118 119 123 128 135 136 137 141 145 146 149 152 153 154 155 170 174 175 180 192 200 225 231 239 240 244 245 258 260 268 270 271 272 273 274 281 286 288 289 290 293 312 314 330 334 335 336 337 346 349 350 357 359 361 366 370 372 375 376 377 378 380 382 383 391 396 398 399 403 414 421 422 425 440 444 449 450 451 452 453 466 470 478 484 493 495 496 528 543 551 554 560 577 589 591 592 593 594 596 597 607 627 629 637 640 641 645 647 654 664 670 671 684 685 687 690 696 697 698 700 701 702 706 707 708 709 711 713 720 724 730 733 747 751 753 771 773 783 785 786 787 788 789 794 796 797 798 801 802 804 808 819 821 822 828 854 855 856 859 860 861 865 872 880 893 895 900 901 903 905 906 907 908 915 917 951 958 964 975 983 985 986 987 995 1009 1015 1019 1025 1026 1029 1031 1037 1044 1056 1061 1062 1064 1065 1066 1067 1069 1070 1071 1072 1074 1094 1097 1098 1100 1103 1104 1105 1106 1107 1109 1112 1113 1114 1122 1125 1133 1136 1138 1139 1142 1146 1147 1148 1149 1151 1154 1156 1157 1158 1159 1163 1164 1165 1167 1170 1172 1182 1183 1184 1190 1195 1197 1208 1210 1222 1224 1227 1254 1266 1324 1325 1329 1330 1339 1341 1353 1382 1393 1402 1417 1440 1534 1543 1546 1547 1551 1552 1553 1554 1560 1573 1578 1580 1588 1612 1614 1617 1634 1640 1648 1655 1660 1661 1663 1667 1670 1671 1677 1685 1690 1692 1710 1739 1799 1800 1802 1803 1804 1805 1808 1810 1813 1816 1822 1824 1828 1830 1835 1837 1838 1843 1846 1852 1853 1854 1863 1865 1868 1869 1870 1871 1872 1873 1874 1875 1876 1877 1883 1884 1887 1889 1890 1892 1893 1894 1895 1898 1900 1902 1905 1913 1914 1915 1916 1917 1918 1922 1923 1924 1930 1935 1936 1942 1946 1947 1948 1950 1951 1952 1957 1961 1964 1969 1993 2044 2046 2048 2049 2050 2051 2053 2056 2062 2066 2067 2069 2071 2072 2073 2074 2075 2077 2078 2079 2080 2081 2082 2087 2088 2090 2091 2093 2094 2101 2102 2103 2108 2110 2111 2112 2113 2117 2118 2122 2125 2126 2127 2128 2129 2131 2132 2133 2136 2137 2138 2139 2140 2141 2142 2143 2144 2145 2146 2147 2148 2149 2150 2151 2152 2153 2154 2155 2156 2157 2158 2159 2160 2164 2165 2166 2167 2168 2169 2170 2173 2174 2175 2176 2177 2178 2179 2180 2181 2182 2183 2184 2185 2186 2187 2188
382 OK SEARCH done.
383 UID SEARCH FLAGGED
* SEARCH 92 145 270 274 281 293 314 337 361 370 398 551 645 654 671 696 700 724 783 794 819 855 901 905 906 1009 1025 1031 1037 1069 1072 1074 1103 1107 1112 1125 1133 1182 1183 1339 1534 1573 1670 1800 1803 1853 1854 1868 1870 1871 1898 1905 1936 1948 1950 2046 2048 2050 2077 2093 2102 2103 2126 2128 2136 2147 2152 2165 2166 2188
383 OK SEARCH done.
384 UID SEARCH ANSWERED
* SEARCH 87 110 118 137 174 245 270 271 286 288 289 336 349 359 378 380 383 391 396 399 414 444 450 451 594 671 684 690 697 698 700 702 706 707 708 711 788 821 822 854 856 859 860 865 893 900 901 917 951 983 985 987 1015 1044 1056 1061 1062 1064 1094 1114 1139 1142 1146 1151 1157 1172 1190 1254 1324 1382 1393 1552 1560 1612 1634 1648 1660 1661 1685 1710 1739 1799 1810 1828 1843 1863 1865 1874 1877 1890 1892 1900 1914 1917 1930 1946 1947 1951 1952 1957 1969 1993 2044 2046 2049 2051 2062 2075 2078 2082 2088 2090 2103 2113 2117 2118 2146 2150 2154 2155 2164 2167 2168 2177 2181 2186
384 OK SEARCH done.
385 UID SEARCH RECENT
* SEARCH
385 OK SEARCH done.


<I'm only including grep FETCH imap.log from this point on>

386 UID FETCH 2159:2164,2167:2172,2174:2187 (UID RFC822.SIZE BODY BODY.PEEK[HEADER.FIELDS (Subject From Date Message-Id References In-Reply-To Xref To Newsgroups Comments)])
* 470 FETCH (UID 2159 RFC822.SIZE 3148 BODY ("text" "plain" NIL NIL NIL "8bit" 1134 30) BODY[HEADER.FIELDS ("Subject" "From" "Date" "Message-Id" "References" "In-Reply-To" "Xref" "To" "Newsgroups" "Comments")] {363}
386 UID FETCH 2159:2164,2167:2172,2174:2187 (UID RFC822.SIZE BODY BODY.PEEK[HEADER.FIELDS (Subject From Date Message-Id References In-Reply-To Xref To Newsgroups Comments)])
* 470 FETCH (UID 2159 RFC822.SIZE 3148 BODY ("text" "plain" NIL NIL NIL "8bit" 1134 30) BODY[HEADER.FIELDS ("Subject" "From" "Date" "Message-Id" "References" "In-Reply-To" "Xref" "To" "Newsgroups" "Comments")] {363}
* 471 FETCH (UID 2160 RFC822.SIZE 28685 BODY ("text" "plain" NIL NIL NIL "8bit" 25881 563) BODY[HEADER.FIELDS ("Subject" "From" "Date" "Message-Id" "References" "In-Reply-To" "Xref" "To" "Newsgroups" "Comments")] {192}
* 472 FETCH (UID 2164 RFC822.SIZE 2305 BODY ("text" "plain" ("charset" "us-ascii") NIL NIL "8bit" 513 17) BODY[HEADER.FIELDS ("Subject" "From" "Date" "Message-Id" "References" "In-Reply-To" "Xref" "To" "Newsgroups" "Comments")] {175}
* 475 FETCH (UID 2167 RFC822.SIZE 2643 BODY ("text" "plain" ("charset" "iso-8859-1") NIL NIL "quoted-printable" 443 12) BODY[HEADER.FIELDS ("Subject" "From" "Date" "Message-Id" "References" "In-Reply-To" "Xref" "To" "Newsgroups" "Comments")] {211}
* 476 FETCH (UID 2168 RFC822.SIZE 6126 BODY (("text" "plain" ("charset" "us-ascii") NIL NIL "7bit" 1346 43)("text" "html" ("charset" "iso-8859-1") NIL "HTML" "8bit" 2203 35) "alternative") BODY[HEADER.FIELDS ("Subject" "From" "Date" "Message-Id" "References" "In-Reply-To" "Xref" "To" "Newsgroups" "Comments")] {223}
* 477 FETCH (UID 2169 RFC822.SIZE 4155 BODY (("text" "plain" ("charset" "us-ascii") NIL NIL "8bit" 694 7)("text" "html" ("charset" "us-ascii") NIL NIL "8bit" 1327 3) "alternative") BODY[HEADER.FIELDS ("Subject" "From" "Date" "Message-Id" "References" "In-Reply-To" "Xref" "To" "Newsgroups" "Comments")] {198}
* 478 FETCH (UID 2170 RFC822.SIZE 2721 BODY ("text" "plain" ("charset" "us-ascii") NIL NIL "7bit" 480 16) BODY[HEADER.FIELDS ("Subject" "From" "Date" "Message-Id" "References" "In-Reply-To" "Xref" "To" "Newsgroups" "Comments")] {186}
* 480 FETCH (UID 2174 RFC822.SIZE 9193 BODY (("text" "plain" ("charset" "us-ascii") NIL NIL "8bit" 687 26)("text" "html" ("charset" "us-ascii") NIL NIL "8bit" 6102 91) "alternative") BODY[HEADER.FIELDS ("Subject" "From" "Date" "Message-Id" "References" "In-Reply-To" "Xref" "To" "Newsgroups" "Comments")] {220}
* 481 FETCH (UID 2175 RFC822.SIZE 9296 BODY (("text" "plain" ("charset" "us-ascii") NIL NIL "8bit" 718 26)("text" "html" ("charset" "us-ascii") NIL NIL "8bit" 6141 91) "alternative") BODY[HEADER.FIELDS ("Subject" "From" "Date" "Message-Id" "References" "In-Reply-To" "Xref" "To" "Newsgroups" "Comments")] {229}
* 482 FETCH (UID 2176 RFC822.SIZE 2478 BODY ("text" "plain" ("charset" "us-ascii" "format" "flowed") NIL NIL "7bit" 233 15) BODY[HEADER.FIELDS ("Subject" "From" "Date" "Message-Id" "References" "In-Reply-To" "Xref" "To" "Newsgroups" "Comments")] {196}
* 483 FETCH (UID 2177 RFC822.SIZE 2957 BODY (("text" "plain" ("charset" "us-ascii" "format" "flowed") NIL NIL "7bit" 280 12)("application" "pgp-signature" ("name" "signature.asc") NIL "OpenPGP digital signature" "8bit" 257) "signed") BODY[HEADER.FIELDS ("Subject" "From" "Date" "Message-Id" "References" "In-Reply-To" "Xref" "To" "Newsgroups" "Comments")] {182}
* 484 FETCH (UID 2178 RFC822.SIZE 2199 BODY ("text" "plain" ("charset" "us-ascii" "format" "flowed") NIL NIL "7bit" 426 10) BODY[HEADER.FIELDS ("Subject" "From" "Date" "Message-Id" "References" "In-Reply-To" "Xref" "To" "Newsgroups" "Comments")] {187}
* 485 FETCH (UID 2179 RFC822.SIZE 2238 BODY ("text" "plain" ("charset" "us-ascii") NIL NIL "8bit" 430 15) BODY[HEADER.FIELDS ("Subject" "From" "Date" "Message-Id" "References" "In-Reply-To" "Xref" "To" "Newsgroups" "Comments")] {193}
* 486 FETCH (UID 2180 RFC822.SIZE 7855 BODY (("text" "plain" ("charset" "us-ascii") NIL NIL "8bit" 668 26)("text" "html" ("charset" "us-ascii") NIL NIL "8bit" 4809 78) "alternative") BODY[HEADER.FIELDS ("Subject" "From" "Date" "Message-Id" "References" "In-Reply-To" "Xref" "To" "Newsgroups" "Comments")] {195}
* 487 FETCH (UID 2181 RFC822.SIZE 2755 BODY ("text" "plain" ("charset" "us-ascii" "format" "flowed") NIL NIL "7bit" 517 16) BODY[HEADER.FIELDS ("Subject" "From" "Date" "Message-Id" "References" "In-Reply-To" "Xref" "To" "Newsgroups" "Comments")] {189}
* 488 FETCH (UID 2182 RFC822.SIZE 59776 BODY ("text" "plain" NIL NIL NIL "8bit" 57011 1212) BODY[HEADER.FIELDS ("Subject" "From" "Date" "Message-Id" "References" "In-Reply-To" "Xref" "To" "Newsgroups" "Comments")] {189}
* 489 FETCH (UID 2183 RFC822.SIZE 5842 BODY ("text" "plain" ("charset" "us-ascii") NIL NIL "7bit" 564 22) BODY[HEADER.FIELDS ("Subject" "From" "Date" "Message-Id" "References" "In-Reply-To" "Xref" "To" "Newsgroups" "Comments")] {3164}
* 490 FETCH (UID 2184 RFC822.SIZE 2636 BODY ("text" "plain" ("charset" "us-ascii" "format" "flowed") NIL NIL "7bit" 500 19) BODY[HEADER.FIELDS ("Subject" "From" "Date" "Message-Id" "References" "In-Reply-To" "Xref" "To" "Newsgroups" "Comments")] {352}
* 491 FETCH (UID 2185 RFC822.SIZE 2289 BODY ("text" "plain" ("charset" "us-ascii") NIL NIL "8bit" 354 20) BODY[HEADER.FIELDS ("Subject" "From" "Date" "Message-Id" "References" "In-Reply-To" "Xref" "To" "Newsgroups" "Comments")] {299}
* 492 FETCH (UID 2186 RFC822.SIZE 2247 BODY ("text" "plain" NIL NIL NIL "8bit" 350 13) BODY[HEADER.FIELDS ("Subject" "From" "Date" "Message-Id" "References" "In-Reply-To" "Xref" "To" "Newsgroups" "Comments")] {302}
* 493 FETCH (UID 2187 RFC822.SIZE 2271 BODY ("text" "plain" NIL NIL NIL "8bit" 345 12) BODY[HEADER.FIELDS ("Subject" "From" "Date" "Message-Id" "References" "In-Reply-To" "Xref" "To" "Newsgroups" "Comments")] {313}
386 OK FETCH completed.

-- 
Chris Green <cmg@dok.org>
A good pun is its own reword.

Re: Losing tickmarks in nnimap groups

[Chris Green]

[-- Attachment #1: Type: text/plain, Size: 1604 bytes --]

Simon Josefsson <jas@extundo.com> writes:

> I always run with `imap-log' enabled, so I can look at what happened
> if something weird happens.  It might not help reproduce the problem,
> but could give some hints to help pin point a pattern or something.

I'm using Oort 5.10.6.  This message isn't flagged because I can't get
gnus to display it no matter the value I pass to the group open
function. I have a plugged agent doing imap over openssl and I think
that's about the only notable gnus config.

I've not included the output from the * 477 fetch commands.  If they
are important to you, I can send them in private, I just don't want to
sign up all my friends for spam :).

I'm willing to try most commands and I can atleast plod at lisp but
debugging this problem (it's not the first message to have that happen
to ) is close to impossible for me without guidance. If I do an nnir
search for flight, it does display.

Maildir/cur/1081245048.27012_3.lilly:2,S

Maildir/courierimapuiddb has

2173 1081245048.27012_3.lilly

(2188 is the highest number I have right now so C-u 30 should pull
that out )

0:nnimap+csoft:INBOX 
C-u 30 Enter

This mail is flight information from my wife on where to pick up my
mother in law... a really bad mail to have had problem with :)

I have the imap.log for this from the C-u 30 Enter 

The only time I see 2173 as a UID in this log is on the initial search
seen command.

Here's the output from reentering the INBOX. I originally had this
posted inline but nntp.gmane.org said my article only had headers.

Sorry if I've sent multiple copies of this message.


[-- Attachment #2: imap-to-gnus.txt.gz --]
[-- Type: application/octet-stream, Size: 2483 bytes --]

[-- Attachment #3: Type: text/plain, Size: 61 bytes --]


-- 
Chris Green <cmg@dok.org>
A good pun is its own reword.