nnimap fails with TLS error when trying to open a davmail server

nnimap fails with TLS error when trying to open a davmail server

[Steinar Bang]

Platform: Intel P4,
	  debian testing ("jessie"),
          GNU Emacs 24.3.1 (i486-pc-linux-gnu, GTK+ Version 3.4.2) of 2013-04-13 on murphy, modified by Debian
          libgnutls26:i386 2.12.20-6
          Ma Gnus v0.8
          davmail 4.3.1-2134-1


I have started a davmail http://davmail.sourceforge.net/ server that
talks to an Exchange server.  But nnimap fails when trying to open the
IMAP server presented by davmail.

Here is the server definition (created in the server buffer, not as a
select method):
 (nnimap "davmail"
         (nnimap-server-port 1143)
         (nnimap-address "localhost")
         (nnimap-stream starttls))

The error message from the Messages buffer, is:
 Opening connection to localhost...
 Unable to open server nnimap+davmail due to: Buffer  *nnimap localhost 1143  *nntpd**-720412 has no process


If I change the server definition to
 (nnimap "davmail"
         (nnimap-server-port 1143)
         (nnimap-address "localhost")
         (nnimap-stream ssl))
or
 (nnimap "davmail"
         (nnimap-server-port 1143)
         (nnimap-address "localhost")
         (nnimap-stream tls))

then I get the following error message in the Messages buffer (the same
error message for both of the above nnimap-stream values):

 Opening connection to localhost via tls...
 gnutls.c: [0] (Emacs) fatal error: An unexpected TLS packet was received.
 gnutls.el: (err=[-15] An unexpected TLS packet was received.) boot: (:priority NORMAL :hostname localhost :loglevel 0 :min-prime-bits 256 :trustfiles (/etc/ssl/certs/ca-certificates.crt) :crlfiles nil :keylist nil :verify-flags nil :verify-error nil :verify-hostname-error nil :callbacks nil)
 Unable to open server nnimap+davmail due to: GnuTLS error: #<process *nnimap*<1>>, -15
gnutls.c: [0] (Emacs) fatal error: An unexpected TLS packet was received. [100 times]
indent-relative: Buffer is read-only: #<buffer *Server*>

Does anyone know what might cause this?  Has anyone else had any success
with davmail?

Thanks!


- Steinar

Re: nnimap fails with TLS error when trying to open a davmail server

[Andreas Schwab]

Steinar Bang <sb@dod.no> writes:

>  gnutls.c: [0] (Emacs) fatal error: An unexpected TLS packet was received.
>  gnutls.el: (err=[-15] An unexpected TLS packet was received.) boot: (:priority NORMAL :hostname localhost :loglevel 0 :min-prime-bits 256 :trustfiles (/etc/ssl/certs/ca-certificates.crt) :crlfiles nil :keylist nil :verify-flags nil :verify-error nil :verify-hostname-error nil :callbacks nil)
>  Unable to open server nnimap+davmail due to: GnuTLS error: #<process *nnimap*<1>>, -15
> gnutls.c: [0] (Emacs) fatal error: An unexpected TLS packet was received. [100 times]

What happens when you connect directly with gnutls-cli?

Andreas.

-- 
Andreas Schwab, schwab@linux-m68k.org
GPG Key fingerprint = 58CA 54C7 6D53 942B 1756  01D3 44D5 214B 8276 4ED5
"And now for something completely different."

Re: nnimap fails with TLS error when trying to open a davmail server

[Steinar Bang]

>>>>> Andreas Schwab <schwab@linux-m68k.org>:

> What happens when you connect directly with gnutls-cli?

sb@edwards:~$ gnutls-cli -V -p 1143 localhost
Resolving 'localhost'...
Connecting to '::1:1143'...
*** Fatal error: An unexpected TLS packet was received.
*** Handshake has failed
GnuTLS error: An unexpected TLS packet was received.

("verbose" wasn't very verbose... no difference from without the -V
flag...)

Stack Overflow says "a gnutls bug"... 
 http://stackoverflow.com/questions/10383866/error-while-using-mutt-gnutls-handshake-a-tls-packet-with-unexpected-length-wa

Re: nnimap fails with TLS error when trying to open a davmail server

[Steinar Bang]

>>>>> Steinar Bang <sb@dod.no>:
>>>>> Andreas Schwab <schwab@linux-m68k.org>:

>> What happens when you connect directly with gnutls-cli?

> sb@edwards:~$ gnutls-cli -V -p 1143 localhost
> Resolving 'localhost'...
> Connecting to '::1:1143'...
> *** Fatal error: An unexpected TLS packet was received.
> *** Handshake has failed
> GnuTLS error: An unexpected TLS packet was received.

Hm... telling gnutls-cli to use starttls actually seems to work, so why
does nnimap (with linked-in gnutls.so) fail...?

 sb@edwards:~$ gnutls-cli -V -s -p 1143 localhost
 Resolving 'localhost'...
 Connecting to '::1:1143'...

 - Simple Client Mode:

 - Received[87]: * OK [CAPABILITY IMAP4REV1 AUTH=LOGIN MOVE] IMAP4rev1 DavMail 4.3.1-2134 server ready

Re: nnimap fails with TLS error when trying to open a davmail server

[Steinar Bang]

>>>>> Steinar Bang <sb@dod.no>:

> Hm... telling gnutls-cli to use starttls actually seems to work, so why
> does nnimap (with linked-in gnutls.so) fail...?

>  sb@edwards:~$ gnutls-cli -V -s -p 1143 localhost
>  Resolving 'localhost'...
>  Connecting to '::1:1143'...

>  - Simple Client Mode:

>  - Received[87]: * OK [CAPABILITY IMAP4REV1 AUTH=LOGIN MOVE] IMAP4rev1 DavMail 4.3.1-2134 server ready

The error message from gnus with (nnimap-stream starttls) was:
 Opening connection to localhost...
 Unable to open server nnimap+davmail due to: Buffer  *nnimap localhost 1143  *nntpd**-720412 has no process

So I googled that error message instead, specifically:
 Unable to open server nnimap+davmail due to
and found this article:
 http://article.gmane.org/gmane.emacs.gnus.user/15365
 nntp://news.gmane.org/gmane.emacs.gnus.user/15365

I changed the server definition to:
 (nnimap "davmail"
         (nnimap-server-port 1143)
         (nnimap-address "localhost")
         (nnimap-stream network))

(ie. "(nnimap-stream network)" instead of "(nnimap-stream starttls)")
and then the server opened and I could see the groups on that server.

I subscribed three groups, but when trying to enter them, I got
 gnus-select-newsgroup: Wrong type argument: number-or-marker-p, OK

I started a new emacs, ran
 (setq debug-on-error t)
and then
 M-x load-library nnimal.el RET
to load nnimap as emacs source, and then started Gnus.

This time I was able to enter the nnimap groups, though a group with 444
articles loaded veeeeery slooowly, and when I finally was able to enter
it, I saw only the newest article in the group, and like the author of
the above article, I saw "nobody" as the sender of that article.

(I didn't use agent on that nnimap server.  That might have speeded up
things, but it would have added an extra error source, and would have
ended up saving multiple copies of the same office documents on my local
hard disk...)

So in short, nnimap with davmail doesn't work in a useful manner right
now.

However, back in October 2010, with the new nnimap freshly in place,
nnimap+davmail seemed to be working:
 http://thread.gmane.org/gmane.emacs.gnus.general/69762/focus=73759
 nntp://news.gmane.org/gmane.emacs.gnus.general/73759

Are anyone else successfully using davmail and nnimap these days?

Thanks!


- Steinar

Re: nnimap fails with TLS error when trying to open a davmail server

[Ted Zlatanov]

On Sat, 08 Jun 2013 21:22:13 +0200 Steinar Bang <sb@dod.no> wrote: 

SB> Are anyone else successfully using davmail and nnimap these days?

I haven't heard of anyone (bug reports, feature requests) since then.
Except you :)

Ted

Issues with davmail and nnimap (Was: nnimap fails with TLS error when trying to open a davmail server)

[Steinar Bang]

>>>>> Ted Zlatanov <tzz@lifelogs.com>:
> On Sat, 08 Jun 2013 21:22:13 +0200 Steinar Bang <sb@dod.no> wrote: 

SB> Are anyone else successfully using davmail and nnimap these days?

> I haven't heard of anyone (bug reports, feature requests) since then.
> Except you :)

Well, there was this article on "the other gnus group" (gmane.emacs.gnus.users)
 http://article.gmane.org/gmane.emacs.gnus.user/15365
 nntp://news.gmane.org/gmane.emacs.gnus.user/15365
with the same symptoms that I had, once I got past the TLS issue, ie.
 - All articles had "unknown" as the sender in the Summary buffer
 - Slow group entry

Sounds like a good candidate for offlineimap and caching on a separate
imap server, actually (except I'm reluctant to use any of my own disk
space to cache all of that redundant info, ie. quotes of the entire
thread in each message, and multiple copies of office documents with
very small differences sent around for comments).

I might as well just use the web interface directly.

Re: Issues with davmail and nnimap

[Steinar Bang]

>>>>> Steinar Bang <sb@dod.no>:

> Well, there was this article on "the other gnus group" (gmane.emacs.gnus.users)
>  http://article.gmane.org/gmane.emacs.gnus.user/15365
>  nntp://news.gmane.org/gmane.emacs.gnus.user/15365
> with the same symptoms that I had, once I got past the TLS issue,

To recap:
 - The Summary buffer only shows a single article
 - The article has nobody as the sender, and no subject

Today I decided to take a look at the nnimap buffer for the davmail
server, and it turns out I have a lot of them:
 *nnimap localhost 1143  *nntpd**
 *nnimap localhost 1143  *nntpd**-105928
 *nnimap localhost 1143  *nntpd**-106132
 *nnimap localhost 1143  *nntpd**-107902
 *nnimap localhost 1143  *nntpd**-108050
 *nnimap localhost 1143  *nntpd**-108440
 *nnimap localhost 1143  *nntpd**-10879
  ...
  [snip! In total: 1536 buffers at the time of writing]

The contents of the buffer without a -number suffix, ie. 
" *nnimap localhost 1143  *nntpd**", is:
* 93 EXISTS
* 1 RECENT
* OK [UIDVALIDITY 1]
* OK [UIDNEXT 96]
* FLAGS (%Answered %Deleted %Draft %Flagged %Seen $Forwarded Junk)
* OK [PERMANENTFLAGS (%Answered %Deleted %Draft %Flagged %Seen $Forwarded Junk %*)]
106 OK [READ-ONLY] EXAMINE completed
* 1 FETCH (UID 1 FLAGS (%Seen))
* 2 FETCH (UID 2 FLAGS (%Seen))
* 3 FETCH (UID 3 FLAGS (%Seen))
* 4 FETCH (UID 4 FLAGS (%Seen))
* 5 FETCH (UID 5 FLAGS (%Seen))
* 6 FETCH (UID 6 FLAGS (%Seen))
* 7 FETCH (UID 7 FLAGS (%Seen))
* 8 FETCH (UID 8 FLAGS (%Seen))
* 9 FETCH (UID 9 FLAGS (%Seen))
* 10 FETCH (UID 10 FLAGS (%Seen))
* 11 FETCH (UID 11 FLAGS (%Seen))
* 12 FETCH (UID 12 FLAGS (%Seen))
* 13 FETCH (UID 13 FLAGS (%Seen))
* 14 FETCH (UID 14 FLAGS (%Seen))
* 15 FETCH (UID 15 FLAGS (%Seen))
* 16 FETCH (UID 16 FLAGS (%Seen))
* 17 FETCH (UID 17 FLAGS (%Seen))
* 18 FETCH (UID 18 FLAGS (%Seen))
* 19 FETCH (UID 19 FLAGS (%Seen))
* 20 FETCH (UID 20 FLAGS (%Seen))
* 21 FETCH (UID 21 FLAGS (%Seen))
* 22 FETCH (UID 22 FLAGS (%Seen))
* 23 FETCH (UID 24 FLAGS (%Seen))
* 24 FETCH (UID 25 FLAGS (%Seen))
* 25 FETCH (UID 26 FLAGS (%Seen))
* 26 FETCH (UID 27 FLAGS (%Seen))
* 27 FETCH (UID 28 FLAGS (%Seen))
* 28 FETCH (UID 29 FLAGS (%Seen))
* 29 FETCH (UID 30 FLAGS (%Seen))
* 30 FETCH (UID 31 FLAGS (%Seen))
* 31 FETCH (UID 32 FLAGS (%Seen))
* 32 FETCH (UID 33 FLAGS (%Seen))
* 33 FETCH (UID 34 FLAGS (%Seen))
* 34 FETCH (UID 35 FLAGS (%Seen))
* 35 FETCH (UID 36 FLAGS (%Seen))
* 36 FETCH (UID 37 FLAGS (%Seen))
* 37 FETCH (UID 38 FLAGS (%Seen))
* 38 FETCH (UID 39 FLAGS (%Seen))
* 39 FETCH (UID 40 FLAGS (%Seen))
* 40 FETCH (UID 41 FLAGS (%Seen))
* 41 FETCH (UID 42 FLAGS (%Seen))
* 42 FETCH (UID 43 FLAGS (%Seen))
* 43 FETCH (UID 44 FLAGS (%Seen))
* 44 FETCH (UID 45 FLAGS (%Seen))
* 45 FETCH (UID 47 FLAGS (%Seen))
* 46 FETCH (UID 48 FLAGS (%Seen))
* 47 FETCH (UID 49 FLAGS (%Seen))
* 48 FETCH (UID 50 FLAGS (%Seen))
* 49 FETCH (UID 51 FLAGS (%Seen))
* 50 FETCH (UID 52 FLAGS (%Seen))
* 51 FETCH (UID 53 FLAGS (%Seen))
* 52 FETCH (UID 54 FLAGS (%Seen))
* 53 FETCH (UID 55 FLAGS (%Seen))
* 54 FETCH (UID 56 FLAGS (%Seen))
* 55 FETCH (UID 57 FLAGS (%Seen))
* 56 FETCH (UID 58 FLAGS (%Seen))
* 57 FETCH (UID 59 FLAGS (%Seen))
* 58 FETCH (UID 60 FLAGS (%Seen))
* 59 FETCH (UID 61 FLAGS (%Seen))
* 60 FETCH (UID 62 FLAGS (%Seen))
* 61 FETCH (UID 63 FLAGS (%Seen))
* 62 FETCH (UID 64 FLAGS (%Seen))
* 63 FETCH (UID 65 FLAGS (%Seen))
* 64 FETCH (UID 66 FLAGS (%Seen))
* 65 FETCH (UID 67 FLAGS (%Seen))
* 66 FETCH (UID 68 FLAGS (%Seen))
* 67 FETCH (UID 69 FLAGS (%Seen))
* 68 FETCH (UID 70 FLAGS (%Seen))
* 69 FETCH (UID 71 FLAGS (%Seen))
* 70 FETCH (UID 72 FLAGS (%Seen))
* 71 FETCH (UID 73 FLAGS (%Seen))
* 72 FETCH (UID 74 FLAGS (%Seen))
* 73 FETCH (UID 75 FLAGS (%Seen))
* 74 FETCH (UID 76 FLAGS (%Seen))
* 75 FETCH (UID 77 FLAGS (%Seen))
* 76 FETCH (UID 78 FLAGS (%Seen))
* 77 FETCH (UID 79 FLAGS (%Seen))
* 78 FETCH (UID 80 FLAGS (%Seen))
* 79 FETCH (UID 81 FLAGS (%Seen))
* 80 FETCH (UID 82 FLAGS (%Seen))
* 81 FETCH (UID 83 FLAGS (%Seen))
* 82 FETCH (UID 84 FLAGS (%Seen))
* 83 FETCH (UID 85 FLAGS (%Seen))
* 84 FETCH (UID 86 FLAGS (%Seen))
* 85 FETCH (UID 87 FLAGS (%Seen))
* 86 FETCH (UID 88 FLAGS (%Seen))
* 87 FETCH (UID 89 FLAGS (%Seen))
* 88 FETCH (UID 90 FLAGS (%Seen))
* 89 FETCH (UID 91 FLAGS (%Seen))
* 90 FETCH (UID 92 FLAGS (%Seen))
* 91 FETCH (UID 93 FLAGS (%Seen))
* 92 FETCH (UID 94 FLAGS (%Seen))
* 93 FETCH (UID 95 FLAGS (%Recent))
107 OK UID FETCH completed
* 79 EXISTS
* 0 RECENT
* OK [UIDVALIDITY 1]
* OK [UIDNEXT 104]
* FLAGS (%Answered %Deleted %Draft %Flagged %Seen $Forwarded Junk)
* OK [PERMANENTFLAGS (%Answered %Deleted %Draft %Flagged %Seen $Forwarded Junk %*)]
108 OK [READ-ONLY] EXAMINE completed
* 3 FETCH (UID 3 FLAGS (%Seen))
* 4 FETCH (UID 4 FLAGS (%Seen))
* 5 FETCH (UID 5 FLAGS (%Seen))
* 6 FETCH (UID 6 FLAGS (%Seen))
* 7 FETCH (UID 7 FLAGS (%Seen %Answered))
* 8 FETCH (UID 8 FLAGS (%Seen))
* 9 FETCH (UID 9 FLAGS (%Seen))
* 10 FETCH (UID 10 FLAGS (%Seen))
* 11 FETCH (UID 11 FLAGS (%Seen))
* 12 FETCH (UID 12 FLAGS (%Seen))
* 13 FETCH (UID 13 FLAGS (%Seen))
* 14 FETCH (UID 14 FLAGS (%Seen))
* 15 FETCH (UID 15 FLAGS (%Seen))
* 16 FETCH (UID 16 FLAGS (%Seen))
* 17 FETCH (UID 17 FLAGS (%Seen))
* 18 FETCH (UID 18 FLAGS (%Seen))
* 19 FETCH (UID 19 FLAGS (%Seen))
* 20 FETCH (UID 20 FLAGS (%Seen))
* 21 FETCH (UID 21 FLAGS (%Seen))
* 22 FETCH (UID 22 FLAGS (%Seen))
* 23 FETCH (UID 23 FLAGS (%Seen))
* 24 FETCH (UID 24 FLAGS (%Seen))
* 25 FETCH (UID 25 FLAGS (%Seen))
* 26 FETCH (UID 26 FLAGS (%Seen))
* 27 FETCH (UID 27 FLAGS (%Seen))
* 28 FETCH (UID 28 FLAGS (%Seen))
* 29 FETCH (UID 29 FLAGS (%Seen))
* 30 FETCH (UID 30 FLAGS (%Seen))
* 31 FETCH (UID 31 FLAGS (%Seen))
* 32 FETCH (UID 32 FLAGS (%Seen))
* 33 FETCH (UID 33 FLAGS (%Seen))
* 34 FETCH (UID 34 FLAGS (%Seen))
* 35 FETCH (UID 37 FLAGS (%Seen))
* 36 FETCH (UID 38 FLAGS (%Seen))
* 37 FETCH (UID 39 FLAGS (%Seen))
* 38 FETCH (UID 40 FLAGS (%Seen))
* 39 FETCH (UID 41 FLAGS (%Seen))
* 40 FETCH (UID 42 FLAGS (%Seen))
* 41 FETCH (UID 43 FLAGS (%Seen))
* 42 FETCH (UID 44 FLAGS (%Seen))
* 43 FETCH (UID 45 FLAGS (%Seen))
* 44 FETCH (UID 46 FLAGS (%Seen))
* 45 FETCH (UID 47 FLAGS (%Seen))
* 46 FETCH (UID 48 FLAGS (%Seen))
* 47 FETCH (UID 49 FLAGS (%Seen))
* 48 FETCH (UID 51 FLAGS (%Seen))
* 49 FETCH (UID 52 FLAGS (%Seen))
* 50 FETCH (UID 54 FLAGS (%Seen))
* 51 FETCH (UID 55 FLAGS (%Seen))
* 52 FETCH (UID 58 FLAGS (%Seen))
* 53 FETCH (UID 62 FLAGS (%Seen %Answered))
* 54 FETCH (UID 63 FLAGS (%Seen))
* 55 FETCH (UID 64 FLAGS (%Seen))
* 56 FETCH (UID 66 FLAGS (%Seen))
* 57 FETCH (UID 67 FLAGS (%Seen))
* 58 FETCH (UID 70 FLAGS (%Seen))
* 59 FETCH (UID 72 FLAGS (%Seen))
* 60 FETCH (UID 73 FLAGS (%Seen))
* 61 FETCH (UID 74 FLAGS (%Seen))
* 62 FETCH (UID 80 FLAGS (%Seen))
* 63 FETCH (UID 82 FLAGS (%Seen))
* 64 FETCH (UID 83 FLAGS (%Seen))
* 65 FETCH (UID 84 FLAGS (%Seen))
* 66 FETCH (UID 85 FLAGS (%Seen))
* 67 FETCH (UID 86 FLAGS (%Seen))
* 68 FETCH (UID 87 FLAGS (%Seen))
* 69 FETCH (UID 89 FLAGS (%Seen))
* 70 FETCH (UID 90 FLAGS (%Seen))
* 71 FETCH (UID 91 FLAGS (%Seen))
* 72 FETCH (UID 92 FLAGS (%Seen))
* 73 FETCH (UID 93 FLAGS (%Seen))
* 74 FETCH (UID 97 FLAGS (%Seen))
* 75 FETCH (UID 98 FLAGS (%Seen))
* 76 FETCH (UID 99 FLAGS (%Seen))
* 77 FETCH (UID 100 FLAGS (%Seen))
* 78 FETCH (UID 102 FLAGS (%Seen))
* 79 FETCH (UID 103 FLAGS (%Seen))
109 OK UID FETCH completed
* 272 EXISTS
* 0 RECENT
* OK [UIDVALIDITY 1]
* OK [UIDNEXT 835]
* FLAGS (%Answered %Deleted %Draft %Flagged %Seen $Forwarded Junk)
* OK [PERMANENTFLAGS (%Answered %Deleted %Draft %Flagged %Seen $Forwarded Junk %*)]
110 OK [READ-ONLY] EXAMINE completed
* 242 FETCH (UID 747 FLAGS (%Seen))
* 243 FETCH (UID 748 FLAGS (%Seen))
* 244 FETCH (UID 749 FLAGS (%Seen))
* 245 FETCH (UID 750 FLAGS (%Seen))
* 246 FETCH (UID 751 FLAGS (%Seen))
* 247 FETCH (UID 752 FLAGS (%Seen))
* 248 FETCH (UID 753 FLAGS (%Seen))
* 249 FETCH (UID 754 FLAGS (%Seen))
* 250 FETCH (UID 755 FLAGS (%Seen))
* 251 FETCH (UID 756 FLAGS (%Seen))
* 252 FETCH (UID 762 FLAGS (%Seen %Answered))
* 253 FETCH (UID 765 FLAGS (%Seen %Answered))
* 254 FETCH (UID 767 FLAGS (%Seen))
* 255 FETCH (UID 768 FLAGS (%Seen))
* 256 FETCH (UID 769 FLAGS (%Seen))
* 257 FETCH (UID 780 FLAGS (%Seen))
* 258 FETCH (UID 790 FLAGS (%Seen %Answered))
* 259 FETCH (UID 792 FLAGS (%Seen))
* 260 FETCH (UID 796 FLAGS (%Seen %Answered))
* 261 FETCH (UID 803 FLAGS (%Seen))
* 262 FETCH (UID 807 FLAGS (%Seen %Answered))
* 263 FETCH (UID 808 FLAGS (%Seen))
* 264 FETCH (UID 811 FLAGS (%Seen %Answered))
* 265 FETCH (UID 812 FLAGS (%Seen %Answered))
* 266 FETCH (UID 815 FLAGS (%Seen %Answered))
* 267 FETCH (UID 816 FLAGS (%Seen %Answered))
* 268 FETCH (UID 818 FLAGS (%Seen %Answered))
* 269 FETCH (UID 820 FLAGS (%Seen %Answered))
* 270 FETCH (UID 827 FLAGS (%Seen))
* 271 FETCH (UID 833 FLAGS (%Seen))
* 272 FETCH (UID 834 FLAGS (%Seen))
111 OK UID FETCH completed
* BYE Closing connection

Process *nnimap*<1> connection broken by remote peer