auth-source problem

auth-source problem

[nyc4bos]

Hi,

I am having a problem with the new auth-source.el (from bzr)
and accessing my mail folders.


It appears to be connecting the same as previous versions of
auth-source.el because I see in the 
*nnimap imap.aim.com 993 *nntpd**: buffer:


* OK IMAP4 ready
* CAPABILITY IMAP4rev1 UIDPLUS ID NAMESPACE LOGIN-REFERRALS IDLE STARTTLS AUTH=XAOL-UAS-MB
1 OK completed



However, I see in the *Message* buffer:

Opening nnimap server on aol...
Opening connection to imap.aim.com via tls...
Opening TLS connection to `imap.aim.com'...
Opening TLS connection with `gnutls-cli -p 993 imap.aim.com'...done
Opening TLS connection to `imap.aim.com'...done
Unable to open server nnimap+aol due to: Invalid function: 993

Re: auth-source problem

[Ted Zlatanov]

On Sun, 06 Mar 2011 21:55:35 -0500 nyc4bos@aol.com wrote: 

n> I am having a problem with the new auth-source.el (from bzr)
n> and accessing my mail folders.

n> It appears to be connecting the same as previous versions of
n> auth-source.el because I see in the 
n> *nnimap imap.aim.com 993 *nntpd**: buffer:

n> * OK IMAP4 ready
n> * CAPABILITY IMAP4rev1 UIDPLUS ID NAMESPACE LOGIN-REFERRALS IDLE STARTTLS AUTH=XAOL-UAS-MB
n> 1 OK completed

n> However, I see in the *Message* buffer:

n> Opening nnimap server on aol...
n> Opening connection to imap.aim.com via tls...
n> Opening TLS connection to `imap.aim.com'...
n> Opening TLS connection with `gnutls-cli -p 993 imap.aim.com'...done
n> Opening TLS connection to `imap.aim.com'...done
n> Unable to open server nnimap+aol due to: Invalid function: 993

Please do `M-x toggle-debug-on-error' and customize `auth-source-debug'
to 'trivia.  Then show the resulting backtrace and all the lines that
match "auth-source" in *Messages*.  I can't tell where the error is.

Thanks
Ted

Re: auth-source problem

[nyc4bos]

Ted Zlatanov <tzz@lifelogs.com> writes:

> On Sun, 06 Mar 2011 21:55:35 -0500 nyc4bos@aol.com wrote: 
>
> n> I am having a problem with the new auth-source.el (from bzr)
> n> and accessing my mail folders.
>
> n> It appears to be connecting the same as previous versions of
> n> auth-source.el because I see in the 
> n> *nnimap imap.aim.com 993 *nntpd**: buffer:
>
> n> * OK IMAP4 ready
> n> * CAPABILITY IMAP4rev1 UIDPLUS ID NAMESPACE LOGIN-REFERRALS IDLE STARTTLS AUTH=XAOL-UAS-MB
> n> 1 OK completed
>
> n> However, I see in the *Message* buffer:
>
> n> Opening nnimap server on aol...
> n> Opening connection to imap.aim.com via tls...
> n> Opening TLS connection to `imap.aim.com'...
> n> Opening TLS connection with `gnutls-cli -p 993 imap.aim.com'...done
> n> Opening TLS connection to `imap.aim.com'...done
> n> Unable to open server nnimap+aol due to: Invalid function: 993
>
> Please do `M-x toggle-debug-on-error' and customize `auth-source-debug'
> to 'trivia.  Then show the resulting backtrace and all the lines that
> match "auth-source" in *Messages*.  I can't tell where the error is.

I updated to Gnus that came with Gnu Emacs created March 7, 2011.

There was no backtrace with `M-x toggle-debug-on-error'.

This is what I now see in the *Messages* buffer:

Opening nnimap server on aol...
Opening connection to imap.aim.com via tls...
Opening TLS connection to `imap.aim.com'...
Opening TLS connection with `gnutls-cli -p 993 imap.aim.com'...failed
Opening TLS connection with `gnutls-cli -p 993 imap.aim.com --protocols ssl3'...failed
Opening TLS connection with `openssl s_client -connect imap.aim.com:993 -no_ssl2 -ign_eof'...failed
Opening TLS connection to `imap.aim.com'...failed
Opening nnimap server on aol...failed: Unable to contact
imap.aim.com:nil via ssl


The `gnutls-cli -p 993 imap.aim.com' command(s) work fine from the
command line.

I think that with the latest Gnus that this problem is not (primarily)
with auth-source.el but something related to it, but that's just a
guess.

>
> Thanks
> Ted

Re: auth-source problem

[Ted Zlatanov]

On Tue, 08 Mar 2011 21:40:15 -0500 nyc4bos@aol.com wrote: 

n> This is what I now see in the *Messages* buffer:

n> Opening nnimap server on aol...
n> Opening connection to imap.aim.com via tls...
n> Opening TLS connection to `imap.aim.com'...
n> Opening TLS connection with `gnutls-cli -p 993 imap.aim.com'...failed
n> Opening TLS connection with `gnutls-cli -p 993 imap.aim.com --protocols ssl3'...failed
n> Opening TLS connection with `openssl s_client -connect imap.aim.com:993 -no_ssl2 -ign_eof'...failed
n> Opening TLS connection to `imap.aim.com'...failed
n> Opening nnimap server on aol...failed: Unable to contact imap.aim.com:nil via ssl

n> The `gnutls-cli -p 993 imap.aim.com' command(s) work fine from the
n> command line.

n> I think that with the latest Gnus that this problem is not (primarily)
n> with auth-source.el but something related to it, but that's just a
n> guess.

Since there's nothing related to auth-source even after you set
`auth-source-debug' to 'trivia, I am sure that the failure is before
auth-source is invoked and there's connection to authenticate.
Specifically here, you're not connecting to imap.aim.com because the
port seems to be nil.  Could it be that you have a bad server
definition?  Can you show your server definition for "aol" that has the
server address "imap.aim.com"?

Ted

Re: auth-source problem

[nyc4bos]

Ted Zlatanov <tzz@lifelogs.com> writes:

> On Tue, 08 Mar 2011 21:40:15 -0500 nyc4bos@aol.com wrote: 
>
> n> This is what I now see in the *Messages* buffer:
>
> n> Opening nnimap server on aol...
> n> Opening connection to imap.aim.com via tls...
> n> Opening TLS connection to `imap.aim.com'...
> n> Opening TLS connection with `gnutls-cli -p 993 imap.aim.com'...failed
> n> Opening TLS connection with `gnutls-cli -p 993 imap.aim.com --protocols ssl3'...failed
> n> Opening TLS connection with `openssl s_client -connect imap.aim.com:993 -no_ssl2 -ign_eof'...failed
> n> Opening TLS connection to `imap.aim.com'...failed
> n> Opening nnimap server on aol...failed: Unable to contact imap.aim.com:nil via ssl
>
> n> The `gnutls-cli -p 993 imap.aim.com' command(s) work fine from the
> n> command line.
>
> n> I think that with the latest Gnus that this problem is not (primarily)
> n> with auth-source.el but something related to it, but that's just a
> n> guess.
>
> Since there's nothing related to auth-source even after you set
> `auth-source-debug' to 'trivia, I am sure that the failure is before
> auth-source is invoked and there's connection to authenticate.

Agreed.

> Specifically here, you're not connecting to imap.aim.com because the
> port seems to be nil.  Could it be that you have a bad server
> definition?  Can you show your server definition for "aol" that has the
> server address "imap.aim.com"?

Here it is:

Value: ((nnfolder "")
 (nnimap "aol"
	 (nnimap-address "imap.aim.com")
	 (nnimap-server-port 993)
	 (nnimap-stream ssl)
	 (nnimap-list-pattern
	  ("*"))
	 (nnir-search-engine imap)))

Original value was nil


Possibly not related:


Since my *Message* buffer says:

Opening nnimap server on aol...
Opening connection to imap.aim.com via tls...
Opening TLS connection to `imap.aim.com'...
Opening TLS connection with `gnutls-cli -p 993 imap.aim.com'...failed
Opening TLS connection with `gnutls-cli -p 993 imap.aim.com --protocols ssl3'...failed
Opening TLS connection with `openssl s_client -connect imap.aim.com:993 -no_ssl2 -ign_eof'...failed
Opening TLS connection to `imap.aim.com'...failed
Opening nnimap server on aol...failed: Unable to contact
imap.aim.com:nil via ssl
Checking new news...done
Warning: Opening nnimap server on aol...failed: Unable to contact imap.aim.com:nil via ssl



Why does it specify "Opening ...tls" since I set nnimap-stream
to "ssl"?


Thanks.

Re: auth-source problem

[Ted Zlatanov]

On Wed, 09 Mar 2011 23:53:32 -0500 nyc4bos@aol.com wrote: 

n> Value: ((nnfolder "")
n>  (nnimap "aol"
n> 	 (nnimap-address "imap.aim.com")
n> 	 (nnimap-server-port 993)
n> 	 (nnimap-stream ssl)
n> 	 (nnimap-list-pattern
n> 	  ("*"))
n> 	 (nnir-search-engine imap)))

n> Since my *Message* buffer says:

n> Opening nnimap server on aol...
n> Opening connection to imap.aim.com via tls...
n> Opening TLS connection to `imap.aim.com'...
n> Opening TLS connection with `gnutls-cli -p 993 imap.aim.com'...failed
n> Opening TLS connection with `gnutls-cli -p 993 imap.aim.com --protocols ssl3'...failed
n> Opening TLS connection with `openssl s_client -connect imap.aim.com:993 -no_ssl2 -ign_eof'...failed
n> Opening TLS connection to `imap.aim.com'...failed
n> Opening nnimap server on aol...failed: Unable to contact
n> imap.aim.com:nil via ssl
n> Checking new news...done
n> Warning: Opening nnimap server on aol...failed: Unable to contact imap.aim.com:nil via ssl

n> Why does it specify "Opening ...tls" since I set nnimap-stream
n> to "ssl"?

Unfortunately I don't know.  Lars is the expert on this.

Ted

Re: auth-source problem

[nyc4bos]

Ted Zlatanov <tzz@lifelogs.com> writes:

> On Wed, 09 Mar 2011 23:53:32 -0500 nyc4bos@aol.com wrote: 
>
> n> Value: ((nnfolder "")
> n>  (nnimap "aol"
> n> 	 (nnimap-address "imap.aim.com")
> n> 	 (nnimap-server-port 993)
> n> 	 (nnimap-stream ssl)
> n> 	 (nnimap-list-pattern
> n> 	  ("*"))
> n> 	 (nnir-search-engine imap)))
>
> n> Since my *Message* buffer says:
>
> n> Opening nnimap server on aol...
> n> Opening connection to imap.aim.com via tls...
> n> Opening TLS connection to `imap.aim.com'...
> n> Opening TLS connection with `gnutls-cli -p 993 imap.aim.com'...failed
> n> Opening TLS connection with `gnutls-cli -p 993 imap.aim.com --protocols ssl3'...failed
> n> Opening TLS connection with `openssl s_client -connect imap.aim.com:993 -no_ssl2 -ign_eof'...failed
> n> Opening TLS connection to `imap.aim.com'...failed
> n> Opening nnimap server on aol...failed: Unable to contact
> n> imap.aim.com:nil via ssl
> n> Checking new news...done
> n> Warning: Opening nnimap server on aol...failed: Unable to contact imap.aim.com:nil via ssl
>
> n> Why does it specify "Opening ...tls" since I set nnimap-stream
> n> to "ssl"?
>
> Unfortunately I don't know.  Lars is the expert on this.

OK, but I REBOOTed and now I see:

Opening nnimap server on aol...
Opening connection to imap.aim.com via tls...
Opening TLS connection to `imap.aim.com'...
Opening TLS connection with `gnutls-cli -p 993 imap.aim.com'...done
Opening TLS connection to `imap.aim.com'...done
auth-source-search: found 1 backends matching (:max 1 :host ("imap.aim.com" "aol") :port (993 "imaps" "imap" "993" "143") :require (:user :secret) :create t)
auth-source-netrc-parse: using CACHED file data for ~/.authinfo.gpg
auth-source-search: found 0 results (max 1) matching (:max 1 :host ("imap.aim.com" "aol") :port (993 "imaps" "imap" "993" "143") :require (:user :secret) :create t)
auth-source-netrc-parse: using CACHED file data for ~/.authinfo.gpg
Unable to open server nnimap+aol due to: Invalid function: 993


auth-source.el doesn't show up (not prompting) for AOL at all and
I do NOT have it in my ~/.authinfo.gpg file so I think at least
this problem is related to auth-source.el

Thanks.
>
> Ted

Re: auth-source problem

[Ted Zlatanov]

On Sat, 12 Mar 2011 00:47:31 -0500 nyc4bos@aol.com wrote: 

n> Unable to open server nnimap+aol due to: Invalid function: 993

n> auth-source.el doesn't show up (not prompting) for AOL at all and
n> I do NOT have it in my ~/.authinfo.gpg file so I think at least
n> this problem is related to auth-source.el

You were right and I finally found the problem.  nnimap.el traps the
error so you don't know it came from auth-source.el (actually from
`replace-regexp-in-string' which tries to evaluate non-string
arguments).  I believe it's fixed now.

Ted

Re: auth-source problem

[nyc4bos]

Ted Zlatanov <tzz@lifelogs.com> writes:

> On Sat, 12 Mar 2011 00:47:31 -0500 nyc4bos@aol.com wrote: 
>
> n> Unable to open server nnimap+aol due to: Invalid function: 993
>
> n> auth-source.el doesn't show up (not prompting) for AOL at all and
> n> I do NOT have it in my ~/.authinfo.gpg file so I think at least
> n> this problem is related to auth-source.el
>
> You were right and I finally found the problem.  nnimap.el traps the
> error so you don't know it came from auth-source.el (actually from
> `replace-regexp-in-string' which tries to evaluate non-string
> arguments).  I believe it's fixed now.

Yes, it's fixed now with the patch in git that I obtained.

Thanks for hunting this bug down!

One issue I still have though:

The prompt says:

   IMAP user at imap.gmail.com:


I think that the prompt should have the default user showing.

Before, you were able to specify in your gnus-(secondary)-select-methods:

...
        (nnimap "aol"
                (nnimap-address "imap.aim.com")
                (nnimap-server-port 993)
                (nnimap-stream ssl)
                (imap-default-user "nyc4bos"))


This was when nnimap used imap.el but I think a `nnimap-username' should
be defined (`nil' as the default, meaning use '(user-login-name)' as per
auth-source.el if found in authinfo(.gpg), netrc, or `nnimap-username'
is not set).

I believe it was Katsumi Yamaoka that provided such a patch to
nnimap.el using:

(defvoo nnimap-username nil
  "The IMAP username used to login.")

(defun nnimap-credentials (address ports &optional username)
...


In any event, I think that `(user-login-name)' should at least
show up in the prompt if not `nnimap-username'.

(Yes, I realize that it will use `(user-login-name)' if you just
hit RET at the prompt even if it doesn't originally show it.

I think you also rseponded to Stefan in bug#8050 that you fixed
this (showing the default user) but I can't seem to find that patch
in either git or bzr as of yet).

Thanks.

Re: auth-source problem

[Ted Zlatanov]

On Sun, 13 Mar 2011 00:28:20 -0500 nyc4bos@aol.com wrote: 

n> One issue I still have though:
n> The prompt says:
n>    IMAP user at imap.gmail.com:
n> I think that the prompt should have the default user showing.

Ah, yes.  Oops.  I forgot to put "(default nyc4bos)" in the prompt, even
though it was acceptable as a default already.  Your guess was right.
The prompt is fixed.

n> Before, you were able to specify in your gnus-(secondary)-select-methods:

n> ...
n>         (nnimap "aol"
n>                 (nnimap-address "imap.aim.com")
n>                 (nnimap-server-port 993)
n>                 (nnimap-stream ssl)
n>                 (imap-default-user "nyc4bos"))


n> This was when nnimap used imap.el but I think a `nnimap-username' should
n> be defined (`nil' as the default, meaning use '(user-login-name)' as per
n> auth-source.el if found in authinfo(.gpg), netrc, or `nnimap-username'
n> is not set).

Yes, that's how it should work.  Let me know if it doesn't.

n> I think you also rseponded to Stefan in bug#8050 that you fixed
n> this (showing the default user) but I can't seem to find that patch
n> in either git or bzr as of yet).

The commits are 57a4bf164075fe2c36b4a311a3199229ac29a460 and
219e1b4f2ae915ca712ed4fb049dde83cf3f6a35.

Thanks for your patience.
Ted

Re: auth-source problem

[nyc4bos]

Ted Zlatanov <tzz@lifelogs.com> writes:

> On Sun, 13 Mar 2011 00:28:20 -0500 nyc4bos@aol.com wrote: 
>
> n> One issue I still have though:
> n> The prompt says:
> n>    IMAP user at imap.gmail.com:
> n> I think that the prompt should have the default user showing.
>
> Ah, yes.  Oops.  I forgot to put "(default nyc4bos)" in the prompt, even
> though it was acceptable as a default already.  Your guess was right.
> The prompt is fixed.
>
> n> Before, you were able to specify in your gnus-(secondary)-select-methods:
>
> n> ...
> n>         (nnimap "aol"
> n>                 (nnimap-address "imap.aim.com")
> n>                 (nnimap-server-port 993)
> n>                 (nnimap-stream ssl)
> n>                 (imap-default-user "nyc4bos"))
>
>
> n> This was when nnimap used imap.el but I think a `nnimap-username' should
> n> be defined (`nil' as the default, meaning use '(user-login-name)' as per
> n> auth-source.el if found in authinfo(.gpg), netrc, or `nnimap-username'
> n> is not set).
>
> Yes, that's how it should work.  Let me know if it doesn't.

I think you need to modify auth-source.el from this:

                        (user-login-name))

to this:

                        (if (not nnimap-username)
                          (user-login-name)
                            nnimap-username))

in order to get the prompting to work.

>
> n> I think you also rseponded to Stefan in bug#8050 that you fixed
> n> this (showing the default user) but I can't seem to find that patch
> n> in either git or bzr as of yet).
>
> The commits are 57a4bf164075fe2c36b4a311a3199229ac29a460 and
> 219e1b4f2ae915ca712ed4fb049dde83cf3f6a35.
>
> Thanks for your patience.

Thanks for your efforts with auth-source.el !

> Ted

Re: auth-source problem

[Ted Zlatanov]

On Wed, 16 Mar 2011 23:27:41 -0400 nyc4bos@aol.com wrote: 

n> Ted Zlatanov <tzz@lifelogs.com> writes:
>> On Sun, 13 Mar 2011 00:28:20 -0500 nyc4bos@aol.com wrote: 

n> Before, you were able to specify in your gnus-(secondary)-select-methods:
>> 
n> ...
n> (nnimap "aol"
n> (nnimap-address "imap.aim.com")
n> (nnimap-server-port 993)
n> (nnimap-stream ssl)
n> (imap-default-user "nyc4bos"))
>> 
>> 
n> This was when nnimap used imap.el but I think a `nnimap-username' should
n> be defined (`nil' as the default, meaning use '(user-login-name)' as per
n> auth-source.el if found in authinfo(.gpg), netrc, or `nnimap-username'
n> is not set).
>> 
>> Yes, that's how it should work.  Let me know if it doesn't.

n> I think you need to modify auth-source.el from this:

n>                         (user-login-name))

n> to this:

n>                         (if (not nnimap-username)
n>                           (user-login-name)
n>                             nnimap-username))

n> in order to get the prompting to work.

OK, I see now that `nnimap-username' is gone, so my "that's how it
should work" is wrong.  

So the question is, do we bring `nnimap-username' back to make creation
easier?  I'd say it's not any better to add that variable globally or
per nnimap server than to enter the user name directly at that prompt or
by editing the netrc file.

Either way, I don't think auth-source.el is the right place to add this
default.  Instead the caller (nnimap.el) should set
`auth-source-creation-defaults' if it knows better what the default
created user name should be.

Ted

Re: auth-source problem

[Lars Magne Ingebrigtsen]

Ted Zlatanov <tzz@lifelogs.com> writes:

> So the question is, do we bring `nnimap-username' back to make creation
> easier?  I'd say it's not any better to add that variable globally or
> per nnimap server than to enter the user name directly at that prompt or
> by editing the netrc file.

I don't think it makes much sense to add user names to all the
backends.  Credentials should be handled by auth-source...

-- 
(domestic pets only, the antidote for overdose, milk.)
  larsi@gnus.org * Lars Magne Ingebrigtsen

Re: auth-source problem

[Andreas Schwab]

nyc4bos@aol.com writes:

>                         (if (not nnimap-username)
>                           (user-login-name)
>                             nnimap-username))

                          (or nnimap-username (user-login-name))

Andreas.

-- 
Andreas Schwab, schwab@linux-m68k.org
GPG Key fingerprint = 58CA 54C7 6D53 942B 1756  01D3 44D5 214B 8276 4ED5
"And now for something completely different."