gnus and smtp auth

gnus and smtp auth

[Samir Saidani]

Hi all !

I'm trying to get gnus sending mail through smtp auth, but after
several hours, I'm definitely unsuccessful...

So here is the situation : I've got a laptop with a sarge debian
installed, and using gnus 5.10.7 and emacs 21.4.1, with the latest cvs
smtpmail and starttls files (byte-compiled).

I managed to send mail through smtpmail and without authentification
with no problems, and I can send mails through smtpmail with
authentification using gmail (I tried the .gnus here :
http://web.phys.ntnu.no/~terjeros/gnus-gmail/)

I also managed to send mail to smtp.xxx.com in few minutes (argh) using
mozilla mail, with the following settings : 
outgoing smtp : smtp.xxx.fr 
port 465 
use secure connection : ssl (the other choices don't work).

When I replace the .gnus configuration (from terjeros) with the right
settings, it hangs and there is nothing in smtp debug.

But I find a difference between smtp.gmail and smtp.xxx.com :

when I do a telnet :

gmail
Trying 64.233.185.109...
Connected to smtp.gmail.com.
Escape character is '^]'.
220 mx.gmail.com ESMTP d16sm1394590wra


smtp.xxx.com
Trying 2001:660:7101::6...
Trying xxx.xxx.xxx.xx...
Connected to smtp.xxx.com.
Escape character is '^]'.


and with
gnutls-cli  smtp.xxx.com -p 465

Resolving 'smtp.xxx.com'...
Connecting to 'x.x.x.x:465'...
- Certificate type: X.509
 - Got a certificate list of 1 certificates.

 - Certificate[0] info:
 # The hostname in the certificate does NOT match 'smtp.xxx.com'.
 # valid since: Sat Feb  5 11:20:00 CET 2005
 # expires at: Tue Feb  5 11:20:00 CET 2008
 # serial number: 00 9f 94 6f 16 5d 19 f2 4b
 # fingerprint: 5d 34 15 88 00 f7 6d 08 67 da 82 ba 5c 94 56 55 
blabla

- Peer's certificate issuer is unknown
- Peer's certificate is NOT trusted
- Version: TLS 1.0
- Key Exchange: RSA
- Cipher: AES 256 CBC
- MAC: SHA
- Compression: NULL
- Handshake was completed

- Simple Client Mode:

220 xxx ESMTP


So I tried different possibilities to get a .gnus.el working but now,
I'm stuck !

Help ?

Thanks !

Samir

gnus and smtp auth

[Samir Saidani]

Hi all !

I'm trying to get gnus sending mail through smtp auth, but after
several hours, I'm definitely unsuccessful...

So here is the situation : I've got a laptop with a sarge debian
installed, and using gnus 5.10.7 and emacs 21.4.1, with the latest cvs
smtpmail and starttls files (byte-compiled).

I managed to send mail through smtpmail and without authentification
with no problems, and I can send mails through smtpmail with
authentification using gmail (I tried the .gnus here :
http://web.phys.ntnu.no/~terjeros/gnus-gmail/)

I also managed to send mail to smtp.xxx.com in few minutes (argh) using
mozilla mail, with the following settings : 
outgoing smtp : smtp.xxx.fr 
port 465 
use secure connection : ssl (the other choices don't work).

When I replace the .gnus configuration (from terjeros) with the right
settings, it hangs and there is nothing in smtp debug.

But I find a difference between smtp.gmail and smtp.xxx.com :

when I do a telnet :

gmail
Trying 64.233.185.109...
Connected to smtp.gmail.com.
Escape character is '^]'.
220 mx.gmail.com ESMTP d16sm1394590wra


smtp.xxx.com
Trying 2001:660:7101::6...
Trying xxx.xxx.xxx.xx...
Connected to smtp.xxx.com.
Escape character is '^]'.


and with
gnutls-cli  smtp.xxx.com -p 465

Resolving 'smtp.xxx.com'...
Connecting to 'x.x.x.x:465'...
- Certificate type: X.509
 - Got a certificate list of 1 certificates.

 - Certificate[0] info:
 # The hostname in the certificate does NOT match 'smtp.xxx.com'.
 # valid since: Sat Feb  5 11:20:00 CET 2005
 # expires at: Tue Feb  5 11:20:00 CET 2008
 # serial number: 00 9f 94 6f 16 5d 19 f2 4b
 # fingerprint: 5d 34 15 88 00 f7 6d 08 67 da 82 ba 5c 94 56 55 
blabla

- Peer's certificate issuer is unknown
- Peer's certificate is NOT trusted
- Version: TLS 1.0
- Key Exchange: RSA
- Cipher: AES 256 CBC
- MAC: SHA
- Compression: NULL
- Handshake was completed

- Simple Client Mode:

220 xxx ESMTP


So I tried different possibilities to get a .gnus.el working but now,
I'm stuck !

Help ?

Thanks !

Samir

Re: gnus and smtp auth

[Simon Josefsson]

Samir Saidani <saidani@info.unicaen.fr> writes:

> When I replace the .gnus configuration (from terjeros) with the right
> settings, it hangs and there is nothing in smtp debug.

What's in *Messages*?  After (setq smtpmail-debug-info t), what do the
*trace...* buffer contain?  With (setq debug-on-quit t), what
backtrace do you get if you C-g when it hangs?

Re: gnus and smtp auth

[Samir Saidani]

Hi,

Thanks for your quick answer !

Here are the logs of :

*Messages*


 Using smtp-auth
 From is `Samir Saidani <saidani@info.unicaen.fr>', setting `smtpmail-smtp-server' to `465'
 Sending...
 Sending via mail...
 Loading smtpmail (source)...done
 Loading mailalias...done
 Opening STARTTLS connection to `smtp.xxx.com'...done
 while: 
 Loading debug...done
 Entering debugger...
  [2 times]
 keyboard-quit: Quit
 Mark set [2 times]

*.gnus.el*

 (setq gnus-posting-styles
      '((".*"
	 (name "Samir Saidani")
	 (address "saidani@info.unicaen.fr"))
        ("^nnml.*gmail"
	 (address "saidani@info.unicaen.fr"))))


  (defun fs-change-smtp ()
  "Change the SMTP server according to the current from line."
  (save-excursion
    (let ((from
           (save-restriction
             (message-narrow-to-headers)
             (message-fetch-field "from"))))
      (message "From is `%s', setting `smtpmail-smtp-server' to `%s'"
               from
               (cond
                ((string-match "saidani@info.unicaen.fr" from)
		 ;; Use stmp-auth
		 (message "Using smtp-auth")
		 ;; Sending mail
		 (setq message-send-mail-function 'smtpmail-send-it)
		 (setq smtpmail-starttls-credentials '(("smtp.xxx.com" 465 nil nil)))
		 (setq smtpmail-auth-credentials '(("smtp.xxx.com" 465 "samir.saidani" nil)))
		 (setq smtpmail-default-smtp-server "smtp.xxx.com")
		 (setq smtpmail-smtp-server "smtp.xxx.com")
		 (setq smtpmail-debug-info t) ; only to debug problems
		 (setq smtpmail-debug-verb t)
		 (setq starttls-use-gnutls t)
		 (setq smtpmail-smtp-service 465))
		((string-match "saidani@info.unicaen.fr" from)
		 ;; Use local sendmail
		 (message "Using local sendmail")
		 (setq message-send-mail-function `message-send-mail-with-sendmail))
		(t
		 (error 
		  (concat "Don't know which mail server to use for "
			  from))))))))

    (add-hook 'message-setup-hook 'fs-change-smtp)

(setq smtpmail-debug-info t)
(setq debug-on-quit t)

*trace ... *
^QUIT

*Backtrace*

Debugger entered--Lisp error: (quit)
  accept-process-output(#<process SMTP>)
  (while (not (search-forward "\r\n" nil t)) (unless (memq ... ...) (throw ... nil)) (accept-process-output process) (goto-char smtpmail-read-point))
  (while response-continue (goto-char smtpmail-read-point) (while (not ...) (unless ... ...) (accept-process-output process) (goto-char smtpmail-read-point)) (setq match-end (point)) (setq response-strings (cons ... response-strings)) (goto-char smtpmail-read-point) (if (looking-at "[0-9]+ ") (let ... ... ... ...) (if ... ... ...)))
  (catch (quote done) (while response-continue (goto-char smtpmail-read-point) (while ... ... ... ...) (setq match-end ...) (setq response-strings ...) (goto-char smtpmail-read-point) (if ... ... ...)) (setq smtpmail-read-point match-end))
  (let ((case-fold-search nil) (response-strings nil) (response-continue t) (return-value ...) match-end) (catch (quote done) (while response-continue ... ... ... ... ... ...) (setq smtpmail-read-point match-end)) return-value)
  smtpmail-read-response(#<process SMTP>)
  (setq greeting (smtpmail-read-response process))
  (car (setq greeting (smtpmail-read-response process)))
  (null (car (setq greeting ...)))
  (or (null (car ...)) (not (integerp ...)) (>= (car greeting) 400))
  (if (or (null ...) (not ...) (>= ... 400)) (throw (quote done) nil))
  (save-current-buffer (set-buffer process-buffer) (set-buffer-process-coding-system (quote raw-text-unix) (quote raw-text-unix)) (make-local-variable (quote smtpmail-read-point)) (setq smtpmail-read-point (point-min)) (if (or ... ... ...) (throw ... nil)) (let (... ...) (while do-ehlo ... ... ...)) (smtpmail-try-auth-methods process supported-extensions host port) (if (or ... ...) (progn ... ...)) (if (and smtpmail-debug-verb ...) (progn ... ...)) (if (member ... supported-extensions) (progn ... ...)) (let (... ...) (smtpmail-send-command process ...) (if ... ...)) (let (...) (while ... ... ... ... ...)) (smtpmail-send-command process "DATA") (if (or ... ... ...) (throw ... nil)) (smtpmail-send-data process smtpmail-text-buffer) (smtpmail-send-command process ".") (if (or ... ... ...) (throw ... nil)) t)
  (with-current-buffer process-buffer (set-buffer-process-coding-system (quote raw-text-unix) (quote raw-text-unix)) (make-local-variable (quote smtpmail-read-point)) (setq smtpmail-read-point (point-min)) (if (or ... ... ...) (throw ... nil)) (let (... ...) (while do-ehlo ... ... ...)) (smtpmail-try-auth-methods process supported-extensions host port) (if (or ... ...) (progn ... ...)) (if (and smtpmail-debug-verb ...) (progn ... ...)) (if (member ... supported-extensions) (progn ... ...)) (let (... ...) (smtpmail-send-command process ...) (if ... ...)) (let (...) (while ... ... ... ... ...)) (smtpmail-send-command process "DATA") (if (or ... ... ...) (throw ... nil)) (smtpmail-send-data process smtpmail-text-buffer) (smtpmail-send-command process ".") (if (or ... ... ...) (throw ... nil)) t)
  (catch (quote done) (setq process-buffer (get-buffer-create ...)) (with-current-buffer process-buffer (erase-buffer)) (setq process (smtpmail-open-stream process-buffer host port)) (and (null process) (throw ... nil)) (set-process-filter process (quote smtpmail-process-filter)) (with-current-buffer process-buffer (set-buffer-process-coding-system ... ...) (make-local-variable ...) (setq smtpmail-read-point ...) (if ... ...) (let ... ...) (smtpmail-try-auth-methods process supported-extensions host port) (if ... ...) (if ... ...) (if ... ...) (let ... ... ...) (let ... ...) (smtpmail-send-command process "DATA") (if ... ...) (smtpmail-send-data process smtpmail-text-buffer) (smtpmail-send-command process ".") (if ... ...) t))
  (unwind-protect (catch (quote done) (setq process-buffer ...) (with-current-buffer process-buffer ...) (setq process ...) (and ... ...) (set-process-filter process ...) (with-current-buffer process-buffer ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... t)) (if process (with-current-buffer ... ... ... ... ...)))
  (let ((process nil) (host ...) (port smtpmail-smtp-service) (envelope-from ...) response-code greeting process-buffer (supported-extensions ...)) (unwind-protect (catch ... ... ... ... ... ... ...) (if process ...)))
  smtpmail-via-smtp(("echo@cnam.fr") #<buffer  smtpmail temp>)
  (not (smtpmail-via-smtp smtpmail-recipient-address-list tembuf))
  (if (not (smtpmail-via-smtp smtpmail-recipient-address-list tembuf)) (error "Sending failed; SMTP protocol error"))
  (if (not (null smtpmail-recipient-address-list)) (if (not ...) (error "Sending failed; SMTP protocol error")) (error "Sending failed; no recipients"))
  (if (not smtpmail-queue-mail) (if (not ...) (if ... ...) (error "Sending failed; no recipients")) (let* (... ... ... ... ... ...) (unless ... ...) (with-current-buffer buffer-data ... ... ... ... ... ... ... ... ... ...) (kill-buffer buffer-scratch) (kill-buffer buffer-data) (kill-buffer buffer-elisp)))
  (save-excursion (set-buffer tembuf) (erase-buffer) (insert-buffer-substring mailbuf) (goto-char (point-max)) (or (= ... 10) (insert 10)) (mail-sendmail-undelimit-header) (setq delimline (point-marker)) (if mail-aliases (expand-mail-aliases ... delimline)) (goto-char (point-min)) (while (and ... ...) (replace-match "\n")) (let (...) (goto-char ...) (if ... ... ...) (goto-char ...) (if ... ...) (goto-char ...) (unless ... ...) (goto-char ...) (unless ... ...) (goto-char ...) (if ... ...) (goto-char ...) (if ... ...) (if mail-interactive ...)) (setq smtpmail-address-buffer (generate-new-buffer "*smtp-mail*")) (setq smtpmail-recipient-address-list (smtpmail-deduce-address-list tembuf ... delimline)) (kill-buffer smtpmail-address-buffer) (smtpmail-do-bcc delimline) (if (not smtpmail-queue-mail) (if ... ... ...) (let* ... ... ... ... ... ...)))
  (unwind-protect (save-excursion (set-buffer tembuf) (erase-buffer) (insert-buffer-substring mailbuf) (goto-char ...) (or ... ...) (mail-sendmail-undelimit-header) (setq delimline ...) (if mail-aliases ...) (goto-char ...) (while ... ...) (let ... ... ... ... ... ... ... ... ... ... ... ... ... ...) (setq smtpmail-address-buffer ...) (setq smtpmail-recipient-address-list ...) (kill-buffer smtpmail-address-buffer) (smtpmail-do-bcc delimline) (if ... ... ...)) (kill-buffer tembuf) (if (bufferp errbuf) (kill-buffer errbuf)))
  (let ((errbuf ...) (tembuf ...) (case-fold-search nil) delimline (mailbuf ...) (smtpmail-mail-address ...) (smtpmail-code-conv-from ...)) (unwind-protect (save-excursion ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ...) (kill-buffer tembuf) (if ... ...)))
  smtpmail-send-it()
  #[nil "\b ┤" [message-send-mail-function] 1]()
  gnus-agent-send-mail()
  message-send-mail(nil)
  message-send-via-mail(nil)
  message-send(nil)
  message-send-and-exit(nil)
  call-interactively(message-send-and-exit)

Thanks at all !

Samir

Simon Josefsson <jas@extundo.com> writes:

> Samir Saidani <saidani@info.unicaen.fr> writes:
>
>> When I replace the .gnus configuration (from terjeros) with the right
>> settings, it hangs and there is nothing in smtp debug.
>
> What's in *Messages*?  After (setq smtpmail-debug-info t), what do the
> *trace...* buffer contain?  With (setq debug-on-quit t), what
> backtrace do you get if you C-g when it hangs?

-- 
Samir SAIDANI				
PhD Student in CS / Doctorant en informatique 	web : http://www.info.unicaen.fr/~saidani
Universite de Caen - Laboratoire GREYC          tel : 02-31-56-74-30
Equipe MAD - Campus II - 14032 Caen Cedex       fax : 02-31-56-76-30

Re: gnus and smtp auth

[Steinar Bang]

>>>>> Samir Saidani <saidani@info.unicaen.fr>:

> I'm trying to get gnus sending mail through smtp auth, but after
> several hours, I'm definitely unsuccessful...

> So here is the situation : I've got a laptop with a sarge debian
> installed, and using gnus 5.10.7 and emacs 21.4.1, with the latest
> cvs smtpmail and starttls files (byte-compiled).

I've got a laptop with sarge as well, and I'm also letting the laptop
talk to a relay using STMP auth.

What I do is to let Gnus deliver to exim on my laptop, and then let
exim do the SMTP auth thingy (this is exim 4, which is simpler, and
more flexible than exim 3, in that respect).

Re: gnus and smtp auth

[Hiroshi Fujishima]

Samir Saidani <saidani@info.unicaen.fr> writes:

> I managed to send mail through smtpmail and without authentification
> with no problems, and I can send mails through smtpmail with
> authentification using gmail (I tried the .gnus here :
> http://web.phys.ntnu.no/~terjeros/gnus-gmail/)
>
> When I replace the .gnus configuration (from terjeros) with the right
> settings, it hangs and there is nothing in smtp debug.

I encountered the same trouble, too. 

In the cause, the behavior of gnutls-cli is of change according to the
value of process-connection-type:

(let ((process-connection-type t))
  (start-process "test" (current-buffer) "gnutls-cli" "-s" "-p" "587" "smtp.gmail.com"))

	Resolving 'smtp.gmail.com'...
	Connecting to '64.233.185.109:587'...
	
	- Simple Client Mode:
	
	220 mx.gmail.com ESMTP d61sm300512wra
	
(let ((process-connection-type nil))
  (start-process "test" (current-buffer) "gnutls-cli" "-s" "-p" "587" "smtp.gmail.com"))

	220 mx.gmail.com ESMTP 33sm823777wra

Since default value of starttls-process-connection-type is nil,
starttls-connect regexp in starttls-open-stream-gnutls() does not
match.  So emacs hangs.  Gnutls version which I use is:

% gnutls-cli --version
GNU TLS test client, version 1.2.4. Libgnutls 1.2.4.

-- 
Hiroshi Fujishima

Re: gnus and smtp auth

[Simon Josefsson]

Hiroshi Fujishima <hiroshi.fujishima@gmail.com> writes:

> Samir Saidani <saidani@info.unicaen.fr> writes:
>
>> I managed to send mail through smtpmail and without authentification
>> with no problems, and I can send mails through smtpmail with
>> authentification using gmail (I tried the .gnus here :
>> http://web.phys.ntnu.no/~terjeros/gnus-gmail/)
>>
>> When I replace the .gnus configuration (from terjeros) with the right
>> settings, it hangs and there is nothing in smtp debug.
>
> I encountered the same trouble, too. 
>
> In the cause, the behavior of gnutls-cli is of change according to the
> value of process-connection-type:
>
> (let ((process-connection-type t))
>   (start-process "test" (current-buffer) "gnutls-cli" "-s" "-p" "587" "smtp.gmail.com"))
>
> 	Resolving 'smtp.gmail.com'...
> 	Connecting to '64.233.185.109:587'...
> 	
> 	- Simple Client Mode:
> 	
> 	220 mx.gmail.com ESMTP d61sm300512wra
> 	
> (let ((process-connection-type nil))
>   (start-process "test" (current-buffer) "gnutls-cli" "-s" "-p" "587" "smtp.gmail.com"))
>
> 	220 mx.gmail.com ESMTP 33sm823777wra
>
> Since default value of starttls-process-connection-type is nil,
> starttls-connect regexp in starttls-open-stream-gnutls() does not
> match.  So emacs hangs.  Gnutls version which I use is:

Does sending mail work if you toggle s-p-c-t?  It is not clear what
the best default for that variable should be.

Re: gnus and smtp auth

[Hiroshi Fujishima]

Simon Josefsson <jas@extundo.com> writes:

>>> When I replace the .gnus configuration (from terjeros) with the right
>>> settings, it hangs and there is nothing in smtp debug.
>>
>> I encountered the same trouble, too. 
>>
>> In the cause, the behavior of gnutls-cli is of change according to the
>> value of process-connection-type:
>>
>> (let ((process-connection-type t))
>>   (start-process "test" (current-buffer) "gnutls-cli" "-s" "-p" "587" "smtp.gmail.com"))
>>
>> 	Resolving 'smtp.gmail.com'...
>> 	Connecting to '64.233.185.109:587'...
>> 	
>> 	- Simple Client Mode:
>> 	
>> 	220 mx.gmail.com ESMTP d61sm300512wra
>> 	
>> (let ((process-connection-type nil))
>>   (start-process "test" (current-buffer) "gnutls-cli" "-s" "-p" "587" "smtp.gmail.com"))
>>
>> 	220 mx.gmail.com ESMTP 33sm823777wra
>>
>> Since default value of starttls-process-connection-type is nil,
>> starttls-connect regexp in starttls-open-stream-gnutls() does not
>> match.  So emacs hangs.  Gnutls version which I use is:
>
> Does sending mail work if you toggle s-p-c-t?  It is not clear what
> the best default for that variable should be.

It did not work regardless of which the value of s-p-c-t was.  If
s-p-c-t is nil, it just hangs.  If s-p-c-t is nil, emacs say `Sending
failed; SMTP protocol error'.  Here is debug infomation:

*Messages*:
Opening STARTTLS connection to `smtp.gmail.com'...done
220 mx.gmail.com ESMTP c12sm932888nzc
250-mx.gmail.com at your service
250-SIZE 20971520
250-8BITMIME
250-STARTTLS
250 ENHANCEDSTATUSCODES
502 5.5.1 Unrecognized command c12sm932888nzc
220 2.0.0 Ready to start TLS
smtpmail-send-it: Sending failed; SMTP protocol error

*trace...* buffer:
Process SMTP killed
220 mx.gmail.com ESMTP c12sm932888nzc^M
EHLO alex^M
250-mx.gmail.com at your service^M
250-SIZE 20971520^M
250-8BITMIME^M
250-STARTTLS^M
250 ENHANCEDSTATUSCODES^M
STARTTLS^M
502 5.5.1 Unrecognized command c12sm932888nzc^M
QUIT^M
220 2.0.0 Ready to start TLS^M

Of course executing in shell prompt works.

% gnutls-cli -s -p 587 smtp.gmail.com
Resolving 'smtp.gmail.com'...
Connecting to '64.233.163.109:587'...

- Simple Client Mode:

220 mx.gmail.com ESMTP 6sm76762nzn
EHLO bar.com
250-mx.gmail.com at your service
250-SIZE 20971520
250-8BITMIME
250-STARTTLS
250 ENHANCEDSTATUSCODES
STARTTLS
220 2.0.0 Ready to start TLS
^D
*** Starting TLS handshake
- Certificate type: X.509
 - Got a certificate list of 1 certificates.

 - Certificate[0] info:
 # The hostname in the certificate matches 'smtp.gmail.com'.
 # valid since: Fri Sep 17 08:35:45 JST 2004
 # expires at: Sat Sep 17 08:35:45 JST 2005
 # fingerprint: F5:BD:C3:C8:D5:4B:03:EA:57:BB:81:72:46:6B:26:54
 # Subject's DN: C=US,ST=California,L=Mountain View,O=Google Inc,CN=smtp.gmail.com
 # Issuer's DN: C=ZA,ST=Western Cape,L=Cape Town,O=Thawte Consulting cc,OU=Certification Services Division,CN=Thawte Server CA,EMAIL=server-certs@thawte.com


- Peer's certificate issuer is unknown
- Peer's certificate is NOT trusted
- Version: TLS 1.0
- Key Exchange: RSA
- Cipher: 3DES 168 CBC
- MAC: SHA
- Compression: NULL
QUIT
*** Fatal error: A TLS packet with unexpected length was received.
*** Server has terminated the connection abnormally.

-- 
Hiroshi Fujishima