coding in some mails is wired

coding in some mails is wired

[Uwe Brauer]

Hi 

Since a couple of weeks I receive some mails how look like this
,----
| 
| From: user <XXX@mathworks.com>
| Subject: RE: the filling patch and its problems
| To: Uwe Brauer <oub@mat.ucm.es>
| CC: Matlab-emacs-discuss <matlab-emacs-discuss@lists.sourceforge.net>
| Date: Mon, 24 Jul 2023 19:08:34 +0000 (12 hours, 32 minutes, 22 seconds ago)
| 
| 
| --_004_mn2pr05mb65581320f9aede6160120580af02amn2pr05mb6558namp_
| Content-type: multipart/alternative; boundary="_000_mn2pr05mb65581320f9aede6160120580af02amn2pr05mb6558namp_"
| 
| 
| --_000_mn2pr05mb65581320f9aede6160120580af02amn2pr05mb6558namp_
| Content-type: text/plain; charset="utf-8"
| Content-transfer-encoding: base64
| 
| SGkgVXdlLA0KDQpIZXJl4oCZcyBhIHJldmlzZWQgcGF0Y2ggdGhhdCBkb2VzIGEgYmV0dGVyIGpv
| YiBmaWxsaW5nIGNvbW1lbnRzLCBhbmQgYWxzbyBmaXhlcyB0aGUgaW5kZW50IHJlZ2lvbiBpc3N1
| ZSB5b3UgZm91bmQuDQoNCkhvcGUgdGhlc2Ugd29yayBmb3IgeW91Lg0KRXJpYw0KDQpGcm9tOiBV
`----


This mail is perfectly displayed for example in the gmail webinterface.

I did not change anything in my gnus configuration.

Any idea how to deal with these sort of emails?
It is mainly email from mathwork but also from other providers and the
number is increasing 

So any help would be highly appreciated.

Regards

Uwe Brauer 


-- 
Warning: Content may be disturbing to some audiences
I strongly condemn Putin's war of aggression against the Ukraine.
I support to deliver weapons to Ukraine's military. 
I support the NATO membership of the Ukraine.
I support the EU membership of the Ukraine. 
https://addons.thunderbird.net/en-US/thunderbird/addon/gmail-conversation-view/

Re: coding in some mails is wired

[Robert Pluim]

>>>>> On Tue, 25 Jul 2023 09:49:25 +0200, Uwe Brauer <oub@mat.ucm.es> said:

    Uwe> Hi 

    Uwe> Since a couple of weeks I receive some mails how look like this
    Uwe> ,----
    Uwe> | 
    Uwe> | From: user <XXX@mathworks.com>
    Uwe> | Subject: RE: the filling patch and its problems
    Uwe> | To: Uwe Brauer <oub@mat.ucm.es>
    Uwe> | CC: Matlab-emacs-discuss <matlab-emacs-discuss@lists.sourceforge.net>
    Uwe> | Date: Mon, 24 Jul 2023 19:08:34 +0000 (12 hours, 32 minutes, 22 seconds ago)
    Uwe> | 
    Uwe> | 
    Uwe> | --_004_mn2pr05mb65581320f9aede6160120580af02amn2pr05mb6558namp_
    Uwe> | Content-type: multipart/alternative; boundary="_000_mn2pr05mb65581320f9aede6160120580af02amn2pr05mb6558namp_"
    Uwe> | 
    Uwe> | 
    Uwe> | --_000_mn2pr05mb65581320f9aede6160120580af02amn2pr05mb6558namp_
    Uwe> | Content-type: text/plain; charset="utf-8"
    Uwe> | Content-transfer-encoding: base64
    Uwe> | 
    Uwe> | SGkgVXdlLA0KDQpIZXJl4oCZcyBhIHJldmlzZWQgcGF0Y2ggdGhhdCBkb2VzIGEgYmV0dGVyIGpv
    Uwe> | YiBmaWxsaW5nIGNvbW1lbnRzLCBhbmQgYWxzbyBmaXhlcyB0aGUgaW5kZW50IHJlZ2lvbiBpc3N1
    Uwe> | ZSB5b3UgZm91bmQuDQoNCkhvcGUgdGhlc2Ugd29yayBmb3IgeW91Lg0KRXJpYw0KDQpGcm9tOiBV
    Uwe> `----


    Uwe> This mail is perfectly displayed for example in the gmail webinterface.

    Uwe> I did not change anything in my gnus configuration.

    Uwe> Any idea how to deal with these sort of emails?
    Uwe> It is mainly email from mathwork but also from other providers and the
    Uwe> number is increasing 

    Uwe> So any help would be highly appreciated.

Which version of emacs/gnus? Would you have a complete example
including headers? Itʼs possible gnusʼ multipart decoding has a bug,
but weʼd need a complete message to confirm.


Robert
-- 

Re: coding in some mails is wired

[Uwe Brauer]

[-- Attachment #1: Type: text/plain, Size: 2604 bytes --]

>>> "RP" == Robert Pluim <rpluim@gmail.com> writes:

>>>>>> On Tue, 25 Jul 2023 09:49:25 +0200, Uwe Brauer <oub@mat.ucm.es> said:
Uwe> Hi 

Uwe> Since a couple of weeks I receive some mails how look like this
Uwe> ,----
Uwe> | 
Uwe> | From: user <XXX@mathworks.com>
Uwe> | Subject: RE: the filling patch and its problems
Uwe> | To: Uwe Brauer <oub@mat.ucm.es>
Uwe> | CC: Matlab-emacs-discuss <matlab-emacs-discuss@lists.sourceforge.net>
Uwe> | Date: Mon, 24 Jul 2023 19:08:34 +0000 (12 hours, 32 minutes, 22 seconds ago)
Uwe> | 
Uwe> | 
Uwe> | --_004_mn2pr05mb65581320f9aede6160120580af02amn2pr05mb6558namp_
Uwe> | Content-type: multipart/alternative; boundary="_000_mn2pr05mb65581320f9aede6160120580af02amn2pr05mb6558namp_"
Uwe> | 
Uwe> | 
Uwe> | --_000_mn2pr05mb65581320f9aede6160120580af02amn2pr05mb6558namp_
Uwe> | Content-type: text/plain; charset="utf-8"
Uwe> | Content-transfer-encoding: base64
Uwe> | 
Uwe> | SGkgVXdlLA0KDQpIZXJl4oCZcyBhIHJldmlzZWQgcGF0Y2ggdGhhdCBkb2VzIGEgYmV0dGVyIGpv
Uwe> | YiBmaWxsaW5nIGNvbW1lbnRzLCBhbmQgYWxzbyBmaXhlcyB0aGUgaW5kZW50IHJlZ2lvbiBpc3N1
Uwe> | ZSB5b3UgZm91bmQuDQoNCkhvcGUgdGhlc2Ugd29yayBmb3IgeW91Lg0KRXJpYw0KDQpGcm9tOiBV
Uwe> `----


Uwe> This mail is perfectly displayed for example in the gmail webinterface.

Uwe> I did not change anything in my gnus configuration.

Uwe> Any idea how to deal with these sort of emails?
Uwe> It is mainly email from mathwork but also from other providers and the
Uwe> number is increasing 

Uwe> So any help would be highly appreciated.

> Which version of emacs/gnus? Would you have a complete example
> including headers? Itʼs possible gnusʼ multipart decoding has a bug,
> but weʼd need a complete message to confirm.

I repaired it so far with  gnus-summary-repair-multipart
and after restarting emacs the message now looks fine, other message I
could also repair, but after restarting emacs the still look odd, not
that odd as Eric's but still odd.

I am running emacs master
emacs-repository-version is a variable defined in ‘version.el’.

Its value is "7bf17ceee8c2d347917541e143ce25609e90ebbb"


If I sent you this message or a similar, in which format? A simple
forward would not do, right?

Uwe 

-- 
Warning: Content may be disturbing to some audiences
I strongly condemn Putin's war of aggression against the Ukraine.
I support to deliver weapons to Ukraine's military. 
I support the NATO membership of the Ukraine.
I support the EU membership of the Ukraine. 
https://addons.thunderbird.net/en-US/thunderbird/addon/gmail-conversation-view/

[-- Attachment #2: smime.p7s --]
[-- Type: application/pkcs7-signature, Size: 5673 bytes --]

Re: coding in some mails is wired

[Robert Pluim]

>>>>> On Tue, 25 Jul 2023 14:28:32 +0200, Uwe Brauer <oub@mat.ucm.es> said:

    Uwe> If I sent you this message or a similar, in which format? A simple
    Uwe> forward would not do, right?

If you save it to an mbox file, and then tar and gzip it before
attaching, that should preserve the headers.

Robert
-- 

Re: coding in some mails is wired

[Uwe Brauer]

[-- Attachment #1: Type: text/plain, Size: 1749 bytes --]

>>> "RP" == Robert Pluim <rpluim@gmail.com> writes:

>>>>>> On Tue, 25 Jul 2023 14:28:32 +0200, Uwe Brauer <oub@mat.ucm.es> said:
Uwe> If I sent you this message or a similar, in which format? A simple
Uwe> forward would not do, right?

> If you save it to an mbox file, and then tar and gzip it before
> attaching, that should preserve the headers.

Ok gnus offers:

,----
| gnus-default-article-saver is a variable defined in ‘gnus-art.el’.
| 
| Its value is ‘gnus-summary-save-in-file’
| Original value was 
| ‘gnus-summary-save-in-rmail’
| 
| A function to save articles in your favorite format.
| The function will be called by way of the ‘gnus-summary-save-article’
| command, and friends such as ‘gnus-summary-save-article-rmail’.
| 
| Gnus provides the following functions:
| 
| * gnus-summary-save-in-rmail (Rmail format)
| * gnus-summary-save-in-mail (Unix mail format)
| * gnus-summary-save-in-folder (MH folder)
| * gnus-summary-save-in-file (article format)
| * gnus-summary-save-body-in-file (article body)
| * gnus-summary-save-in-vm (use VM’s folder format)
| * gnus-summary-write-to-file (article format -- overwrite)
| * gnus-summary-write-body-to-file (article body -- overwrite)
| * gnus-summary-save-in-pipe (article format)
`----


Is gnus-summary-save-in-mail better than gnus-summary-save-in-folder?
> Robert

-- 
Warning: Content may be disturbing to some audiences
I strongly condemn Putin's war of aggression against the Ukraine.
I support to deliver weapons to Ukraine's military. 
I support the NATO membership of the Ukraine.
I support the EU membership of the Ukraine. 
https://addons.thunderbird.net/en-US/thunderbird/addon/gmail-conversation-view/

[-- Attachment #2: smime.p7s --]
[-- Type: application/pkcs7-signature, Size: 5673 bytes --]

Re: coding in some mails is wired

[Robert Pluim]

>>>>> On Tue, 25 Jul 2023 19:46:07 +0200, Uwe Brauer <oub@mat.ucm.es> said:

    Uwe> | Gnus provides the following functions:
    Uwe> | 
    Uwe> | * gnus-summary-save-in-rmail (Rmail format)
    Uwe> | * gnus-summary-save-in-mail (Unix mail format)
    Uwe> | * gnus-summary-save-in-folder (MH folder)
    Uwe> | * gnus-summary-save-in-file (article format)
    Uwe> | * gnus-summary-save-body-in-file (article body)
    Uwe> | * gnus-summary-save-in-vm (use VM’s folder format)
    Uwe> | * gnus-summary-write-to-file (article format -- overwrite)
    Uwe> | * gnus-summary-write-body-to-file (article body -- overwrite)
    Uwe> | * gnus-summary-save-in-pipe (article format)
    Uwe> `----


    Uwe> Is gnus-summary-save-in-mail better than gnus-summary-save-in-folder?

Yes

Robert
-- 

Re: coding in some mails is wired

[Uwe Brauer]

[-- Attachment #1.1: Type: text/plain, Size: 375 bytes --]

>>> "RP" == Robert Pluim <rpluim@gmail.com> writes:

>>>>>> On Tue, 25 Jul 2023 14:28:32 +0200, Uwe Brauer <oub@mat.ucm.es> said:
Uwe> If I sent you this message or a similar, in which format? A simple
Uwe> forward would not do, right?

> If you save it to an mbox file, and then tar and gzip it before
> attaching, that should preserve the headers.

Here it is 


[-- Attachment #1.2: Coding.tgz --]
[-- Type: application/x-gtar-compressed, Size: 10613 bytes --]

[-- Attachment #1.3: Type: text/plain, Size: 358 bytes --]



-- 
Warning: Content may be disturbing to some audiences
I strongly condemn Putin's war of aggression against the Ukraine.
I support to deliver weapons to Ukraine's military. 
I support the NATO membership of the Ukraine.
I support the EU membership of the Ukraine. 
https://addons.thunderbird.net/en-US/thunderbird/addon/gmail-conversation-view/

[-- Attachment #2: smime.p7s --]
[-- Type: application/pkcs7-signature, Size: 5673 bytes --]

Re: coding in some mails is wired

[Eric S Fraga]

On Wednesday, 26 Jul 2023 at 11:03, Uwe Brauer wrote:
> Here it is 

Applying munpack (on Linux) to the contents of that file indicates there
is nothing to unpack.  Looking at the file contents, the only suspicious
line is the one with "boundary=" which has a single space at the start.
Deleting the single space fixes it and munpack finds three mime parts,
although the third one consists of a single character (line feed alone,
I think).

Why there is a space at the start of the boundary line is unclear and
whether this should be allowed or not is beyond my mime-fu.

HTH,
eric

-- 
Eric S Fraga via gnus (Emacs 30.0.50 2023-07-19) on Debian 12.0

Re: coding in some mails is wired

[Robert Pluim]

>>>>> On Wed, 26 Jul 2023 10:19:48 +0100, Eric S Fraga <e.fraga@ucl.ac.uk> said:

    Eric> On Wednesday, 26 Jul 2023 at 11:03, Uwe Brauer wrote:
    >> Here it is 

    Eric> Applying munpack (on Linux) to the contents of that file indicates there
    Eric> is nothing to unpack.  Looking at the file contents, the only suspicious
    Eric> line is the one with "boundary=" which has a single space at the start.
    Eric> Deleting the single space fixes it and munpack finds three mime parts,
    Eric> although the third one consists of a single character (line feed alone,
    Eric> I think).

    Eric> Why there is a space at the start of the boundary line is unclear and
    Eric> whether this should be allowed or not is beyond my mime-fu.

Itʼs a folded header, I think thatʼs allowed.

I can read that file without any issues as an nndoc group, using "G
f", using emacs master.

Iʼd like to check the original, but as far as I can tell thereʼs
nowhere for a mere mortal to download an mbox archive for the
matlab-emacs-discuss list (and I donʼt see that message in the web
interface in any case)

Robert
-- 

Re: coding in some mails is wired

[Eric S Fraga]

On Wednesday, 26 Jul 2023 at 12:07, Robert Pluim wrote:
> Itʼs a folded header, I think thatʼs allowed.

Agreed; just strange that munpack doesn't recognise the contents as a
mime encoded message with that space.  But definitely outside my realm
of expertise by a huge distance so I'll shup up now. :-)

-- 
Eric S Fraga via gnus (Emacs 30.0.50 2023-07-19) on Debian 12.0

Re: coding in some mails is wired

[Uwe Brauer]

[-- Attachment #1.1: Type: text/plain, Size: 1527 bytes --]

>>> "RP" == Robert Pluim <rpluim@gmail.com> writes:

>>>>>> On Wed, 26 Jul 2023 10:19:48 +0100, Eric S Fraga <e.fraga@ucl.ac.uk> said:
Eric> On Wednesday, 26 Jul 2023 at 11:03, Uwe Brauer wrote:
>>> Here it is 

Eric> Applying munpack (on Linux) to the contents of that file indicates there
Eric> is nothing to unpack.  Looking at the file contents, the only suspicious
Eric> line is the one with "boundary=" which has a single space at the start.
Eric> Deleting the single space fixes it and munpack finds three mime parts,
Eric> although the third one consists of a single character (line feed alone,
Eric> I think).



I am confused, I tried to follow Roberts instructions:
,----
| 
| gnus-default-article-saver is a variable defined in ‘gnus-art.el’.
| 
| Its value is ‘gnus-summary-save-in-mail’
| Original value was 
| ‘gnus-summary-save-in-rmail’
`----

So I saved that message in file, put that file in a new subdirectory,
tarred and gziped that directory. What else should I have done?

Here are the screenshots of the this message together with a third
screenshot after applying  command gnus-summary-repair-multipart 

-- 
Warning: Content may be disturbing to some audiences
I strongly condemn Putin's war of aggression against the Ukraine.
I support to deliver weapons to Ukraine's military. 
I support the NATO membership of the Ukraine.
I support the EU membership of the Ukraine. 
https://addons.thunderbird.net/en-US/thunderbird/addon/gmail-conversation-view/

[-- Attachment #1.2: coding-correct.png --]
[-- Type: image/png, Size: 242438 bytes --]

[-- Attachment #1.3: coding2.png --]
[-- Type: image/png, Size: 346480 bytes --]

[-- Attachment #1.4: coding1.png --]
[-- Type: image/png, Size: 305804 bytes --]

[-- Attachment #2: smime.p7s --]
[-- Type: application/pkcs7-signature, Size: 5673 bytes --]

Re: coding in some mails is wired

[Robert Pluim]

>>>>> On Wed, 26 Jul 2023 14:16:10 +0200, Uwe Brauer <oub@mat.ucm.es> said:
    Uwe> I am confused, I tried to follow Roberts instructions:
    Uwe> ,----
    Uwe> | 
    Uwe> | gnus-default-article-saver is a variable defined in ‘gnus-art.el’.
    Uwe> | 
    Uwe> | Its value is ‘gnus-summary-save-in-mail’
    Uwe> | Original value was 
    Uwe> | ‘gnus-summary-save-in-rmail’
    Uwe> `----

    Uwe> So I saved that message in file, put that file in a new subdirectory,
    Uwe> tarred and gziped that directory. What else should I have done?

Nothing. Itʼs fine, itʼs just that munpack doesnʼt like the result.

    Uwe> Here are the screenshots of the this message together with a third
    Uwe> screenshot after applying  command gnus-summary-repair-multipart 

That recreates the Content-Type header without the folding that Eric
mentioned. But I can display the message as-is without editing it.

I notice one of the screenshots mentions that the message hasnʼt been
downloaded completely. Does doing 'A C' help at all?

Which version of Emacs are you using?

Robert
-- 

Re: coding in some mails is wired

[Uwe Brauer]

[-- Attachment #1: Type: text/plain, Size: 1693 bytes --]

>>> "RP" == Robert Pluim <rpluim@gmail.com> writes:

>>>>>> On Wed, 26 Jul 2023 14:16:10 +0200, Uwe Brauer <oub@mat.ucm.es> said:
Uwe> I am confused, I tried to follow Roberts instructions:
Uwe> ,----
Uwe> | 
Uwe> | gnus-default-article-saver is a variable defined in ‘gnus-art.el’.
Uwe> | 
Uwe> | Its value is ‘gnus-summary-save-in-mail’
Uwe> | Original value was 
Uwe> | ‘gnus-summary-save-in-rmail’
Uwe> `----

Uwe> So I saved that message in file, put that file in a new subdirectory,
Uwe> tarred and gziped that directory. What else should I have done?

> Nothing. Itʼs fine, itʼs just that munpack doesnʼt like the result.

Uwe> Here are the screenshots of the this message together with a third
Uwe> screenshot after applying  command gnus-summary-repair-multipart 

> That recreates the Content-Type header without the folding that Eric
> mentioned. But I can display the message as-is without editing it.

> I notice one of the screenshots mentions that the message hasnʼt been
> downloaded completely. Does doing 'A C' help at all?


Ah I did, I have to check this with the other messages


> Which version of Emacs are you using?


emacs-repository-version is a variable defined in ‘version.el’.

Its value is "7bf17ceee8c2d347917541e143ce25609e90ebbb"



> Robert

-- 
Warning: Content may be disturbing to some audiences
I strongly condemn Putin's war of aggression against the Ukraine.
I support to deliver weapons to Ukraine's military. 
I support the NATO membership of the Ukraine.
I support the EU membership of the Ukraine. 
https://addons.thunderbird.net/en-US/thunderbird/addon/gmail-conversation-view/

[-- Attachment #2: smime.p7s --]
[-- Type: application/pkcs7-signature, Size: 5673 bytes --]

Re: coding in some mails is wired

[Robert Pluim]

>>>>> On Wed, 26 Jul 2023 18:59:59 +0200, Uwe Brauer <oub@mat.ucm.es> said:
    >> Which version of Emacs are you using?


    Uwe> emacs-repository-version is a variable defined in ‘version.el’.

    Uwe> Its value is "7bf17ceee8c2d347917541e143ce25609e90ebbb"

Thatʼs pretty old. Any chance you could try with a more recent
version?

Robert
-- 

Re: coding in some mails is wired

[Uwe Brauer]

[-- Attachment #1: Type: text/plain, Size: 1593 bytes --]

>>> "RP" == Robert Pluim <rpluim@gmail.com> writes:

>>>>>> On Wed, 26 Jul 2023 18:59:59 +0200, Uwe Brauer <oub@mat.ucm.es> said:
>>> Which version of Emacs are you using?


Uwe> emacs-repository-version is a variable defined in ‘version.el’.

Uwe> Its value is "7bf17ceee8c2d347917541e143ce25609e90ebbb"

> Thatʼs pretty old. Any chance you could try with a more recent
> version?

Well it is still the 29 branch, right 😇

The point is I have some old bbdb files I still use, newer version of
emacs caused me to fiddle quite a bit with defalias to make it all work,
and unfortunately the News file is not very very helpful in this regard
(I still don't see the point of renaming variables and breaking backward
compatibility), but at some point later this month I might try it and
will spend a day or two till everything is back to normal


BTW, one reason of this behavior might be connected to the fact that
right now I have a rather slow connection which caused problems when
trying to open files with large attachments (took ages), so I think I
set a variable so that it does not automatically downloads a message
completely, but I forget which variable that was.... 😨

Uwe 



> Robert

-- 
Warning: Content may be disturbing to some audiences
I strongly condemn Putin's war of aggression against the Ukraine.
I support to deliver weapons to Ukraine's military. 
I support the NATO membership of the Ukraine.
I support the EU membership of the Ukraine. 
https://addons.thunderbird.net/en-US/thunderbird/addon/gmail-conversation-view/

[-- Attachment #2: smime.p7s --]
[-- Type: application/pkcs7-signature, Size: 5673 bytes --]

Re: coding in some mails is wired

[Andreas Schwab]

On Jul 25 2023, Uwe Brauer wrote:

> Its value is "7bf17ceee8c2d347917541e143ce25609e90ebbb"

You need at least 33647b6d63f.

-- 
Andreas Schwab, schwab@linux-m68k.org
GPG Key fingerprint = 7578 EB47 D4E5 4D69 2510  2552 DF73 E780 A9DA AEC1
"And now for something completely different."

Re: coding in some mails is wired

[Uwe Brauer]

[-- Attachment #1: Type: text/plain, Size: 596 bytes --]

>>> "AS" == Andreas Schwab <schwab@linux-m68k.org> writes:

> On Jul 25 2023, Uwe Brauer wrote:
>> Its value is "7bf17ceee8c2d347917541e143ce25609e90ebbb"

> You need at least 33647b6d63f.

At least for what? correct, decoding?



-- 
Warning: Content may be disturbing to some audiences
I strongly condemn Putin's war of aggression against the Ukraine.
I support to deliver weapons to Ukraine's military. 
I support the NATO membership of the Ukraine.
I support the EU membership of the Ukraine. 
https://addons.thunderbird.net/en-US/thunderbird/addon/gmail-conversation-view/

[-- Attachment #2: smime.p7s --]
[-- Type: application/pkcs7-signature, Size: 5673 bytes --]

Re: coding in some mails is wired

[Uwe Brauer]

[-- Attachment #1: Type: text/plain, Size: 667 bytes --]

>>> "AS" == Andreas Schwab <schwab@linux-m68k.org> writes:

> On Jul 25 2023, Uwe Brauer wrote:
>> Its value is "7bf17ceee8c2d347917541e143ce25609e90ebbb"

> You need at least 33647b6d63f.

On a second thought: I don't recall having these coding problems say a
month ago. So I am really puzzled.




-- 
Warning: Content may be disturbing to some audiences
I strongly condemn Putin's war of aggression against the Ukraine.
I support to deliver weapons to Ukraine's military. 
I support the NATO membership of the Ukraine.
I support the EU membership of the Ukraine. 
https://addons.thunderbird.net/en-US/thunderbird/addon/gmail-conversation-view/

[-- Attachment #2: smime.p7s --]
[-- Type: application/pkcs7-signature, Size: 5673 bytes --]