Automatically detecting the charset

Automatically detecting the charset

[Michael Below]

Hi,

I would like gnus to send mail and news articles in iso 8859-1 by
default, but to switch to another charset if necessary. I just sent a
mail conatining an ¤ euro sign in that format, which is no good. Gnus
should find out that the ¤ requires iso8859-15 and encode the message
appropriately. 

Right now, I have these settings on encoding:
 '(current-language-environment "Latin-9")
 '(default-input-method "latin-9-prefix")

Excuse me if this is mentioned in the manual somewhere, I couldn't
find it.

Michael
-- 
_Agricultural activity_ is the management by an enterprise of the
biological transformation of biological assets for sale, into
agricultural produce, or into additional biological assets.  IAS 41,5

Re: Automatically detecting the charset

[Kai Großjohann]

Michael Below <mbelow@antithese.de> writes:

> I would like gnus to send mail and news articles in iso 8859-1 by
> default, but to switch to another charset if necessary. I just sent a
> mail conatining an ¤ euro sign in that format, which is no good. Gnus
> should find out that the ¤ requires iso8859-15 and encode the message
> appropriately. 

Your message is encoded in Latin-1, which does not have a Euro sign.
I wonder how that comes.  How do you insert the Euro sign?  What does
C-u C-x = say on a Euro sign?

> Right now, I have these settings on encoding:
>  '(current-language-environment "Latin-9")
>  '(default-input-method "latin-9-prefix")

Hm.  This should insert Latin-9 characters, so by default you should
always send Latin-9, I think.  Hm.
-- 
Ambibibentists unite!

Re: Automatically detecting the charset

[Kai Großjohann]

Michael Below <mbelow@antithese.de> writes:

> For my test file, this says:
> Coding system for saving this buffer:
>   t -- raw-text-unix
> Default coding system (for new files):
>   0 -- iso-latin-9 (alias: iso-8859-15 latin-9 latin-0)
> Coding system for keyboard input:
>   nil
> Coding system for terminal output:
>   0 -- iso-latin-9 (alias: iso-8859-15 latin-9 latin-0)

I don't understand.  It seems to know about Latin-9, yet it fails to
recognize this when opening files.

Hm.

For keyboard input, it might help to say C-x RET k iso-8859-15 RET.
Then enter umlauts.  Do they show up in the proper encoding?

Hm.

Try 

    LANG=de_DE@euro emacs -q -no-site-file

in bash.  Then open a file with umlauts into that Emacs.  Is that okay?

-- 
Ambibibentists unite!

Re: Automatically detecting the charset

[Michael Below]

Hi,

a followup to Kai's message
<84bs277szf.fsf@lucy.is.informatik.uni-duisburg.de>:

> For keyboard input, it might help to say C-x RET k iso-8859-15 RET.
> Then enter umlauts.  Do they show up in the proper encoding?

No, that doesn't help. I am being offered iso-latin-9 as a default
when I do that, but C-u C-x = still gives me "eight-bit-graphic".

> Try 
>
>    LANG=de_DE@euro emacs -q -no-site-file
>
> in bash.  Then open a file with umlauts into that Emacs.  Is that
> okay?

Hey, that works! Now characters are recognized as something like:

  character: ö (07566, 3958, 0xf76)
    charset: latin-iso8859-15
	     (Right-Hand Part of Latin Alphabet 9 (ISO/IEC 8859-15): ISO-IR-203)
 code point: 118
     syntax: word
   category: l:Latin  
buffer code: 0x8E 0xF6
  file code: F6 (encoded by coding system iso-latin-9-unix)
       font:
	     -monotype-courier new-medium-r-normal--17-128-95-95-m-100-iso8859-15

That sounds much better!
It also works if I leave out the -q.
So it looks like the system init files are buggy somehow.

I know these init files:
~ $ls /etc/emacs/site-start.d
00debian-vars.el  50dpkg-dev.el  50gettext.el    50mew.el
50bbdb.el         50erc.el       50mailcrypt.el  50user-de.el
~ $ls /etc/emacs21/site-start.d
00debian-vars.elc  49url.el  50psgml-init.el  50w3.el

Should I try removing them and putting them back in one by one, or
is there a more intelligent approach?

Ciao
  Michael
-- 
_Agricultural activity_ is the management by an enterprise of the
biological transformation of biological assets for sale, into
agricultural produce, or into additional biological assets.  IAS 41,5

Re: Automatically detecting the charset

[Kai Großjohann]

Michael Below <mbelow@antithese.de> writes:

> Hi,
>
> a followup to Kai's message
> <84bs277szf.fsf@lucy.is.informatik.uni-duisburg.de>:
>
>> For keyboard input, it might help to say C-x RET k iso-8859-15 RET.
>> Then enter umlauts.  Do they show up in the proper encoding?
>
> No, that doesn't help. I am being offered iso-latin-9 as a default
> when I do that, but C-u C-x = still gives me "eight-bit-graphic".

Did you enter new umlauts and use C-u C-x = on them?

>> Try 
>>
>>    LANG=de_DE@euro emacs -q -no-site-file
>>
>> in bash.  Then open a file with umlauts into that Emacs.  Is that
>> okay?
>
> Hey, that works! Now characters are recognized as something like:
>
>   character: ö (07566, 3958, 0xf76)
>     charset: latin-iso8859-15
> 	     (Right-Hand Part of Latin Alphabet 9 (ISO/IEC 8859-15): ISO-IR-203)
>  code point: 118
>      syntax: word
>    category: l:Latin  
> buffer code: 0x8E 0xF6
>   file code: F6 (encoded by coding system iso-latin-9-unix)
>        font:
> 	     -monotype-courier new-medium-r-normal--17-128-95-95-m-100-iso8859-15
>
> That sounds much better!
> It also works if I leave out the -q.
> So it looks like the system init files are buggy somehow.
>
> I know these init files:
> ~ $ls /etc/emacs/site-start.d
> 00debian-vars.el  50dpkg-dev.el  50gettext.el    50mew.el
> 50bbdb.el         50erc.el       50mailcrypt.el  50user-de.el
> ~ $ls /etc/emacs21/site-start.d
> 00debian-vars.elc  49url.el  50psgml-init.el  50w3.el
>
> Should I try removing them and putting them back in one by one, or
> is there a more intelligent approach?

I'd look at 50user-de.el, first.  If that isn't it, try your approach.

Is there standard-display-european in 50user-de.el?  It could cause
the problem.
-- 
Ambibibentists unite!

Re: Automatically detecting the charset

[Michael Below]

Hi,

Kai wrote in <84fzrg7yk3.fsf@lucy.is.informatik.uni-duisburg.de>:

> Wow.  I wonder if "dpkg --purge" would have deleted it, and which
> Debian package it came from.  (Are you running Debian?)

Yes, I am running Debian. I guess --purge would have deleted this, but
usually packages are just removed, leaving the config files behind...

Maybe this came from the user-de package of Debian 2.1 or something
like that.

Thank you for your help!

Michael
-- 
_Agricultural activity_ is the management by an enterprise of the
biological transformation of biological assets for sale, into
agricultural produce, or into additional biological assets.  IAS 41,5