Re: UTF-8 support has stopped working

[Steinar Bang <sb@dod.no>]

[-- Attachment #1: Type: text/plain, Size: 768 bytes --]

[Note! Gnus insists making this message 7 parts because of charset
       issues.  Should it automatically have selected utf-8?  I tried
       doing `C-x RET f utf-8 RET', but it didn't seem to make any
       difference]

>>>>> Reiner Steib <4.uce.03.r.s@nurfuerspam.de>:

> On Mon, Apr 14 2003, Steinar Bang wrote:

>> With XEmacs 21, it displays both UTF-8 encoded headers and message
>> parts correctly.

> Really?  Can you see Markus Kuhn's utf-8 demo file in XEmacs 21.4 more
> or less correctly?  See
> <news://news.gmane.org/utf-8-demo.fsf@marauder.physik.uni-ulm.de>.

I see a suprising amount of stuff seemingly correctly.  Ie. I wasn't
aware that I had the fonts to see it correctly

> I tried and I saw lots of `?' and other errors, e.g.:

>   ?deutsche‘ 

[-- Attachment #2: Type: text/plain, Size: 18 bytes --]

?Anführungszeichen

[-- Attachment #3: Type: text/plain, Size: 33 bytes --]

“, the euro symbol: 14.95 

[-- Attachment #4: Type: text/plain, Size: 348 bytes --]

€

I see question marks before "deutsche" and "Anführungszeichen", I see
a rectangle immediately following "deutsche".  I see a double quote
character with the thickest end at the bottom and curling towards the
right (is this a "german quote"?) just before the comma, and I see the
Euro symbol (ie. not the dollar symbol you see).

> was shown as:

[-- Attachment #5: Type: text/plain, Size: 16 bytes --]


>   ?deutsche‘ 

[-- Attachment #6: Type: text/plain, Size: 18 bytes --]

?Anführungszeichen

[-- Attachment #7: Type: text/plain, Size: 2164 bytes --]

“, the euro symbol: 14.95 $
>   ^          ^                                             ^

> But this is not a Gnus issue (I get the same opening the demo file
> directly in XEmacs).  

> In Emacs 21.3, I see some rectangles (I guess this is due to missing
> fonts)

I would have guessed that missing fonts was the root of the entire
problem.  You're saying it's not?

> in: Mathematics and sciences,

Some symbols shown correctly.  Some just shown as question marks.
No rectangles.  In Linguistics and dictionaries, I see some characters
correctly, and some as tilde ie. "~".

> APL,

Some OK.  Some as question marks.  In the Nicer typography in plain
text files, I see some rectangles for the first time, for the single
quotes.   Greek looks... well,... Greek to me.

> Georgian,

All question marks, except for the text "Unicode" and some numbers.
Russian looks OK.  Cyrillic characters, and no unknown characters.

> Thai (UCS Level 2),

I see only tilde characters.

> Ethiopian,

I see only tilde characters.  Runes and Braille are all question
marks. 

> Compact font selection example text and Greetings in various
> languages.

Both look OK.

In any case, we're not seeing the same thing with the same software.
So the difference in what we're seeing either comes from different
versions of the software, or a different selection of fonts installed.

I'm guessing at fonts.  See the end of the message for the missing
font warnings I got.

Why some missing characters showed up as rectangles, some as question
mark, and some as tilde, I have no idea.


- Steinar

Missing font warnings when opening Markus Kuhn's utf-8 demo file:

(1) (font/warning) Unable to instantiate font for face default, charset ipa

(2) (font/warning) Unable to instantiate font for face default, charset chinese-cns11643-1

(3) (font/warning) Unable to instantiate font for face default, charset chinese-big5-1

(4) (font/warning) Unable to instantiate font for face default, charset japanese-jisx0212

(5) (font/warning) Unable to instantiate font for face default, charset thai-tis620

(6) (font/warning) Unable to instantiate font for face default, charset ethiopic