Re: <mtext> UTF further problems

[Hans Hagen <pragma@wxs.nl>]

Mojca Miklavec wrote:

> \usemodule[mathml]
> \starttext\startXMLdata
> <formula><math><mtext>\"{a}\"{o}\"{u}\v{c}\v{s}\v{z}</mtext></math></formula> 
> \stopXMLdata\stoptext
> 
> fails as well.
> 
> An interesting observation: I tested on live.contextgarden.com, on the 
> latest ConTeXt in MikTeX distribution and in an old minimal ConTeXt 
> distribution for Windows (6.12.2004). The results from MikTeX and 
> live.contextgarden.net were equal. \v{c} resulted in something like
> "leftdoubleguillemont" overlapped with "c", \"{a}, \"{o} and \"{u} 
> resulted in a dash over the letter a/o/u. In the minimal ConTeXt 
> distribution the line
>     \"{a}\"{o}\"{u}\v{c}\v{s}\v{z}
> resulted in
>     "{a}"{o}"{u}v {c}v {s}v {z}
> (literally).

Let me tell you that it's even stranger:

\usemodule[mathml]

\starttext

\chardef\XMLtokensreduction\zerocount

\startXMLdata
<formula><math><mtext>\"{a}\"{o}\"{u}\v{c}\v{s}\v{z}</mtext></math></formula>
\stopXMLdata

\chardef\XMLtokensreduction\plustwo

\startXMLdata
<formula><math><mtext>\"{a}\"{o}\"{u}\v{c}\v{s}\v{z}</mtext></math></formula>
\stopXMLdata

\stoptext

since currently the mml code reenters the tokenizer, the text inside mtext is 
actually seen as tex code

the only way to get this fixed is to rewrite the mml parser (i've partially done 
that already using the normal xml handler instead of the messy mapper); it seems 
that i need to speed up that port.

Hans


-----------------------------------------------------------------
                                           Hans Hagen | PRAGMA ADE
               Ridderstraat 27 | 8061 GH Hasselt | The Netherlands
      tel: 038 477 53 69 | fax: 038 477 53 74 | www.pragma-ade.com
                                              | www.pragma-pod.nl
-----------------------------------------------------------------