Re: Re: texutil "malformed UTF-8 character" error

Re: Re: texutil "malformed UTF-8 character" error

[Duncan Hothersall]

>  > although the .tui file is full of entries as far as I can tell. Maybe
>  > something esle is wrong - still working on minimal file.
> 
> \starttext
> 
> \placelist[chapter][criterium=text]
> \placeindex[criterium=text]
> 
> \chapter{test}
> 
> \index{test} test
> 
> \stoptext
> 
> 
> can you send me the tui file?
> 
> Hans

This works fine - registers gain entries and are output correctly, and 
the .tui file has in it:

c \thisissectionseparator{:}
c \thisisutilityversion{2003.07.19}
c \thisisbytesequence{}
f b {tester}
c \mainreference{}{index:t}{2::0:0:0:0:0:0:0::1}{1}{}
c \initializevariable\usedcolorchannels{}
c \listentry{chapter}{1}{1}{test}{2::0:1:0:0:0:0:0::2}{2}
r e {index} {2} {} {test} {2::0:1:0:0:0:0:0::2} {2}
f e {tester}
c \initializevariable\lastpage{2}
c \initializevariable\lastpagenumber{2}
c \initializevariable\totalnofMPgraphics{0}
c \initializevariable\totalnofpositions{0}
c \initializevariable\totalnofparbackgrounds{0}
c \initializevariable\currentstrategypass{1}

Must be something I'm doing in the main file. I will continue to try to 
produce a minimal non-working example. Thanks for all the help thus far.

Duncan

Re: Re: texutil "malformed UTF-8 character" error

[Hans Hagen]

Duncan Hothersall wrote:

> Right, interesting - have upgraded to Perl 5.8.5, and now, having 
> removed the \def\testbytesequence{} from cont-new.tex, the error 
> message "malformed UTF-8 character" has gone away! Quite possibly the 
> RedHat 9 install of Perl 5.8.0 had some default of UTF-8 mode set 
> (though I couldn't see any evidence of it).

but still strange that ^^something triggers utf-8 

Hans 
 

-----------------------------------------------------------------
                                          Hans Hagen | PRAGMA ADE
              Ridderstraat 27 | 8061 GH Hasselt | The Netherlands
     tel: 038 477 53 69 | fax: 038 477 53 74 | www.pragma-ade.com
                                             | www.pragma-pod.nl
-----------------------------------------------------------------

Re: Re: texutil "malformed UTF-8 character" error

[Hans Hagen]

Duncan Hothersall wrote:

> although the .tui file is full of entries as far as I can tell. Maybe 
> something esle is wrong - still working on minimal file.

\starttext

\placelist[chapter][criterium=text]
\placeindex[criterium=text]

\chapter{test}

\index{test} test

\stoptext


can you send me the tui file? 

Hans  

-----------------------------------------------------------------
                                          Hans Hagen | PRAGMA ADE
              Ridderstraat 27 | 8061 GH Hasselt | The Netherlands
     tel: 038 477 53 69 | fax: 038 477 53 74 | www.pragma-ade.com
                                             | www.pragma-pod.nl
-----------------------------------------------------------------

Re: Re: texutil "malformed UTF-8 character" error

[Taco Hoekwater]

Hi,

On Mon, 23 Aug 2004 09:03:36 +0100, Duncan wrote:

> > (i run perl 5.8.0)
> 
> I'm running 5.8.0 too (on Redhat).

I'd definately try to get away from 5.8.0 as soon as possible. There were
quite a lot of (sometimes rather serious) bugs in 5.8.0, esp. in the multibyte 
handling, but also in other areas !

And you should also check if perl runs in UTF-8 mode by default. From the man
page:

          You can enable automatic UTF-8-ification of your standard file han-
           dles, default "open()" layer, and @ARGV by using either the "-C"
           command line switch or the "PERL_UNICODE" environment variable, see
           perlrun for the documentation of the "-C" switch.

Good luck, Taco
-- 
groeten,

Taco

Re: Re: texutil "malformed UTF-8 character" error

[Hans Hagen Outside]

Duncan Hothersall wrote:

> I wrote:
>
>> Malformed UTF-8 character (unexpected end of string) at 
>> /usr/TeX/texmf/scripts/context/perl/texutil.pl line 1520, <TUI> line 3.
>
> etc.
>
> Forgot to say, the /tui file in question has this at line 3:
>
> c \thisisbytesequence{^^G^^[#}
>
> which certainly does look a bit funny.

can you check your cp8bit.tcx file? it probably isn't 8 bit -) should be: 

0x00   0x00  %
0x01   0x01  %
0x02   0x02  %
0x03   0x03  %
0x04   0x04  %

etc 

Hans 


-----------------------------------------------------------------
                                          Hans Hagen | PRAGMA ADE
              Ridderstraat 27 | 8061 GH Hasselt | The Netherlands
     tel: 038 477 53 69 | fax: 038 477 53 74 | www.pragma-ade.com
                                             | www.pragma-pod.nl
-----------------------------------------------------------------