Re: Ruby 1.9.1 and non-ascii char parsing in .tui file

[Jose Augusto <jasaugusto@gmail.com>]

[-- Attachment #1.1: Type: text/plain, Size: 2784 bytes --]

Hi Hans,

The patch I proposed works also with ruby less than 1.9 (e.g. ruby 1.8.7)!
The force_encoding() method is used only if RUBY_VERSION >= 1.9.
If the scripts are executed by ruby 1.8 or lesser version, there's no change
done to
the current line of code (e.g. 'case line.chomp' ).

Also, I verified the patch with ruby 1.8.7 and  with 1.9.1, and it worked in
both cases.

The patch has however the problem of slowing processing (the "if" is
executed
when parsing each line of the files, and probably this issue could be
optimized...)

Meanwhile I don't think that the magic string
# encoding: ASCII-8BIT
solves the problem. This string indicates that the script is written in
ASCII-8BIT,
but when is reading the strings from the .tex or .tui files ruby 1.9.1
considers
them as US-ASCII regardless of the encoding declared in # encoding: ...

I introduced " # encoding: ASCII-8BIT  " in texmfstart.rb, tex.rb and
texutil.rb
and the problem didn't disapeer :-(

Of course I may be wrong. But the experiments I did make me think this way.
Also, I don't have Linux at my disposal (I mean, with context installed) and
there
the behavior perhaps is different...

Kind regards and thank you very much.

J. Augusto






On Mon, Aug 10, 2009 at 5:27 PM, Hans Hagen <pragma@wxs.nl> wrote:

> Jose Augusto wrote:
>
>> I Hans,
>>
>> I just sent a mail with a possible patch, before I read this answer from
>> you
>> :-)
>> As I say there, the patches work (at least for me) and I had updated
>> context
>> mkii a few hours ago, so I don't know if the betas you mentioned have
>> already
>> been installed...
>>
>> Hope the proposed patches be helpful...
>>
>
> your patch will not work with ruby < 1.9 so if my patch (opening files in
> rb mode) works ok that's more robust;
>
> another option is to patch texmfstart.rb
>
> #!/usr/bin/env ruby
> #encoding: ASCII-8BIT
>
>
>
> -----------------------------------------------------------------
>                                          Hans Hagen | PRAGMA ADE
>              Ridderstraat 27 | 8061 GH Hasselt | The Netherlands
>     tel: 038 477 53 69 | fax: 038 477 53 74 | www.pragma-ade.com
>                                             | www.pragma-pod.nl
> -----------------------------------------------------------------
>
> ___________________________________________________________________________________
> If your question is of interest to others as well, please add an entry to
> the Wiki!
>
> maillist : ntg-context@ntg.nl /
> http://www.ntg.nl/mailman/listinfo/ntg-context
> webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
> archive  : https://foundry.supelec.fr/projects/contextrev/
> wiki     : http://contextgarden.net
>
> ___________________________________________________________________________________
>

[-- Attachment #1.2: Type: text/html, Size: 3982 bytes --]

[-- Attachment #2: Type: text/plain, Size: 487 bytes --]

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : https://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________