From mboxrd@z Thu Jan 1 00:00:00 1970 X-Msuck: nntp://news.gmane.io/gmane.comp.tex.context/52162 Path: news.gmane.org!not-for-mail From: Jose Augusto Newsgroups: gmane.comp.tex.context Subject: Re: Ruby 1.9.1 and non-ascii char parsing in .tui file Date: Mon, 10 Aug 2009 16:21:41 +0100 Message-ID: <1781d7210908100821s1c343d9j95aa4bffe9d7db92@mail.gmail.com> References: <1781d7210908081216n46c62018kb3a5f14643afb396@mail.gmail.com> <4A7F2A0D.2010907@wxs.nl> <1781d7210908092015n2d57ae21n6f09fd66729e41ac@mail.gmail.com> <4A801C60.8030501@wxs.nl> Reply-To: mailing list for ConTeXt users NNTP-Posting-Host: lo.gmane.org Mime-Version: 1.0 Content-Type: multipart/mixed; boundary="===============0617273375==" X-Trace: ger.gmane.org 1249917720 3508 80.91.229.12 (10 Aug 2009 15:22:00 GMT) X-Complaints-To: usenet@ger.gmane.org NNTP-Posting-Date: Mon, 10 Aug 2009 15:22:00 +0000 (UTC) To: mailing list for ConTeXt users Original-X-From: ntg-context-bounces@ntg.nl Mon Aug 10 17:21:53 2009 Return-path: Envelope-to: gctc-ntg-context-518@m.gmane.org Original-Received: from balder.ntg.nl ([195.12.62.10]) by lo.gmane.org with esmtp (Exim 4.50) id 1MaWh7-0003fy-Fx for gctc-ntg-context-518@m.gmane.org; Mon, 10 Aug 2009 17:21:53 +0200 Original-Received: from localhost (localhost [127.0.0.1]) by balder.ntg.nl (Postfix) with ESMTP id 7BDF5C9A9B; Mon, 10 Aug 2009 17:21:50 +0200 (CEST) X-Virus-Scanned: Debian amavisd-new at balder.ntg.nl Original-Received: from balder.ntg.nl ([127.0.0.1]) by localhost (balder.ntg.nl [127.0.0.1]) (amavisd-new, port 10024) with LMTP id B+7+iTQ7Vybn; Mon, 10 Aug 2009 17:21:47 +0200 (CEST) Original-Received: from balder.ntg.nl (localhost [127.0.0.1]) by balder.ntg.nl (Postfix) with ESMTP id 1CF8BC9A7C; Mon, 10 Aug 2009 17:21:47 +0200 (CEST) Original-Received: from localhost (localhost [127.0.0.1]) by balder.ntg.nl (Postfix) with ESMTP id 4C6EAC9A7C for ; Mon, 10 Aug 2009 17:21:45 +0200 (CEST) X-Virus-Scanned: Debian amavisd-new at balder.ntg.nl Original-Received: from balder.ntg.nl ([127.0.0.1]) by localhost (balder.ntg.nl [127.0.0.1]) (amavisd-new, port 10024) with LMTP id cYN7sWeBOEwA for ; Mon, 10 Aug 2009 17:21:42 +0200 (CEST) Original-Received: from mail-bw0-f207.google.com (mail-bw0-f207.google.com [209.85.218.207]) by balder.ntg.nl (Postfix) with ESMTP id A8E0AC9A77 for ; Mon, 10 Aug 2009 17:21:42 +0200 (CEST) Original-Received: by bwz3 with SMTP id 3so2665538bwz.2 for ; Mon, 10 Aug 2009 08:21:42 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :date:message-id:subject:from:to:content-type; bh=SKumEdYugTgUhuNXqUmSbereBWVhKbvSoyBA1GNloyU=; b=ddZjroA7B1Ct0igriGwxGJXQigfD671yrBub1/wDOry9ldFDo9rFWRBVx47QycqjXd 13FxGelUC3VIHWff0eEbCk5YbHANwuNbfXGBQDZco4PU+0Cvas9bSBk5EpGQOOteiZK0 WLEtskqqHkbHg6LjrTO2mh1MCgE/aTHv0zfeo= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; b=NNuakbDdeWB9wfDiA+fG5WdGkoVD4GRPk++BpYMlTvsPitd2adM96fwSX9cChtnRqL rD/aP3giuX3TCGY6XEP473B7ZemmfiDeiRBIW6ZlWuxFlf7ijA0FltzOoysuAu8il0nG fT7ZTcCLIJ+wadSxCRc0AEaSSbLknI3chfZcw= Original-Received: by 10.223.121.6 with SMTP id f6mr392781far.51.1249917701346; Mon, 10 Aug 2009 08:21:41 -0700 (PDT) In-Reply-To: <4A801C60.8030501@wxs.nl> X-BeenThere: ntg-context@ntg.nl X-Mailman-Version: 2.1.12 Precedence: list List-Id: mailing list for ConTeXt users List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Original-Sender: ntg-context-bounces@ntg.nl Errors-To: ntg-context-bounces@ntg.nl Xref: news.gmane.org gmane.comp.tex.context:52162 Archived-At: --===============0617273375== Content-Type: multipart/alternative; boundary=001636c5bb719656aa0470cb24a2 --001636c5bb719656aa0470cb24a2 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit I Hans, I just sent a mail with a possible patch, before I read this answer from you :-) As I say there, the patches work (at least for me) and I had updated context mkii a few hours ago, so I don't know if the betas you mentioned have already been installed... Hope the proposed patches be helpful... Thx very much for your answer. J. Augusto On Mon, Aug 10, 2009 at 2:10 PM, Hans Hagen wrote: > Jose Augusto wrote: > >> Hi all, >> >> Ok, here it goes. Atached are the files used in the test. >> >> The problem as reported in the >> previous email << used >> the file with the offending chars wrapped in a main file, which was just: >> >> \starttext >> \input zzz.tex >> \stoptext >> >> That is, the offending chars were in zzz.tex. >> >> In that example I noticed the error because the cross-refs >> in the equation numbering were not working. >> The parsing of the .tui file by ruby 1.9.1 failed. Then I saw the errors. >> > > ruby 1.9 internally is no longer 8 bit clean i.e. there is always an > encoding (file as well as internal); there is no way to enforce this (there > is the -E option but that is useless for 1.8) > > i now open some files explicitly in binary mode; maybe that helps; i have > no clue what happens with string manipulations later on > > i always liked ruby but such fundamental changes (encoding, dropping > functions etc) without renaming the program are a showstopper for me as one > cannot predict what will be on the user's system > > it looks like i have to convert the texutil part to lua (takes a few days > and since i mostly use luatex it has a low priority) > > i uploaded a beta for testing > > Hans > > > ----------------------------------------------------------------- > Hans Hagen | PRAGMA ADE > Ridderstraat 27 | 8061 GH Hasselt | The Netherlands > tel: 038 477 53 69 | fax: 038 477 53 74 | www.pragma-ade.com > | www.pragma-pod.nl > ----------------------------------------------------------------- > > ___________________________________________________________________________________ > If your question is of interest to others as well, please add an entry to > the Wiki! > > maillist : ntg-context@ntg.nl / > http://www.ntg.nl/mailman/listinfo/ntg-context > webpage : http://www.pragma-ade.nl / http://tex.aanhet.net > archive : https://foundry.supelec.fr/projects/contextrev/ > wiki : http://contextgarden.net > > ___________________________________________________________________________________ > --001636c5bb719656aa0470cb24a2 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable I Hans,

I just sent a mail with a possible patch, before I read this= answer from you :-)
As I say there, the patches work (at least for me) = and I had updated context
mkii a few hours ago, so I don't know if t= he betas you mentioned have already
been installed...

Hope the proposed patches be helpful...
Thx ver= y much for your answer.

J. Augusto

On Mon, Aug 10, 2009 at 2:10 PM, Hans Hagen <pragma@wxs.nl> wrote:
Jose Augusto wrote:
Hi all,

Ok, here it goes. Atached are the files used in the test.

The problem as reported in the >> previous email << used
the file with the offending chars wrapped in a main file, which was just:
\starttext
\input zzz.tex
\stoptext

That is, the offending chars were in zzz.tex.

In that example I noticed the error because the cross-refs
in the equation numbering were not working.
The parsing of the .tui file by ruby 1.9.1 failed. Then I saw the errors.

ruby 1.9 internally is no longer 8 bit clean i.e. there is always an encodi= ng (file as well as internal); there is no way to enforce this (there is th= e -E option but that is useless for 1.8)

i now open some files explicitly in binary mode; maybe that helps; i have n= o clue what happens with string manipulations later on

i always liked ruby but such fundamental changes (encoding, dropping functi= ons etc) without renaming the program are a showstopper for me as one canno= t predict what will be on the user's system

it looks like i have to convert the texutil part to lua (takes a few days a= nd since i mostly use luatex it has a low priority)

i uploaded a beta for testing

Hans


-----------------------------------------------------------------
=A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0Hans Hagen | PRAGMA ADE
=A0 =A0 =A0 =A0 =A0 =A0 =A0Ridderstraat 27 | 8061 GH Hasselt | The Netherl= ands
=A0 =A0 tel: 038 477 53 69 | fax: 038 477 53 74 | www.pragma-ade.com
=A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 =A0 | ww= w.pragma-pod.nl
-----------------------------------------------------------------
___________________________________________________________________________= ________
If your question is of interest to others as well, please add an entry to t= he Wiki!

maillist : ntg-cont= ext@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage =A0: http://= www.pragma-ade.nl / http://tex.aanhet.net
archive =A0: https://foundry.supelec.fr/projects/contextrev/
wiki =A0 =A0 : http:= //contextgarden.net
___________________________________________________________________________= ________

--001636c5bb719656aa0470cb24a2-- --===============0617273375== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline ___________________________________________________________________________________ If your question is of interest to others as well, please add an entry to the Wiki! maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context webpage : http://www.pragma-ade.nl / http://tex.aanhet.net archive : https://foundry.supelec.fr/projects/contextrev/ wiki : http://contextgarden.net ___________________________________________________________________________________ --===============0617273375==--