Re: UTF conversion via Lua - Procházka Lukáš Ing.

From: "Procházka Lukáš Ing. - Pontex s. r. o." <LPr@pontex.cz>
To: "mailing list for ConTeXt users" <ntg-context@ntg.nl>
Subject: Re: UTF conversion via Lua
Date: Fri, 10 Feb 2012 12:32:22 +0100	[thread overview]
Message-ID: <op.v9gnn8mctpjj8f@lpr> (raw)
In-Reply-To: <A3E152D5-6C86-4F65-ACC0-CF6BA08C50A3@googlemail.com>

[-- Attachment #1: Type: text/plain, Size: 2275 bytes --]

... \enableregime - nice idea!

Despite this, I'm still not able to make work the example:

---- Test.mkiv
\enableregime[cp1250]

\starttext
   \startluacode
     function loadFile(fn)
       local fh = assert(io.open(fn, "r"))
       local str = fh:read("*all")

       fh:close()

       return str
     end

     context.startregime{"cp1250"}
       context(loadFile("a.txt"))
     context.stopregime()
   \stopluacode
\stoptext
----

Where's the problem?

Lukas

On Fri, 10 Feb 2012 12:15:29 +0100, Wolfgang Schuster <schuster.wolfgang@googlemail.com> wrote:

>
> Am 10.02.2012 um 12:11 schrieb Procházka Lukáš Ing. - Pontex s. r. o.:
>
>> ... Well, my information was not correct.
>>
>> There are characters > 127 in the file, like "ř", "š"...
>>
>> Each char = 1 byte, and as I'm using Windows with CP 1250, the characters are displayed correctly.
>>
>> But I have problem loading them into ConTeXt.
>>
>> I need to convert the bytes > 127 to UTF sequence, which would be acceptable by ConTeXt.
>>
>> @Thomas:
>>
>> The table looks nice but there are no entries for CP 1250 to UTF conversion.
>>
>> I prepared some tables: character conversion and removal of diacritics (see the attachment);
>> maybe it would be handful to include them into ConTeXt somehow.
>
> Why don’t you let do context the conversion:
>
> \starttext
>
> this is something in utf8
>
> \startregime[cp1250]
> \input filewithcp1250encoding
> \stopregime
>
> more text encoded in utf8
>
> \stoptext
>
> Wolfgang
> ___________________________________________________________________________________
> If your question is of interest to others as well, please add an entry to the Wiki!
>
> maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
> webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
> archive  : http://foundry.supelec.fr/projects/contextrev/
> wiki     : http://contextgarden.net
> ___________________________________________________________________________________

-- 
Ing. Lukáš Procházka [mailto:LPr@pontex.cz]
Pontex s. r. o.      [mailto:pontex@pontex.cz] [http://www.pontex.cz]
Bezová 1658
147 14 Praha 4

Tel: +420 244 062 238
Fax: +420 244 461 038

[-- Attachment #2: a.txt --]
[-- Type: text/plain, Size: 9 bytes --]

abc
žý

[-- Attachment #3: Test.mkiv --]
[-- Type: application/octet-stream, Size: 332 bytes --]

\enableregime[cp1250]

\starttext
  \startluacode
    function loadFile(fn)
      local fh = assert(io.open(fn, "r"))
      local str = fh:read("*all")

      fh:close()

      return str
    end

    context.startregime{"cp1250"}
      context(loadFile("a.txt"))
    context.stopregime()
  \stopluacode
\stoptext

[-- Attachment #4: Type: text/plain, Size: 485 bytes --]

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________