Problem typing file with diacritics by \typefile

Problem typing file with diacritics by \typefile

[Procházka Lukáš Ing. - Pontex s. r. o.]

[-- Attachment #1: Type: text/plain, Size: 1029 bytes --]

Hello,

I have problem. Suppose having t-TypeF.ctx which is to print itself:

---
\enableregime[cp1250]

\starttext

   ABC

   ŽŠČ

   \typefile[]{t-TypeF.ctx}

\stoptext
---

The letters "ŽŠČ" to be printed during \typefile are the problem.

I get a long error message, where the key message is:


l.9   \typefile[]{t-TypeF.ctx}

! String contains an invalid utf-8 sequence.

system          > error on line 73 in file t-TypeF.ctx: String contains an invalid utf-8 sequence ...


l.73
      ´┐Ż

The file is created with CP 1250 = Windows, Eastern Europe, Czech Republic.

So how do I make ctx accept also Czech letters with diacritics like "ŽŠČ"?

- I also looked to wiki to \setuptyping, but it doesn't seem to there would be a command which could change this.

Lukas


-- 
Ing. Lukáš Procházka [mailto:LPr@pontex.cz]
Pontex s. r. o.      [mailto:pontex@pontex.cz] [http://www.pontex.cz]
Bezová 1658
147 14 Praha 4

Tel: +420 244 062 238
Fax: +420 244 461 038

[-- Attachment #2: t-TypeF.ctx --]
[-- Type: application/octet-stream, Size: 87 bytes --]

[-- Attachment #3: Type: text/plain, Size: 486 bytes --]

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: Problem typing file with diacritics by \typefile

[Peter Münster]

On Tue, Oct 12 2010, Procházka Lukáš Ing. - Pontex s. r. o. wrote:

> \enableregime[cp1250]
> 
> \starttext
> 
>   ABC
> 
>   ŽŠČ
> 
>   \typefile[]{t-TypeF.ctx}
> 
> \stoptext
> ---
> 
> The letters "ŽŠČ" to be printed during \typefile are the problem.

Hello,

It seems, that \typefile assumes utf8 independently of the \enableregime.

I would suggest to configure your environment (editor and so on) to use only
utf8.

Cheers, Peter

-- 
Contact information: http://pmrb.free.fr/contact/
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: Problem typing file with diacritics by \typefile

[Procházka Lukáš Ing. - Pontex s. r. o.]

On Tue, 12 Oct 2010 08:45:25 +0200, Peter Münster <pmlists@free.fr> wrote:

> I would suggest to configure your environment (editor and so on) to use only
> utf8.

It's a problem as the file which is \typefiled is generated by another program and I have no control of which characters or which encoding it uses.

All runs programs run under Windows and all [mentioned] are using CP 1250.

Lukas

>
> Cheers, Peter
>

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: Problem typing file with diacritics by \typefile

[Peter Münster]

On Tue, Oct 12 2010, Procházka Lukáš Ing. - Pontex s. r. o. wrote:

> All runs programs run under Windows and all [mentioned] are using CP 1250.

Perhaps with a filter:
windows-program | recode windows-1250..u8 >output-file

Cheers, Peter

-- 
Contact information: http://pmrb.free.fr/contact/
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: Problem typing file with diacritics by \typefile

[Hans Hagen]

On 12-10-2010 9:39, Peter Münster wrote:
> On Tue, Oct 12 2010, Procházka Lukáš Ing. - Pontex s. r. o. wrote:
>
>> All runs programs run under Windows and all [mentioned] are using CP 1250.
>
> Perhaps with a filter:
> windows-program | recode windows-1250..u8>output-file

it's not that complex to support an regime option for \typefile but I 
need an example file then

Hans

-----------------------------------------------------------------
                                           Hans Hagen | PRAGMA ADE
               Ridderstraat 27 | 8061 GH Hasselt | The Netherlands
     tel: 038 477 53 69 | voip: 087 875 68 74 | www.pragma-ade.com
                                              | www.pragma-pod.nl
-----------------------------------------------------------------
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: Problem typing file with diacritics by \typefile

[Procházka Lukáš Ing. - Pontex s. r. o.]

[-- Attachment #1: Type: text/plain, Size: 702 bytes --]

On Tue, 12 Oct 2010 13:24:24 +0200, Hans Hagen <pragma@wxs.nl> wrote:

> On 12-10-2010 9:39, Peter Münster wrote:
>> On Tue, Oct 12 2010, Procházka Lukáš Ing. - Pontex s. r. o. wrote:
>>
>>> All runs programs run under Windows and all [mentioned] are using CP 1250.
>>
>> Perhaps with a filter:
>> windows-program | recode windows-1250..u8>output-file
>
> it's not that complex to support an regime option for \typefile but I
> need an example file then

There is one attached - "t-TypeF.mkiv" - it contains all Czech letters with diacritics.

You can see also all letters with diacritics in Czech - "Cz.txt" (CP 1250) and their "translation" to UTF8 - "Cz-UTF8.txt".

Cheers,

Lukas

[-- Attachment #2: Cz.txt --]
[-- Type: text/plain, Size: 92 bytes --]

á
è
ï
é
ì
í
ò
ó
ø
š

ú
ù
ý
ž

Á
È
Ï
É
Ì
Í
Ò
Ó
Ø
Š

Ú
Ù
Ý
Ž

[-- Attachment #3: Cz-UTF8.txt --]
[-- Type: text/plain, Size: 122 bytes --]

á
č
ď
é
Ä›
í
ň
ó
Å™
Å¡
Å¥
ú
ů
ý
ž

Á
Č
ÄŽ
É
Äš
Í
Ň
Ó
Ř
Å 
Ť
Ú
Å®
Ý
Ž

[-- Attachment #4: t-TypeF.mkiv --]
[-- Type: application/octet-stream, Size: 147 bytes --]

[-- Attachment #5: Type: text/plain, Size: 486 bytes --]

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: Problem typing file with diacritics by \typefile

[Hans Hagen]

[-- Attachment #1: Type: text/plain, Size: 1245 bytes --]

On 12-10-2010 2:14, Procházka Lukáš Ing. - Pontex s. r. o. wrote:
> On Tue, 12 Oct 2010 13:24:24 +0200, Hans Hagen <pragma@wxs.nl> wrote:
>
>> On 12-10-2010 9:39, Peter Münster wrote:
>>> On Tue, Oct 12 2010, Procházka Lukáš Ing. - Pontex s. r. o. wrote:
>>>
>>>> All runs programs run under Windows and all [mentioned] are using CP
>>>> 1250.
>>>
>>> Perhaps with a filter:
>>> windows-program | recode windows-1250..u8>output-file
>>
>> it's not that complex to support an regime option for \typefile but I
>> need an example file then
>
> There is one attached - "t-TypeF.mkiv" - it contains all Czech letters
> with diacritics.
>
> You can see also all letters with diacritics in Czech - "Cz.txt" (CP
> 1250) and their "translation" to UTF8 - "Cz-UTF8.txt".

this will work in the next beta (making zip now)



-----------------------------------------------------------------
                                           Hans Hagen | PRAGMA ADE
               Ridderstraat 27 | 8061 GH Hasselt | The Netherlands
     tel: 038 477 53 69 | voip: 087 875 68 74 | www.pragma-ade.com
                                              | www.pragma-pod.nl
-----------------------------------------------------------------

[-- Attachment #2: regimetest.zip --]
[-- Type: application/zip, Size: 1069 bytes --]

[-- Attachment #3: Type: text/plain, Size: 486 bytes --]

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: Problem typing file with diacritics by \typefile

[Procházka Lukáš Ing. - Pontex s. r. o.]

[-- Attachment #1: Type: text/plain, Size: 503 bytes --]

Hello,

I just downloaded the last beta and it seems there is (again) a problem with \typefile a file with diacritics.

Samples are attached.

Best regards,

Lukas


On Tue, 12 Oct 2010 17:15:06 +0200, Hans Hagen <pragma@wxs.nl> wrote:
>
> this will work in the next beta (making zip now)


-- 
Ing. Lukáš Procházka [mailto:LPr@pontex.cz]
Pontex s. r. o.      [mailto:pontex@pontex.cz] [http://www.pontex.cz]
Bezová 1658
147 14 Praha 4

Tel: +420 244 062 238
Fax: +420 244 461 038

[-- Attachment #2: t.txt --]
[-- Type: text/plain, Size: 17 bytes --]

ABCD
ÁÈÏáíéøžý

[-- Attachment #3: t.mkiv --]
[-- Type: application/octet-stream, Size: 87 bytes --]

\starttext
  \startluacode
    context.typefile("t.txt")
  \stopluacode
\stoptext

[-- Attachment #4: t.log --]
[-- Type: application/octet-stream, Size: 6645 bytes --]

[-- Attachment #5: Type: text/plain, Size: 486 bytes --]

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: Problem typing file with diacritics by \typefile

[Wolfgang Schuster]

Am 13.01.2011 um 11:36 schrieb Procházka Lukáš Ing. - Pontex s. r. o.:

> Hello,
> 
> I just downloaded the last beta and it seems there is (again) a problem with \typefile a file with diacritics.
> 
> Samples are attached.

Save your file in utf-8 encoding, my editor shows me your t.txt is currently encoded as “ISO 8859-7”.

You need also another typewriter font because Latin Modern Typewriter doesn’t contain lowercase greek letters.

Wolfgang

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: Problem typing file with diacritics by \typefile

[Procházka Lukáš Ing. - Pontex s. r. o.]

On Thu, 13 Jan 2011 12:03:06 +0100, Wolfgang Schuster <schuster.wolfgang@googlemail.com> wrote:

>
> Am 13.01.2011 um 11:36 schrieb Procházka Lukáš Ing. - Pontex s. r. o.:
>
>> Hello,
>>
>> I just downloaded the last beta and it seems there is (again) a problem with \typefile a file with diacritics.
>>
>> Samples are attached.
>
> Save your file in utf-8 encoding, my editor shows me your t.txt is currently encoded as “ISO 8859-7”.

... Yes, that's a possibility. But as I can remember, this was fixed and there was no requirement for the file to be UTF-8 encoded (see http://www.ntg.nl/pipermail/ntg-context/2010/053222.html).

The file I want to typeset is generated by another program, which uses diacritics (single bytes), CP1250.

> You need also another typewriter font because Latin Modern Typewriter doesn’t contain lowercase greek letters.

This wouldn't be a problem, greek letters are not included.

Lukas

> Wolfgang
>


-- 
Ing. Lukáš Procházka [mailto:LPr@pontex.cz]
Pontex s. r. o.      [mailto:pontex@pontex.cz] [http://www.pontex.cz]
Bezová 1658
147 14 Praha 4

Tel: +420 244 062 238
Fax: +420 244 461 038

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: Problem typing file with diacritics by \typefile

[Wolfgang Schuster]

Am 13.01.2011 um 12:11 schrieb Procházka Lukáš Ing. - Pontex s. r. o.:

> OSave your file in utf-8 encoding, my editor shows me your t.txt is currently encoded as “ISO 8859-7”.
> 
> ... Yes, that's a possibility. But as I can remember, this was fixed and there was no requirement for the file to be UTF-8 encoded (see http://www.ntg.nl/pipermail/ntg-context/2010/053222.html).
> 
> The file I want to typeset is generated by another program, which uses diacritics (single bytes), CP1250.

And how should ConTeXt know that your file is in another encoding, in the example you referred there was \enableregime[cp1250] at the begin of the document but not in the document you now sent.

Wolfgang

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: Problem typing file with diacritics by \typefile

[Procházka Lukáš Ing. - Pontex s. r. o.]

Hello,

sorry, my silly fault.

The main problem was to use \setuptyping instead of \definetyping.

When I was trying to create an as-small-as-possible example, I forgot to insert \enableregime[1250] to the header, so I encountered additional error messages.

Sorry again for wasting your (and all readers') time.

Lukas


On Thu, 13 Jan 2011 12:18:12 +0100, Wolfgang Schuster <schuster.wolfgang@googlemail.com> wrote:

>
> Am 13.01.2011 um 12:11 schrieb Procházka Lukáš Ing. - Pontex s. r. o.:
>
>> OSave your file in utf-8 encoding, my editor shows me your t.txt is currently encoded as “ISO 8859-7”.
>>
>> ... Yes, that's a possibility. But as I can remember, this was fixed and there was no requirement for the file to be UTF-8 encoded (see http://www.ntg.nl/pipermail/ntg-context/2010/053222.html).
>>
>> The file I want to typeset is generated by another program, which uses diacritics (single bytes), CP1250.
>
> And how should ConTeXt know that your file is in another encoding, in the example you referred there was \enableregime[cp1250] at the begin of the document but not in the document you now sent.
>
> Wolfgang


-- 
Ing. Lukáš Procházka [mailto:LPr@pontex.cz]
Pontex s. r. o.      [mailto:pontex@pontex.cz] [http://www.pontex.cz]
Bezová 1658
147 14 Praha 4

Tel: +420 244 062 238
Fax: +420 244 461 038

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________