hyphenation in latest

hyphenation in latest

[Thomas A. Schmitz]

Hi all, Hans,

I get no hyphenation for ancient Greek with the latest beta (and, as I  
have seen, a couple of betas before that). Test file (I hope this  
doesn't get butchered in the mail):

\usetypescriptfile[type-gentium]
\usetypescript[gentium]
\setupbodyfont[gentium,12pt]

\starttext

\language[agr] φιλοσοφία \hyphenatedword{φιλοσοφία}

\stoptext

Interestingly, the log file says:

mkiv lua stats : loaded patterns           - agr:gr:pat:exc:3  
us:us:pat:exc:2

but there is no hyphenation. Any pointers?

All best

Thomas
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : https://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: hyphenation in latest

[Hans Hagen]

Thomas A. Schmitz wrote:
> Hi all, Hans,
> 
> I get no hyphenation for ancient Greek with the latest beta (and, as I 
> have seen, a couple of betas before that). Test file (I hope this 
> doesn't get butchered in the mail):
> 
> \usetypescriptfile[type-gentium]
> \usetypescript[gentium]
> \setupbodyfont[gentium,12pt]
> 
> \starttext
> 
> \language[agr] φιλοσοφία \hyphenatedword{φιλοσοφία}
> 
> \stoptext
> 
> Interestingly, the log file says:
> 
> mkiv lua stats : loaded patterns           - agr:gr:pat:exc:3 
> us:us:pat:exc:2
> 
> but there is no hyphenation. Any pointers?

maybe somethign with the greek patterns then?

\starttext

\definedfont[cambria]

\language[agr] % try different ones
\the\normallanguage

\input tufte

\stoptext

-----------------------------------------------------------------
                                           Hans Hagen | PRAGMA ADE
               Ridderstraat 27 | 8061 GH Hasselt | The Netherlands
      tel: 038 477 53 69 | fax: 038 477 53 74 | www.pragma-ade.com
                                              | www.pragma-pod.nl
-----------------------------------------------------------------
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : https://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: hyphenation in latest

[Thomas A. Schmitz]

On Apr 9, 2009, at 12:00 AM, Hans Hagen wrote:

> maybe somethign with the greek patterns then?
>
> \starttext
>
> \definedfont[cambria]
>
> \language[agr] % try different ones
> \the\normallanguage
>
> \input tufte
>
> \stoptext

I have looked at the Greek patterns, and there's nothing wrong with  
them; I also tried with older patterns from 2007 which I know worked a  
while ago - nothing, no hyphenation at all. Language like fr and de  
work, but I would need another example with a non-Latin script. Can  
anybody test with Russian or Ukrainian?

Thomas
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : https://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: hyphenation in latest

[Hans Hagen]

Thomas A. Schmitz wrote:
> 
> On Apr 9, 2009, at 12:00 AM, Hans Hagen wrote:
> 
>> maybe somethign with the greek patterns then?
>>
>> \starttext
>>
>> \definedfont[cambria]
>>
>> \language[agr] % try different ones
>> \the\normallanguage
>>
>> \input tufte
>>
>> \stoptext
> 
> I have looked at the Greek patterns, and there's nothing wrong with 
> them; I also tried with older patterns from 2007 which I know worked a 
> while ago - nothing, no hyphenation at all. Language like fr and de 
> work, but I would need another example with a non-Latin script. Can 
> anybody test with Russian or Ukrainian?

weird, as the catcodes look ok


-----------------------------------------------------------------
                                           Hans Hagen | PRAGMA ADE
               Ridderstraat 27 | 8061 GH Hasselt | The Netherlands
      tel: 038 477 53 69 | fax: 038 477 53 74 | www.pragma-ade.com
                                              | www.pragma-pod.nl
-----------------------------------------------------------------
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : https://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: hyphenation in latest

[Thomas A. Schmitz]

On Apr 9, 2009, at 12:11 PM, Hans Hagen wrote:

> weird, as the catcodes look ok
>

Hmm, I'll do some more tests later; I'll be offline until Sunday  
night. But it doesn't work in mkii either, so the bug probably is with  
the pattern file.

Thomas
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : https://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: hyphenation in latest

[Thomas A. Schmitz]

On Apr 9, 2009, at 12:18 PM, Thomas A. Schmitz wrote:

>
> On Apr 9, 2009, at 12:11 PM, Hans Hagen wrote:
>
>> weird, as the catcodes look ok
>>
>
> Hmm, I'll do some more tests later; I'll be offline until Sunday  
> night. But it doesn't work in mkii either, so the bug probably is  
> with the pattern file.
>
OK, just one more detail before I leave: I get proper hyphenation with  
luatex version 0.35.0 and ConTeXt version 2009.02.24 (had this older  
version still on my linux box). lang-agr.pat in this version and the  
most recent beta is identical. So it's not the pattern file itself  
which is at fault; in between, something must have changed in the way  
the patterns are loaded and used, either in luatex itself or in ConTeXt.

Thomas
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : https://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: hyphenation in latest

[Hans Hagen]

Thomas A. Schmitz wrote:
> 
> On Apr 9, 2009, at 12:18 PM, Thomas A. Schmitz wrote:
> 
>>
>> On Apr 9, 2009, at 12:11 PM, Hans Hagen wrote:
>>
>>> weird, as the catcodes look ok
>>>
>>
>> Hmm, I'll do some more tests later; I'll be offline until Sunday 
>> night. But it doesn't work in mkii either, so the bug probably is with 
>> the pattern file.
>>
> OK, just one more detail before I leave: I get proper hyphenation with 
> luatex version 0.35.0 and ConTeXt version 2009.02.24 (had this older 
> version still on my linux box). lang-agr.pat in this version and the 
> most recent beta is identical. So it's not the pattern file itself which 
> is at fault; in between, something must have changed in the way the 
> patterns are loaded and used, either in luatex itself or in ConTeXt.

in lang-grk ...

\installlanguage
   [\s!agr]
   [\s!default=\s!gr,
    \s!patterns=\s!agr,
    \s!mapping=\s!agr,
    \s!encoding=\s!agr]

there are no gr patterns so you need to specify another set


-----------------------------------------------------------------
                                           Hans Hagen | PRAGMA ADE
               Ridderstraat 27 | 8061 GH Hasselt | The Netherlands
      tel: 038 477 53 69 | fax: 038 477 53 74 | www.pragma-ade.com
                                              | www.pragma-pod.nl
-----------------------------------------------------------------
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : https://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: hyphenation in latest

[Thomas A. Schmitz]

On Apr 9, 2009, at 3:46 PM, Hans Hagen wrote:

> in lang-grk ...
>
> \installlanguage
>  [\s!agr]
>  [\s!default=\s!gr,
>   \s!patterns=\s!agr,
>   \s!mapping=\s!agr,
>   \s!encoding=\s!agr]
>
> there are no gr patterns so you need to specify another set
>
Thanks Hans, it works again in the latest beta!

All best

Thomas
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : https://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: hyphenation in latest

[Vyatcheslav Yatskovsky]

I can. Please, explain what have to be tested in Russian and Ukrainian, 
and what result are expected?

Vyatcheslav
> maybe somethign with the greek patterns then?
> >
> >  \starttext
> >
> >  \definedfont[cambria]
> >
> >  \language[agr] % try different ones
> >  \the\normallanguage
> >
> >  \input tufte
> >
> >  \stoptext
>    
>
> I have looked at the Greek patterns, and there's nothing wrong with
> them; I also tried with older patterns from 2007 which I know worked a
> while ago - nothing, no hyphenation at all. Language like fr and de
> work, but I would need another example with a non-Latin script. Can
> anybody test with Russian or Ukrainian?
>
> Thomas
>    

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : https://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: hyphenation in latest

[Thomas A. Schmitz]

On Apr 9, 2009, at 8:35 AM, Vyatcheslav Yatskovsky wrote:

> I can. Please, explain what have to be tested in Russian and  
> Ukrainian, and what result are expected?
>
> Vyatcheslav

Great. Just run a simple test file like this

\usetypescriptfile[type-gentium] % or any other typescript that has  
Cyrillic
\usetypescript[gentium]
\setupbodyfont[gentium,12pt]

\starttext

{\language[agr] \the\normallanguage φιλοσοφία  
\hyphenatedword{φιλοσοφία}}

{\language[XXX] \the\normallanguage \hyphenatedword{YYY}}

\stoptext

where XXX is the language code for Russian (ru, I assume?) or  
Ukrainian (uk?), and YYY is a Russian/Ukrainian word long enough to  
allow hyphenation. The output should show you the word with the proper  
hyphenation (whereas here, there is no hyphenation in the Greek word.

Thanks!

Thomas
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : https://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________