Changes in hyphenations with 2016-10-12 beta

Changes in hyphenations with 2016-10-12 beta

[josephcanedo]

[-- Attachment #1.1: Type: text/plain, Size: 627 bytes --]

Dear list,

After ugrading to latest beta (to test typesetting with it for now), I noticed that some words that used to be hyphenated with previous versions are no longer hyphenated in the output, especially when the word break used to happen at a ligature (for example ‘st’ or ‘ct’).

I had a quick look to the différences in files in tex/texmf-context/tex/context/base directory and I see some changes to font handling. 

Is this expected ? Or is there any mechanism to get the old behaviour ? I’ll try to build a MWE to show this if that’s required.

Thanks a lot,

Best regards

Joseph Canedo


[-- Attachment #1.2: Type: text/html, Size: 2223 bytes --]

[-- Attachment #2: Type: text/plain, Size: 489 bytes --]

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://context.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: Changes in hyphenations with 2016-10-12 beta

[josephcanedo]

[-- Attachment #1.1: Type: text/plain, Size: 1721 bytes --]

Apparently this difference comes from this change in font-ots.lua near line 603. If I edit the file to put back the discretionary_code argument, the output is same with new beta.

MWE (well as close to MWE I could write, requires EBGaramond unfortunately).

\language[fr]
\definefontfeature[feat][
  mode=node, ccmp=yes, calt=yes,
  liga=yes, dlig=yes, hlig=yes,
  kern=yes, mark=yes, mkmk=yes,
  onum=yes, pnum=yes, salt=yes,
  script=latn, trep=yes,
  dlig=yes, cv91=yes, ss05=no,
  protrusion=quality, expansion=quality]

\definefontfamily[mainfont][serif][EBGaramond][features=feat]
\setupbodyfont[mainfont, 9pt]

\setupalign[hanging, lesshyphenation, hz]

\starttext

\setbox\scratchbox\vbox{\hsize=8.43cm
T advint qu'il y eut famine au pays/ oultre la premiere famine/ qui fut
 au temps de Abraham. Et Izahak s'en alla vers Abimelech 
Roy des Philisthins en Gerar}\box\scratchbox

\stoptext

De : josephcanedo@gmail.com
Envoyé le :jeudi 13 octobre 2016 10:17
À : mailing list for ConTeXt users
Objet :Changes in hyphenations with 2016-10-12 beta

Dear list,

After ugrading to latest beta (to test typesetting with it for now), I noticed that some words that used to be hyphenated with previous versions are no longer hyphenated in the output, especially when the word break used to happen at a ligature (for example ‘st’ or ‘ct’).

I had a quick look to the différences in files in tex/texmf-context/tex/context/base directory and I see some changes to font handling. 

Is this expected ? Or is there any mechanism to get the old behaviour ? I’ll try to build a MWE to show this if that’s required.

Thanks a lot,

Best regards

Joseph Canedo



[-- Attachment #1.2: Type: text/html, Size: 4504 bytes --]

[-- Attachment #2: new.pdf --]
[-- Type: application/pdf, Size: 9918 bytes --]

[-- Attachment #3: old.pdf --]
[-- Type: application/pdf, Size: 9479 bytes --]

[-- Attachment #4: Type: text/plain, Size: 489 bytes --]

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://context.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: Changes in hyphenations with 2016-10-12 beta

[Pablo Rodriguez]

On 10/13/2016 11:56 AM, josephcanedo@gmail.com wrote:
> Apparently this difference comes from this change in font-ots.lua near
> line 603. If I edit the file to put back the discretionary_code
> argument, the output is same with new beta.

Hi Joseph,

French hyphenation is unknown to me, but I have a different approach.

> MWE (well as close to MWE I could write, requires EBGaramond unfortunately).
> 
> \language[fr]

The document main language is invoked in ConTeXt with:

    \mainlanguage[fr]

> \setupalign[hanging, lesshyphenation, hz]

I suspect that if you ask for less hyphenation, you get it.

See my sample:

    \mainlanguage[fr]
    \setupalign[lesshyphenation]
    \starttext
    \hyphenatedword{T advint qu'il y eut famine au pays/ oultre la
    premiere famine/ qui fut au temps de Abraham. Et Izahak s'en alla
    vers Abimelech Roy des Philisthins en Gerar}
    \stoptext

\hyphenatedword is your friend here. I get different results if I
comment the second line (to get normal hyphenation).

I wonder whether this might be causing the issue you’re experiencing.

Just in case it helps,


Pablo
-- 
http://www.ousia.tk
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://context.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: Changes in hyphenations with 2016-10-12 beta

[Hans Hagen]

On 10/13/2016 7:37 PM, Pablo Rodriguez wrote:
> On 10/13/2016 11:56 AM, josephcanedo@gmail.com wrote:
>> Apparently this difference comes from this change in font-ots.lua near
>> line 603. If I edit the file to put back the discretionary_code
>> argument, the output is same with new beta.
>
> Hi Joseph,
>
> French hyphenation is unknown to me, but I have a different approach.

When messing with disc nodes one can argue if some of then need to 
become discretionary nodes or keep their other type. This change keeps 
it more original (of course one can  argue about it) which has some 
consequence for the number of passes that tex makes (pass without 
hyphenation, pass with hyphenation, pass with hyphenation and stretch)

i plan to makes things a bit more configureable in the alternative 
hyphenator

one can also argue that the first pass can be omitted (i.e. always go 
for the best solution)

>> MWE (well as close to MWE I could write, requires EBGaramond unfortunately).
>>
>> \language[fr]
>
> The document main language is invoked in ConTeXt with:
>
>     \mainlanguage[fr]
>
>> \setupalign[hanging, lesshyphenation, hz]
>
> I suspect that if you ask for less hyphenation, you get it.
>
> See my sample:
>
>     \mainlanguage[fr]
>     \setupalign[lesshyphenation]
>     \starttext
>     \hyphenatedword{T advint qu'il y eut famine au pays/ oultre la
>     premiere famine/ qui fut au temps de Abraham. Et Izahak s'en alla
>     vers Abimelech Roy des Philisthins en Gerar}
>     \stoptext
>
> \hyphenatedword is your friend here. I get different results if I
> comment the second line (to get normal hyphenation).
>
> I wonder whether this might be causing the issue you’re experiencing.
>
> Just in case it helps,
>
>
> Pablo
>


-- 

-----------------------------------------------------------------
                                           Hans Hagen | PRAGMA ADE
               Ridderstraat 27 | 8061 GH Hasselt | The Netherlands
        tel: 038 477 53 69 | www.pragma-ade.nl | www.pragma-pod.nl
-----------------------------------------------------------------
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://context.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: Changes in hyphenations with 2016-10-12 beta

[josephcanedo]

[-- Attachment #1.1: Type: text/plain, Size: 3022 bytes --]

Great, thanks a lot Hans. Not a big issue (some glues are bit more stretched than before here and there, but not to the point to have underfulls), but curious to understand.
Best regards

Joseph

De : Hans Hagen
Envoyé le :jeudi 13 octobre 2016 20:51
À : mailing list for ConTeXt users
Objet :Re: [NTG-context] Changes in hyphenations with 2016-10-12 beta

On 10/13/2016 7:37 PM, Pablo Rodriguez wrote:
> On 10/13/2016 11:56 AM, josephcanedo@gmail.com wrote:
>> Apparently this difference comes from this change in font-ots.lua near
>> line 603. If I edit the file to put back the discretionary_code
>> argument, the output is same with new beta.
>
> Hi Joseph,
>
> French hyphenation is unknown to me, but I have a different approach.

When messing with disc nodes one can argue if some of then need to 
become discretionary nodes or keep their other type. This change keeps 
it more original (of course one can  argue about it) which has some 
consequence for the number of passes that tex makes (pass without 
hyphenation, pass with hyphenation, pass with hyphenation and stretch)

i plan to makes things a bit more configureable in the alternative 
hyphenator

one can also argue that the first pass can be omitted (i.e. always go 
for the best solution)

>> MWE (well as close to MWE I could write, requires EBGaramond unfortunately).
>>
>> \language[fr]
>
> The document main language is invoked in ConTeXt with:
>
>     \mainlanguage[fr]
>
>> \setupalign[hanging, lesshyphenation, hz]
>
> I suspect that if you ask for less hyphenation, you get it.
>
> See my sample:
>
>     \mainlanguage[fr]
>     \setupalign[lesshyphenation]
>     \starttext
>     \hyphenatedword{T advint qu'il y eut famine au pays/ oultre la
>     premiere famine/ qui fut au temps de Abraham. Et Izahak s'en alla
>     vers Abimelech Roy des Philisthins en Gerar}
>     \stoptext
>
> \hyphenatedword is your friend here. I get different results if I
> comment the second line (to get normal hyphenation).
>
> I wonder whether this might be causing the issue you’re experiencing.
>
> Just in case it helps,
>
>
> Pablo
>


-- 

-----------------------------------------------------------------
                                           Hans Hagen | PRAGMA ADE
               Ridderstraat 27 | 8061 GH Hasselt | The Netherlands
        tel: 038 477 53 69 | www.pragma-ade.nl | www.pragma-pod.nl
-----------------------------------------------------------------
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://context.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________


[-- Attachment #1.2: Type: text/html, Size: 6831 bytes --]

[-- Attachment #2: Type: text/plain, Size: 489 bytes --]

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://context.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________