bug with en and em dashes

bug with en and em dashes

[Pablo Rodriguez]

Dear list,

using latest beta from 2017.05.09 10:14 with the following sample:

    \starttext
    \startTEXpage[offset=1em]
    -- ---

    – —
    \stopTEXpage
    \stoptext

I get as result:

    -- ----
    -- ----

Ligatures aren’t converted and even real en and em dashes are converted
to hyphens.

Could anyone confirm the issue?

Many thanks for your help,

Pablo
-- 
http://www.ousia.tk
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://context.aanhet.net
archive  : https://bitbucket.org/phg/context-mirror/commits/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: bug with en and em dashes

[Thomas Floeren]

> On 9. May 2017, at 21:10, Pablo Rodriguez <oinos@gmx.es> wrote:
> 
> Dear list,
> 
> using latest beta from 2017.05.09 10:14 with the following sample:
> 
>    \starttext
>    \startTEXpage[offset=1em]
>    -- ---
> 
>    – —
>    \stopTEXpage
>    \stoptext
> 
> I get as result:
> 
>    -- ----
>    -- ----
> 
> Ligatures aren’t converted and even real en and em dashes are converted
> to hyphens.
> 
> Could anyone confirm the issue?



Works as expected here, with ConTeXt 2017.05.10 10:41

Best,
Tom


> 
> Many thanks for your help,
> 
> Pablo
> -- 
> http://www.ousia.tk
> ___________________________________________________________________________________
> If your question is of interest to others as well, please add an entry to the Wiki!
> 
> maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
> webpage  : http://www.pragma-ade.nl / http://context.aanhet.net
> archive  : https://bitbucket.org/phg/context-mirror/commits/
> wiki     : http://contextgarden.net
> ___________________________________________________________________________________

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://context.aanhet.net
archive  : https://bitbucket.org/phg/context-mirror/commits/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: bug with en and em dashes

[Pablo Rodriguez]

On 05/11/2017 04:17 PM, Thomas Floeren wrote:
>> On 9. May 2017, at 21:10, Pablo Rodriguez wrote:
>> [...]
>> Ligatures aren’t converted and even real en and em dashes are converted
>> to hyphens.
>>
>> Could anyone confirm the issue?
> 
> Works as expected here, with ConTeXt 2017.05.10 10:41

Hi Tom,

many thanks for your reply.

I guess your OS is MacOS X. I have just tested a brand-new installation
in Linux 32bit:

time (cd && mkdir temp-ctx-install && cd temp-ctx-install &&\
rsync -ptv rsync://contextgarden.net/minimals/setup/first-setup.sh . &&\
./first-setup.sh --modules=all && cd &&\
source temp-ctx-install/tex/setuptex && mtxrunjit --generate\
&& echo "\starttext – —\par-- ---\stoptext" \
> test-ctx-temp.mkiv && contextjit --purgeall test-ctx-temp.mkiv &&\
evince test-ctx-temp.pdf)

And I’m still experiencing the issue. I wonder whether other Linux
(32bit or 64bit) users are experiencing this.

Many thanks for your help,

Pablo
-- 
http://www.ousia.tk
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://context.aanhet.net
archive  : https://bitbucket.org/phg/context-mirror/commits/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: bug with en and em dashes

[Mikael P. Sundqvist]

[-- Attachment #1: Type: text/plain, Size: 2132 bytes --]

On Thu, May 11, 2017 at 9:04 PM, Pablo Rodriguez <oinos@gmx.es> wrote:
> On 05/11/2017 04:17 PM, Thomas Floeren wrote:
>>> On 9. May 2017, at 21:10, Pablo Rodriguez wrote:
>>> [...]
>>> Ligatures aren’t converted and even real en and em dashes are converted
>>> to hyphens.
>>>
>>> Could anyone confirm the issue?
>>
>> Works as expected here, with ConTeXt 2017.05.10 10:41
>
> Hi Tom,
>
> many thanks for your reply.
>
> I guess your OS is MacOS X. I have just tested a brand-new installation
> in Linux 32bit:
>
> time (cd && mkdir temp-ctx-install && cd temp-ctx-install &&\
> rsync -ptv rsync://contextgarden.net/minimals/setup/first-setup.sh . &&\
> ./first-setup.sh --modules=all && cd &&\
> source temp-ctx-install/tex/setuptex && mtxrunjit --generate\
> && echo "\starttext – —\par-- ---\stoptext" \
>> test-ctx-temp.mkiv && contextjit --purgeall test-ctx-temp.mkiv &&\
> evince test-ctx-temp.pdf)
>
> And I’m still experiencing the issue. I wonder whether other Linux
> (32bit or 64bit) users are experiencing this.
>
> Many thanks for your help,
>
> Pablo
> --
> http://www.ousia.tk
> ___________________________________________________________________________________
> If your question is of interest to others as well, please add an entry to the Wiki!
>
> maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
> webpage  : http://www.pragma-ade.nl / http://context.aanhet.net
> archive  : https://bitbucket.org/phg/context-mirror/commits/
> wiki     : http://contextgarden.net
> ___________________________________________________________________________________

Hi!

I'm not sure what you see but I attach the resulting file, and I see no problem.

$ uname -a
Linux hurf 4.8.0-41-generic #44-Ubuntu SMP Fri Mar 3 15:27:17 UTC 2017
x86_64 x86_64 x86_64 GNU/Linux

$ context --version

mtx-context     | ConTeXt Process Management 1.01
mtx-context     |
mtx-context     | main context file:
/home/mickep/ConTeXt/tex/texmf-context/tex/context/base/mkiv/context.mkiv
mtx-context     | current version: 2017.05.09 10:14

/Mikael

[-- Attachment #2: dashtest.pdf --]
[-- Type: application/pdf, Size: 4462 bytes --]

[-- Attachment #3: Type: text/plain, Size: 492 bytes --]

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://context.aanhet.net
archive  : https://bitbucket.org/phg/context-mirror/commits/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: bug with en and em dashes

[Pablo Rodriguez]

On 05/11/2017 09:25 PM, Mikael P. Sundqvist wrote:
> I'm not sure what you see but I attach the resulting file, and I see no problem.
> 
> $ uname -a
> Linux hurf 4.8.0-41-generic #44-Ubuntu SMP Fri Mar 3 15:27:17 UTC 2017
> x86_64 x86_64 x86_64 GNU/Linux
> 
> mtx-context     | current version: 2017.05.09 10:14

Hi Mikael,

sorry for not being accurate enough before (I have just realized it).

It is about copying from the generated document (it also happens with
your attached PDF file):

    \starttext
    \startTEXpage[offset=1em]
    -- ---

    – —
    \stopTEXpage
    \stoptext

Select all, copy and paste it on a pure-text editor. You will get two
and four hyphens for en and em dashes, respectively.

Could you confirm this? Until very recently, I copied en and em dashes
from PDF documents generated by ConTeXt.

Many thanks for your help,

Pablo
-- 
http://www.ousia.tk
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://context.aanhet.net
archive  : https://bitbucket.org/phg/context-mirror/commits/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: bug with en and em dashes

[Mikael P. Sundqvist]

On Sun, May 14, 2017 at 8:21 PM, Pablo Rodriguez <oinos@gmx.es> wrote:
> On 05/11/2017 09:25 PM, Mikael P. Sundqvist wrote:
>> I'm not sure what you see but I attach the resulting file, and I see no problem.
>>
>> $ uname -a
>> Linux hurf 4.8.0-41-generic #44-Ubuntu SMP Fri Mar 3 15:27:17 UTC 2017
>> x86_64 x86_64 x86_64 GNU/Linux
>>
>> mtx-context     | current version: 2017.05.09 10:14
>
> Hi Mikael,
>
> sorry for not being accurate enough before (I have just realized it).
>
> It is about copying from the generated document (it also happens with
> your attached PDF file):
>
>     \starttext
>     \startTEXpage[offset=1em]
>     -- ---
>
>     – —
>     \stopTEXpage
>     \stoptext
>
> Select all, copy and paste it on a pure-text editor. You will get two
> and four hyphens for en and em dashes, respectively.
>
> Could you confirm this? Until very recently, I copied en and em dashes
> from PDF documents generated by ConTeXt.
>
> Many thanks for your help,
>
> Pablo
> --
> http://www.ousia.tk
> ___________________________________________________________________________________
> If your question is of interest to others as well, please add an entry to the Wiki!
>
> maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
> webpage  : http://www.pragma-ade.nl / http://context.aanhet.net
> archive  : https://bitbucket.org/phg/context-mirror/commits/
> wiki     : http://contextgarden.net
> ___________________________________________________________________________________

Sorry for the misunderstanding. Indeed, I get two and four dashes for
en and em dashes respectively.

/Mikael

-- ----
-- ----
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://context.aanhet.net
archive  : https://bitbucket.org/phg/context-mirror/commits/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: bug with en and em dashes

[Hans Hagen]

On 5/14/2017 8:21 PM, Pablo Rodriguez wrote:
> On 05/11/2017 09:25 PM, Mikael P. Sundqvist wrote:
>> I'm not sure what you see but I attach the resulting file, and I see no problem.
>>
>> $ uname -a
>> Linux hurf 4.8.0-41-generic #44-Ubuntu SMP Fri Mar 3 15:27:17 UTC 2017
>> x86_64 x86_64 x86_64 GNU/Linux
>>
>> mtx-context     | current version: 2017.05.09 10:14
>
> Hi Mikael,
>
> sorry for not being accurate enough before (I have just realized it).
>
> It is about copying from the generated document (it also happens with
> your attached PDF file):
>
>     \starttext
>     \startTEXpage[offset=1em]
>     -- ---
>
>     – —
>     \stopTEXpage
>     \stoptext
>
> Select all, copy and paste it on a pure-text editor. You will get two
> and four hyphens for en and em dashes, respectively.
>
> Could you confirm this? Until very recently, I copied en and em dashes
> from PDF documents generated by ConTeXt.

it has to do with more aggressive tounicode resolution and it happens 
that lm/gyre fonts have these chars as ligatures; i'll be a bit more 
restrictive in that case

Hans

-----------------------------------------------------------------
                                           Hans Hagen | PRAGMA ADE
               Ridderstraat 27 | 8061 GH Hasselt | The Netherlands
        tel: 038 477 53 69 | www.pragma-ade.nl | www.pragma-pod.nl
-----------------------------------------------------------------
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://context.aanhet.net
archive  : https://bitbucket.org/phg/context-mirror/commits/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: bug with en and em dashes

[Pablo Rodriguez]

On 05/15/2017 03:52 PM, Hans Hagen wrote:
> On 5/14/2017 8:21 PM, Pablo Rodriguez wrote:
>> [...]
>> Select all, copy and paste it on a pure-text editor. You will get two
>> and four hyphens for en and em dashes, respectively.
>>
>> Could you confirm this? Until very recently, I copied en and em dashes
>> from PDF documents generated by ConTeXt.
> 
> it has to do with more aggressive tounicode resolution and it happens 
> that lm/gyre fonts have these chars as ligatures; i'll be a bit more 
> restrictive in that case

Hans,

many thanks for fixing the issue (when the new beta is released).

Pablo
-- 
http://www.ousia.tk
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://context.aanhet.net
archive  : https://bitbucket.org/phg/context-mirror/commits/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: bug with en and em dashes

[Hans Hagen]

On 5/15/2017 8:27 PM, Pablo Rodriguez wrote:
> On 05/15/2017 03:52 PM, Hans Hagen wrote:
>> On 5/14/2017 8:21 PM, Pablo Rodriguez wrote:
>>> [...]
>>> Select all, copy and paste it on a pure-text editor. You will get two
>>> and four hyphens for en and em dashes, respectively.
>>>
>>> Could you confirm this? Until very recently, I copied en and em dashes
>>> from PDF documents generated by ConTeXt.
>>
>> it has to do with more aggressive tounicode resolution and it happens
>> that lm/gyre fonts have these chars as ligatures; i'll be a bit more
>> restrictive in that case
>
> Hans,
>
> many thanks for fixing the issue (when the new beta is released).

this week we have 'current' releases as we close in to tl code freeze


-----------------------------------------------------------------
                                           Hans Hagen | PRAGMA ADE
               Ridderstraat 27 | 8061 GH Hasselt | The Netherlands
        tel: 038 477 53 69 | www.pragma-ade.nl | www.pragma-pod.nl
-----------------------------------------------------------------
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://context.aanhet.net
archive  : https://bitbucket.org/phg/context-mirror/commits/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: bug with en and em dashes

[Marcus Vinicius Mesquita]

[-- Attachment #1.1: Type: text/plain, Size: 40 bytes --]

It works flawless in arch linux 64bits.

[-- Attachment #1.2: Type: text/html, Size: 104 bytes --]

[-- Attachment #2: Type: text/plain, Size: 492 bytes --]

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://context.aanhet.net
archive  : https://bitbucket.org/phg/context-mirror/commits/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: bug with en and em dashes

[Andres Conrado]

[-- Attachment #1.1: Type: text/plain, Size: 168 bytes --]

I confirm the issue in NOT present in my machine (Arch Linux x64). I can
see the dashes as they are supposed to be.

Andrés Conrado Montoya
http://chiquitico.org

[-- Attachment #1.2: Type: text/html, Size: 527 bytes --]

[-- Attachment #2: Type: text/plain, Size: 492 bytes --]

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://context.aanhet.net
archive  : https://bitbucket.org/phg/context-mirror/commits/
wiki     : http://contextgarden.net
___________________________________________________________________________________