copy&paste from pdf bug (smallcaps, text figures)

copy&paste from pdf bug (smallcaps, text figures)

[Philipp Gesang]

[-- Attachment #1.1: Type: text/plain, Size: 737 bytes --]

Hi,

copy&paste from PDF is broken:

  \setupbodyfont [iwona]
  \starttext
    \feature[+][just-os,smallcaps] 0123456789 abcdefghijklmnopqrstuvwxyz
  \stoptext

Result:   
Expected: 0123456789abcdefghijklmnopqrstuvwxyz

(Tried in Okular, but reported for other readers as well [1])

Thanks to Marius’ git mirror I could bisect the changes since
TL 2012. It looks like the issue has been introduced with release
"stable 2013.05.27 09:10" [2].

Best regards,
Philipp


[1] http://tex.stackexchange.com/q/126333/14066
[2] http://repo.or.cz/w/context.git/commitdiff/6b2f7c5fd7a3e465f4e2662b1e5bd2c9d5cce8f8

[-- Attachment #1.2: Type: application/pgp-signature, Size: 490 bytes --]

[-- Attachment #2: Type: text/plain, Size: 485 bytes --]

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: copy&paste from pdf bug (smallcaps, text figures)

[Otared Kavian]

Hi,

I tested your example: no problem here on Mac OS X 10.8.4, with either TeXShop, Adobe Redaer or Preview, with the latest beta (ConTeXt  ver: 2013.08.01 01:31 MKIV beta  fmt: 2013.8.1  int: english/english).

Best regards: OK

On 1 août 2013, at 19:33, Philipp Gesang <Philipp.Gesang@alumni.uni-heidelberg.de> wrote:

> Hi,
> 
> copy&paste from PDF is broken:
> 
>  \setupbodyfont [iwona]
>  \starttext
>    \feature[+][just-os,smallcaps] 0123456789 abcdefghijklmnopqrstuvwxyz
>  \stoptext
> 
> Result:   
> Expected: 0123456789abcdefghijklmnopqrstuvwxyz
> 
> (Tried in Okular, but reported for other readers as well [1])
> 
> Thanks to Marius’ git mirror I could bisect the changes since
> TL 2012. It looks like the issue has been introduced with release
> "stable 2013.05.27 09:10" [2].
> 
> Best regards,
> Philipp
> 
> 
> [1] http://tex.stackexchange.com/q/126333/14066
> [2] http://repo.or.cz/w/context.git/commitdiff/6b2f7c5fd7a3e465f4e2662b1e5bd2c9d5cce8f8
> ___________________________________________________________________________________
> If your question is of interest to others as well, please add an entry to the Wiki!
> 
> maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
> webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
> archive  : http://foundry.supelec.fr/projects/contextrev/
> wiki     : http://contextgarden.net
> ___________________________________________________________________________________

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: copy&paste from pdf bug (smallcaps, text figures)

[Marco Patzer]

[-- Attachment #1.1: Type: text/plain, Size: 445 bytes --]

On 2013–08–01 Philipp Gesang wrote:

> copy&paste from PDF is broken:
> 
>   \setupbodyfont [iwona]
>   \starttext
>     \feature[+][just-os,smallcaps] 0123456789 abcdefghijklmnopqrstuvwxyz
>   \stoptext
> 
> Result:   
> Expected: 0123456789abcdefghijklmnopqrstuvwxyz

Works here with 2013.08.01 01:31 (linux)

Marco

[-- Attachment #1.2: Digital signature --]
[-- Type: application/pgp-signature, Size: 490 bytes --]

[-- Attachment #2: Type: text/plain, Size: 485 bytes --]

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: copy&paste from pdf bug (smallcaps, text figures)

[Philipp Gesang]

[-- Attachment #1.1: Type: text/plain, Size: 623 bytes --]

···<date: 2013-08-01, Thursday>···<from: Otared Kavian>···

> I tested your example: no problem here on Mac OS X 10.8.4, with
> either TeXShop, Adobe Redaer or Preview, with the latest beta
> (ConTeXt  ver: 2013.08.01 01:31 MKIV beta  fmt: 2013.8.1  int:
> english/english).

x64 linux here, but it’s the same with the windows version in
wine32. I get the bad output with okular (poppler), acroread, and
mupdf, but strangely not with zathura (mupdf-based). It is
present both in texlive and the most recent beta. Going back
exactly one release to "2013.05.22 19:28" fixes it consistently.

Philipp

[-- Attachment #1.2: Type: application/pgp-signature, Size: 490 bytes --]

[-- Attachment #2: Type: text/plain, Size: 485 bytes --]

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: copy&paste from pdf bug (smallcaps, text figures)

[Marco Patzer]

[-- Attachment #1.1: Type: text/plain, Size: 684 bytes --]

On 2013–08–01 Philipp Gesang wrote:

> ···<date: 2013-08-01, Thursday>···<from: Otared Kavian>···
> 
> > I tested your example: no problem here on Mac OS X 10.8.4, with
> > either TeXShop, Adobe Redaer or Preview, with the latest beta
> > (ConTeXt  ver: 2013.08.01 01:31 MKIV beta  fmt: 2013.8.1  int:
> > english/english).
> 
> x64 linux here, but it’s the same with the windows version in
> wine32. I get the bad output with okular (poppler), acroread, and
> mupdf, but strangely not with zathura (mupdf-based).

Just to add to the list:

x64 linux here, and it works with the following poppler based
viewers (zathura-poppler, xpdf, evince)

Marco

[-- Attachment #1.2: Digital signature --]
[-- Type: application/pgp-signature, Size: 490 bytes --]

[-- Attachment #2: Type: text/plain, Size: 485 bytes --]

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: copy&paste from pdf bug (smallcaps, text figures)

[Jannik Voges]

[-- Attachment #1.1: Type: text/plain, Size: 268 bytes --]

Works with OS X Preview (10.8.4).



Am 01.08.2013 um 19:33 schrieb Philipp Gesang <Philipp.Gesang@alumni.uni-heidelberg.de>:


>  \setupbodyfont [iwona]
>  \starttext
>    \feature[+][just-os,smallcaps] 0123456789 abcdefghijklmnopqrstuvwxyz
>  \stoptext


[-- Attachment #1.2: Type: text/html, Size: 3472 bytes --]

[-- Attachment #2: Type: text/plain, Size: 485 bytes --]

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: copy&paste from pdf bug (smallcaps, text figures)

[Philipp Gesang]

[-- Attachment #1.1: Type: text/plain, Size: 1786 bytes --]

···<date: 2013-08-02, Friday>···<from: Marco Patzer>···

> On 2013–08–01 Philipp Gesang wrote:
> 
> > ···<date: 2013-08-01, Thursday>···<from: Otared Kavian>···
> > 
> > > I tested your example: no problem here on Mac OS X 10.8.4, with
> > > either TeXShop, Adobe Redaer or Preview, with the latest beta
> > > (ConTeXt  ver: 2013.08.01 01:31 MKIV beta  fmt: 2013.8.1  int:
> > > english/english).
> > 
> > x64 linux here, but it’s the same with the windows version in
> > wine32. I get the bad output with okular (poppler), acroread, and
> > mupdf, but strangely not with zathura (mupdf-based).
> 
> Just to add to the list:
> 
> x64 linux here, and it works with the following poppler based
> viewers (zathura-poppler, xpdf, evince)

For those who want to test the git version, the commits are:

    last good: a61813ccdd4b7bcc81932317e1360fda6c79962d
    first bad: 6b2f7c5fd7a3e465f4e2662b1e5bd2c9d5cce8f8

Don’t forget to delete the cache.

I suspect I found the troublesome changes. The problem vanishes
if I revert this modification to font-map.lua:

    -local separator   = S("_.")
    -local other       = C((1 - separator)^1)
    -local ligsplitter = Ct(other * (separator * other)^0)
    +local ligseparator = P("_")
    +local varseparator = P(".")
    +local namesplitter = Ct(C((1 - ligseparator - varseparator)^1) * (ligseparator * C((1 - ligseparator - varseparator)^1))^0)

and then further down:

    -                local split = lpegmatch(ligsplitter,name)
    <...>
    +                local split = lpegmatch(namesplitter,name)

For convenience I repeat the link to the changeset:

    http://repo.or.cz/w/context.git/commitdiff/6b2f7c5fd7a3e465f4e2662b1e5bd2c9d5cce8f8

Best,
Philipp


[-- Attachment #1.2: Type: application/pgp-signature, Size: 490 bytes --]

[-- Attachment #2: Type: text/plain, Size: 485 bytes --]

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: copy&paste from pdf bug (smallcaps, text figures)

[Hans Hagen]

On 8/2/2013 12:12 AM, Philipp Gesang wrote:
> ···<date: 2013-08-02, Friday>···<from: Marco Patzer>···
>
>> On 2013–08–01 Philipp Gesang wrote:
>>
>>> ···<date: 2013-08-01, Thursday>···<from: Otared Kavian>···
>>>
>>>> I tested your example: no problem here on Mac OS X 10.8.4, with
>>>> either TeXShop, Adobe Redaer or Preview, with the latest beta
>>>> (ConTeXt  ver: 2013.08.01 01:31 MKIV beta  fmt: 2013.8.1  int:
>>>> english/english).
>>>
>>> x64 linux here, but it’s the same with the windows version in
>>> wine32. I get the bad output with okular (poppler), acroread, and
>>> mupdf, but strangely not with zathura (mupdf-based).
>>
>> Just to add to the list:
>>
>> x64 linux here, and it works with the following poppler based
>> viewers (zathura-poppler, xpdf, evince)

i'm a bit puzzled

> For those who want to test the git version, the commits are:
>
>      last good: a61813ccdd4b7bcc81932317e1360fda6c79962d
>      first bad: 6b2f7c5fd7a3e465f4e2662b1e5bd2c9d5cce8f8
>
> Don’t forget to delete the cache.
>
> I suspect I found the troublesome changes. The problem vanishes
> if I revert this modification to font-map.lua:
>
>      -local separator   = S("_.")
>      -local other       = C((1 - separator)^1)
>      -local ligsplitter = Ct(other * (separator * other)^0)
>      +local ligseparator = P("_")
>      +local varseparator = P(".")
>      +local namesplitter = Ct(C((1 - ligseparator - varseparator)^1) * (ligseparator * C((1 - ligseparator - varseparator)^1))^0)
>
> and then further down:
>
>      -                local split = lpegmatch(ligsplitter,name)
>      <...>
>      +                local split = lpegmatch(namesplitter,name)
>
> For convenience I repeat the link to the changeset:

what do you revert from ... the + things are already in the file

>      http://repo.or.cz/w/context.git/commitdiff/6b2f7c5fd7a3e465f4e2662b1e5bd2c9d5cce8f8

btw, this bit of code is evolving (was recently adapt to some border 
case fonts that use their own rules)

anyhow, on my win8 system the beta works with sumatra, okular and 
acrobat (indeed one might need to wipe the cache, but i can increment 
the version number)

Hans


-----------------------------------------------------------------
                                           Hans Hagen | PRAGMA ADE
               Ridderstraat 27 | 8061 GH Hasselt | The Netherlands
     tel: 038 477 53 69 | voip: 087 875 68 74 | www.pragma-ade.com
                                              | www.pragma-pod.nl
-----------------------------------------------------------------
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: copy&paste from pdf bug (smallcaps, text figures)

[Philipp Gesang]

[-- Attachment #1.1: Type: text/plain, Size: 3250 bytes --]

···<date: 2013-08-02, Friday>···<from: Hans Hagen>···

> On 8/2/2013 12:12 AM, Philipp Gesang wrote:
> >···<date: 2013-08-02, Friday>···<from: Marco Patzer>···
> >
> >>On 2013–08–01 Philipp Gesang wrote:
> >>
> >>>···<date: 2013-08-01, Thursday>···<from: Otared Kavian>···
> >>>
> >>>>I tested your example: no problem here on Mac OS X 10.8.4, with
> >>>>either TeXShop, Adobe Redaer or Preview, with the latest beta
> >>>>(ConTeXt  ver: 2013.08.01 01:31 MKIV beta  fmt: 2013.8.1  int:
> >>>>english/english).
> >>>
> >>>x64 linux here, but it’s the same with the windows version in
> >>>wine32. I get the bad output with okular (poppler), acroread, and
> >>>mupdf, but strangely not with zathura (mupdf-based).
> >>
> >>Just to add to the list:
> >>
> >>x64 linux here, and it works with the following poppler based
> >>viewers (zathura-poppler, xpdf, evince)

I’m on a different machine now: the problem affects linux x86 and
pdftotext as well. Also, in xpdf I get smallcaps copied as
uppercase instead of lowercase.

> i'm a bit puzzled
> 
> >For those who want to test the git version, the commits are:
> >
> >     last good: a61813ccdd4b7bcc81932317e1360fda6c79962d
> >     first bad: 6b2f7c5fd7a3e465f4e2662b1e5bd2c9d5cce8f8
> >
> >Don’t forget to delete the cache.
> >
> >I suspect I found the troublesome changes. The problem vanishes
> >if I revert this modification to font-map.lua:
> >
> >     -local separator   = S("_.")
> >     -local other       = C((1 - separator)^1)
> >     -local ligsplitter = Ct(other * (separator * other)^0)
> >     +local ligseparator = P("_")
> >     +local varseparator = P(".")
> >     +local namesplitter = Ct(C((1 - ligseparator - varseparator)^1) * (ligseparator * C((1 - ligseparator - varseparator)^1))^0)
> >
> >and then further down:
> >
> >     -                local split = lpegmatch(ligsplitter,name)
> >     <...>
> >     +                local split = lpegmatch(namesplitter,name)
> >
> >For convenience I repeat the link to the changeset:
> 
> what do you revert from ... the + things are already in the file

I’m quoting from the changeset, so the “-” lines indicate the
good version.

> >     http://repo.or.cz/w/context.git/commitdiff/6b2f7c5fd7a3e465f4e2662b1e5bd2c9d5cce8f8
> 
> btw, this bit of code is evolving (was recently adapt to some border
> case fonts that use their own rules)
> 
> anyhow, on my win8 system the beta works with sumatra, okular and
> acrobat (indeed one might need to wipe the cache, but i can
> increment the version number)

Weird. Here’s a PDF of the code I posted compiled with version
“2013.08.01 01:31” and how pdftotext renders it:

    https://phi-gamma.net/pdf/copypasta.pdf
    https://phi-gamma.net/files/copypasta.txt
  
I definitely get   from this
one. The characters are mapped from the private use area:


    <...>
    30 beginbfchar
    <0409> <F761>
    <0416> <F762>
    <0418> <F763>
    <0423> <F764>
    <042A> <F765>
    <0435> <F738>
    <...>

Can someone reproduce it at all?

Philipp


[-- Attachment #1.2: Type: application/pgp-signature, Size: 490 bytes --]

[-- Attachment #2: Type: text/plain, Size: 485 bytes --]

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: copy&paste from pdf bug (smallcaps, text figures)

[Marco Patzer]

[-- Attachment #1.1: Type: text/plain, Size: 639 bytes --]

On 2013–08–02 Philipp Gesang wrote:

>     https://phi-gamma.net/pdf/copypasta.pdf
>     https://phi-gamma.net/files/copypasta.txt
>   
> I definitely get   from this
> one.

Indeed. When I copy from your file I get those private Unicode
slots. When I run the example code from your OP, I get the correct
characters. I don't know what's the difference between those two
files. The LuaTeX version and ConTeXt version is the same.

Creator:        ConTeXt - 2013.08.01 01:31
Producer:       LuaTeX-0.76.0

Marco

[-- Attachment #1.2: Digital signature --]
[-- Type: application/pgp-signature, Size: 490 bytes --]

[-- Attachment #2: Type: text/plain, Size: 485 bytes --]

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: copy&paste from pdf bug (smallcaps, text figures)

[Philipp Gesang]

[-- Attachment #1.1: Type: text/plain, Size: 2151 bytes --]

···<date: 2013-08-02, Friday>···<from: Marco Patzer>···

> On 2013–08–02 Philipp Gesang wrote:
> 
> >     https://phi-gamma.net/pdf/copypasta.pdf
> >     https://phi-gamma.net/files/copypasta.txt
> >   
> > I definitely get   from this
> > one.
> 
> Indeed. When I copy from your file I get those private Unicode
> slots. When I run the example code from your OP, I get the correct
> characters. I don't know what's the difference between those two
> files.

The PDF is what Context produces here with that code.

>        The LuaTeX version and ConTeXt version is the same.
> 
> Creator:        ConTeXt - 2013.08.01 01:31
> Producer:       LuaTeX-0.76.0

There appears to be a difference between node and base mode
depending on how the font is defined:

  \pdfcompresslevel0
  
  \setupbodyfont [iwona]
  
  \definefontfeature [proto]    [onum=yes,smcp=yes,script=dflt,lang=dflt]
  \definefontfeature [withbase] [proto] [mode=base]
  \definefontfeature [withnode] [proto] [mode=node]
  
  \definefont [iwonab] [file:Iwona-Regular.otf*withbase]
  \definefont [iwonan] [file:Iwona-Regular.otf*withnode]
  
  \starttext
    \feature[<]
    base mode\par
    {\feature[!][withbase]0123456789abcdefghijklmnopqrstuvwxyz\par}
    {\iwonab 0123456789abcdefghijklmnopqrstuvwxyz}
  
    node mode\par
    {\feature[!][withnode]0123456789abcdefghijklmnopqrstuvwxyz\par}
    {\iwonan 0123456789abcdefghijklmnopqrstuvwxyz}
  \stoptext \endinput

This gets me (through pdftotext):

  base mode
  
  0123456789abcdefghijklmnopqrstuvwxyz
  node mode
  
  

So base mode with \definefont works while node mode or the font
from the typescript doesn’t.

Philipp

[-- Attachment #1.2: Type: application/pgp-signature, Size: 490 bytes --]

[-- Attachment #2: Type: text/plain, Size: 485 bytes --]

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: copy&paste from pdf bug (smallcaps, text figures)

[Hans Hagen]

[-- Attachment #1: Type: text/plain, Size: 3961 bytes --]

On 8/2/2013 2:28 PM, Philipp Gesang wrote:
> ···<date: 2013-08-02, Friday>···<from: Marco Patzer>···
>
>> On 2013–08–02 Philipp Gesang wrote:
>>
>>>      https://phi-gamma.net/pdf/copypasta.pdf
>>>      https://phi-gamma.net/files/copypasta.txt
>>>
>>> I definitely get   from this
>>> one.
>>
>> Indeed. When I copy from your file I get those private Unicode
>> slots. When I run the example code from your OP, I get the correct
>> characters. I don't know what's the difference between those two
>> files.
>
> The PDF is what Context produces here with that code.
>
>>         The LuaTeX version and ConTeXt version is the same.
>>
>> Creator:        ConTeXt - 2013.08.01 01:31
>> Producer:       LuaTeX-0.76.0
>
> There appears to be a difference between node and base mode
> depending on how the font is defined:
>
>    \pdfcompresslevel0
>
>    \setupbodyfont [iwona]
>
>    \definefontfeature [proto]    [onum=yes,smcp=yes,script=dflt,lang=dflt]
>    \definefontfeature [withbase] [proto] [mode=base]
>    \definefontfeature [withnode] [proto] [mode=node]
>
>    \definefont [iwonab] [file:Iwona-Regular.otf*withbase]
>    \definefont [iwonan] [file:Iwona-Regular.otf*withnode]
>
>    \starttext
>      \feature[<]
>      base mode\par
>      {\feature[!][withbase]0123456789abcdefghijklmnopqrstuvwxyz\par}
>      {\iwonab 0123456789abcdefghijklmnopqrstuvwxyz}
>
>      node mode\par
>      {\feature[!][withnode]0123456789abcdefghijklmnopqrstuvwxyz\par}
>      {\iwonan 0123456789abcdefghijklmnopqrstuvwxyz}
>    \stoptext \endinput
>
> This gets me (through pdftotext):
>
>    base mode
>    
>    0123456789abcdefghijklmnopqrstuvwxyz
>    node mode
>    
>    
>
> So base mode with \definefont works while node mode or the font
> from the typescript doesn’t.

For such tests you need to compare all cases:

nopdfcompression

\setupbodyfont [iwona]

\definefontfeature [withbaseone] [proto] [mode=base]
\definefontfeature [withnodeone] [proto] [mode=node]
\definefontfeature [withbasetwo] [proto] 
[mode=base,onum=yes,smcp=yes,script=dflt,lang=dflt]
\definefontfeature [withnodetwo] [proto] 
[mode=node,onum=yes,smcp=yes,script=dflt,lang=dflt]

\definefont [iwonabone] [file:Iwona-Regular.otf*withbaseone]
\definefont [iwonanone] [file:Iwona-Regular.otf*withnodeone]

\definefont [iwonabtwo] [file:Iwona-Regular.otf*withbasetwo]
\definefont [iwonantwo] [file:Iwona-Regular.otf*withnodetwo]

\starttext

test 1, both modes:

{\iwonanone 0123456789abcdefghijklmnopqrstuvwxyz}\par
{\iwonabone 0123456789abcdefghijklmnopqrstuvwxyz}\par
{\iwonantwo 0123456789abcdefghijklmnopqrstuvwxyz}\par
{\iwonabtwo 0123456789abcdefghijklmnopqrstuvwxyz}\par

% test 2, base only:

% {\iwonabone 0123456789abcdefghijklmnopqrstuvwxyz}\par
% {\iwonabtwo 0123456789abcdefghijklmnopqrstuvwxyz}\par

% test 3, node only:

% {\iwonanone 0123456789abcdefghijklmnopqrstuvwxyz}\par
% {\iwonantwo 0123456789abcdefghijklmnopqrstuvwxyz}\par

\stoptext

i.e. get rid of potential interferences

attached is what i get


-- 

-----------------------------------------------------------------
                                           Hans Hagen | PRAGMA ADE
               Ridderstraat 27 | 8061 GH Hasselt | The Netherlands
     tel: 038 477 53 69 | voip: 087 875 68 74 | www.pragma-ade.com
                                              | www.pragma-pod.nl
-----------------------------------------------------------------

[-- Attachment #2: oeps.pdf --]
[-- Type: application/pdf, Size: 27862 bytes --]

[-- Attachment #3: Type: text/plain, Size: 485 bytes --]

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: copy&paste from pdf bug (smallcaps, text figures)

[Philipp Gesang]

[-- Attachment #1.1: Type: text/plain, Size: 4219 bytes --]

···<date: 2013-08-02, Friday>···<from: Hans Hagen>···

> On 8/2/2013 2:28 PM, Philipp Gesang wrote:
> >···<date: 2013-08-02, Friday>···<from: Marco Patzer>···
> >
> >>On 2013–08–02 Philipp Gesang wrote:
> >>
> >>>     https://phi-gamma.net/pdf/copypasta.pdf
> >>>     https://phi-gamma.net/files/copypasta.txt
> >>>
> >>>I definitely get   from this
> >>>one.
> >>
> >>Indeed. When I copy from your file I get those private Unicode
> >>slots. When I run the example code from your OP, I get the correct
> >>characters. I don't know what's the difference between those two
> >>files.
> >
> >The PDF is what Context produces here with that code.
> >
> >>        The LuaTeX version and ConTeXt version is the same.
> >>
> >>Creator:        ConTeXt - 2013.08.01 01:31
> >>Producer:       LuaTeX-0.76.0
> >
> >There appears to be a difference between node and base mode
> >depending on how the font is defined:
> >
> >   \pdfcompresslevel0
> >
> >   \setupbodyfont [iwona]
> >
> >   \definefontfeature [proto]    [onum=yes,smcp=yes,script=dflt,lang=dflt]
> >   \definefontfeature [withbase] [proto] [mode=base]
> >   \definefontfeature [withnode] [proto] [mode=node]
> >
> >   \definefont [iwonab] [file:Iwona-Regular.otf*withbase]
> >   \definefont [iwonan] [file:Iwona-Regular.otf*withnode]
> >
> >   \starttext
> >     \feature[<]
> >     base mode\par
> >     {\feature[!][withbase]0123456789abcdefghijklmnopqrstuvwxyz\par}
> >     {\iwonab 0123456789abcdefghijklmnopqrstuvwxyz}
> >
> >     node mode\par
> >     {\feature[!][withnode]0123456789abcdefghijklmnopqrstuvwxyz\par}
> >     {\iwonan 0123456789abcdefghijklmnopqrstuvwxyz}
> >   \stoptext \endinput
> >
> >This gets me (through pdftotext):
> >
> >   base mode
> >   
> >   0123456789abcdefghijklmnopqrstuvwxyz
> >   node mode
> >   
> >   
> >
> >So base mode with \definefont works while node mode or the font
> >from the typescript doesn’t.
> 
> For such tests you need to compare all cases:
> 
> nopdfcompression
> 
> \setupbodyfont [iwona]
> 
> \definefontfeature [withbaseone] [proto] [mode=base]
> \definefontfeature [withnodeone] [proto] [mode=node]
> \definefontfeature [withbasetwo] [proto]
> [mode=base,onum=yes,smcp=yes,script=dflt,lang=dflt]
> \definefontfeature [withnodetwo] [proto]
> [mode=node,onum=yes,smcp=yes,script=dflt,lang=dflt]
> 
> \definefont [iwonabone] [file:Iwona-Regular.otf*withbaseone]
> \definefont [iwonanone] [file:Iwona-Regular.otf*withnodeone]
> 
> \definefont [iwonabtwo] [file:Iwona-Regular.otf*withbasetwo]
> \definefont [iwonantwo] [file:Iwona-Regular.otf*withnodetwo]
> 
> \starttext
> 
> test 1, both modes:
> 
> {\iwonanone 0123456789abcdefghijklmnopqrstuvwxyz}\par
> {\iwonabone 0123456789abcdefghijklmnopqrstuvwxyz}\par
> {\iwonantwo 0123456789abcdefghijklmnopqrstuvwxyz}\par
> {\iwonabtwo 0123456789abcdefghijklmnopqrstuvwxyz}\par
> 
> % test 2, base only:
> 
> % {\iwonabone 0123456789abcdefghijklmnopqrstuvwxyz}\par
> % {\iwonabtwo 0123456789abcdefghijklmnopqrstuvwxyz}\par
> 
> % test 3, node only:
> 
> % {\iwonanone 0123456789abcdefghijklmnopqrstuvwxyz}\par
> % {\iwonantwo 0123456789abcdefghijklmnopqrstuvwxyz}\par
> 
> \stoptext
> 
> i.e. get rid of potential interferences
> 
> attached is what i get

Your PDF is flawless, but on my machine node mode produces the
wrong output. (Also I run the luatex beta-0.76.0-2013040516 that
comes with the minimals.) PDF:

  https://phi-gamma.net/pdf/copypasta-hh.pdf

Here’s a link to the diff between your PDF and my output:

  http://pastie.org/private/zwnesrug7wpy4ket6ppl1g

This bug is quite elusive; can you think of anything that this
behavior might be a side-effect of?

Philipp


[-- Attachment #1.2: Type: application/pgp-signature, Size: 490 bytes --]

[-- Attachment #2: Type: text/plain, Size: 485 bytes --]

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: copy&paste from pdf bug (smallcaps, text figures)

[Arthur Reutenauer]

> Here’s a link to the diff between your PDF and my output:
> 
>   http://pastie.org/private/zwnesrug7wpy4ket6ppl1g

  I don't know where in ConTeXt's code the difference comes from, but in
the PDF it is quite clear: Hans' file has a number of CMap entries that
map glyph IDs to lowercase latin letters, which yours doesn't.  See
lines 153, 154, and similar ones.

	Arthur
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: copy&paste from pdf bug (smallcaps, text figures)

[Philipp Gesang]

[-- Attachment #1.1: Type: text/plain, Size: 4116 bytes --]

···<date: 2013-08-02, Friday>···<from: Hans Hagen>···

> On 8/2/2013 2:28 PM, Philipp Gesang wrote:
> >···<date: 2013-08-02, Friday>···<from: Marco Patzer>···
> >
> >>On 2013–08–02 Philipp Gesang wrote:
> >>
> >>>     https://phi-gamma.net/pdf/copypasta.pdf
> >>>     https://phi-gamma.net/files/copypasta.txt
> >>>
> >>>I definitely get   from this
> >>>one.
> >>
> >>Indeed. When I copy from your file I get those private Unicode
> >>slots. When I run the example code from your OP, I get the correct
> >>characters. I don't know what's the difference between those two
> >>files.
> >
> >The PDF is what Context produces here with that code.
> >
> >>        The LuaTeX version and ConTeXt version is the same.
> >>
> >>Creator:        ConTeXt - 2013.08.01 01:31
> >>Producer:       LuaTeX-0.76.0
> >
> >There appears to be a difference between node and base mode
> >depending on how the font is defined:
> >
> >   \pdfcompresslevel0
> >
> >   \setupbodyfont [iwona]
> >
> >   \definefontfeature [proto]    [onum=yes,smcp=yes,script=dflt,lang=dflt]
> >   \definefontfeature [withbase] [proto] [mode=base]
> >   \definefontfeature [withnode] [proto] [mode=node]
> >
> >   \definefont [iwonab] [file:Iwona-Regular.otf*withbase]
> >   \definefont [iwonan] [file:Iwona-Regular.otf*withnode]
> >
> >   \starttext
> >     \feature[<]
> >     base mode\par
> >     {\feature[!][withbase]0123456789abcdefghijklmnopqrstuvwxyz\par}
> >     {\iwonab 0123456789abcdefghijklmnopqrstuvwxyz}
> >
> >     node mode\par
> >     {\feature[!][withnode]0123456789abcdefghijklmnopqrstuvwxyz\par}
> >     {\iwonan 0123456789abcdefghijklmnopqrstuvwxyz}
> >   \stoptext \endinput
> >
> >This gets me (through pdftotext):
> >
> >   base mode
> >   
> >   0123456789abcdefghijklmnopqrstuvwxyz
> >   node mode
> >   
> >   
> >
> >So base mode with \definefont works while node mode or the font
> >from the typescript doesn’t.
> 
> For such tests you need to compare all cases:
> 
> nopdfcompression
> 
> \setupbodyfont [iwona]
> 
> \definefontfeature [withbaseone] [proto] [mode=base]
> \definefontfeature [withnodeone] [proto] [mode=node]
> \definefontfeature [withbasetwo] [proto]
> [mode=base,onum=yes,smcp=yes,script=dflt,lang=dflt]
> \definefontfeature [withnodetwo] [proto]
> [mode=node,onum=yes,smcp=yes,script=dflt,lang=dflt]
> 
> \definefont [iwonabone] [file:Iwona-Regular.otf*withbaseone]
> \definefont [iwonanone] [file:Iwona-Regular.otf*withnodeone]
> 
> \definefont [iwonabtwo] [file:Iwona-Regular.otf*withbasetwo]
> \definefont [iwonantwo] [file:Iwona-Regular.otf*withnodetwo]
> 
> \starttext
> 
> test 1, both modes:
> 
> {\iwonanone 0123456789abcdefghijklmnopqrstuvwxyz}\par
> {\iwonabone 0123456789abcdefghijklmnopqrstuvwxyz}\par
> {\iwonantwo 0123456789abcdefghijklmnopqrstuvwxyz}\par
> {\iwonabtwo 0123456789abcdefghijklmnopqrstuvwxyz}\par
> 
> % test 2, base only:
> 
> % {\iwonabone 0123456789abcdefghijklmnopqrstuvwxyz}\par
> % {\iwonabtwo 0123456789abcdefghijklmnopqrstuvwxyz}\par
> 
> % test 3, node only:
> 
> % {\iwonanone 0123456789abcdefghijklmnopqrstuvwxyz}\par
> % {\iwonantwo 0123456789abcdefghijklmnopqrstuvwxyz}\par
> 
> \stoptext
> 
> i.e. get rid of potential interferences
> 
> attached is what i get

Hi all,

I removed the entire tree (Hans suggested this in a private
message) and started over with a clean install of the minimals.
Now it works as expected, both with Context and Luatex-Fonts.
Might have been caused by a leftover file that didn’t update.

Thanks for your assistance and sorry for the noise!

Best,
Philipp


[-- Attachment #1.2: Type: application/pgp-signature, Size: 490 bytes --]

[-- Attachment #2: Type: text/plain, Size: 485 bytes --]

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________