actualtext and encoding

actualtext and encoding

[Wolfgang Schuster]

Hi Hans,

you showed a while ago how the actualtext function of pdf works
and i have a module where i would use it but letters outside of
ascii appear wrong when i copy the text

\starttext
text \pdfliteral{/Span <</ActualText (Müller) >> BDC}Meier\pdfliteral{EMC} text
\stoptext

becomes

text Müller text

when i copy the text from the pdf (Adobe Reader) and insert it in my editor.

Wolfgang

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: actualtext and encoding

[Taco Hoekwater]

Wolfgang Schuster wrote:
> Hi Hans,
> 
> you showed a while ago how the actualtext function of pdf works
> and i have a module where i would use it but letters outside of
> ascii appear wrong when i copy the text
> 
> \starttext
> text \pdfliteral{/Span <</ActualText (Müller) >> BDC}Meier\pdfliteral{EMC} text
> \stoptext

Is /ActualText supposed to be in PDFDoc Encoding?

Best wishes,
Taco
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: actualtext and encoding

[Wolfgang Schuster]

Am 07.12.2009 um 08:52 schrieb Taco Hoekwater:

> Is /ActualText supposed to be in PDFDoc Encoding?

No, you could also use Unicode Encoding.

Wolfgang

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: actualtext and encoding

[Hans Hagen]

Taco Hoekwater wrote:
> 
> Wolfgang Schuster wrote:
>> Hi Hans,
>>
>> you showed a while ago how the actualtext function of pdf works
>> and i have a module where i would use it but letters outside of
>> ascii appear wrong when i copy the text
>>
>> \starttext
>> text \pdfliteral{/Span <</ActualText (Müller) >> BDC}Meier\pdfliteral{EMC} text
>> \stoptext
> 
> Is /ActualText supposed to be in PDFDoc Encoding?

nopdfcompression

\def\pdfactualtext#1#2%
   {\pdfliteral direct{/Span <</ActualText 
\ctxlua{tex.write(lpdf.tosixteen("#2"))} >> BDC}#1\pdfliteral direct{EMC}}

\starttext
     text \pdfactualtext{Meier}{Müller} text
\stoptext


-----------------------------------------------------------------
                                           Hans Hagen | PRAGMA ADE
               Ridderstraat 27 | 8061 GH Hasselt | The Netherlands
      tel: 038 477 53 69 | fax: 038 477 53 74 | www.pragma-ade.com
                                              | www.pragma-pod.nl
-----------------------------------------------------------------
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: actualtext and encoding

[Wolfgang Schuster]

Am 07.12.2009 um 09:46 schrieb Hans Hagen:

> \def\pdfactualtext#1#2%
>  {\pdfliteral direct{/Span <</ActualText \ctxlua{tex.write(lpdf.tosixteen("#2"))} >> BDC}#1\pdfliteral direct{EMC}}
> 
> \starttext
>    text \pdfactualtext{Meier}{Müller} text
> \stoptext

Perfect, will this end in the core?

Regards,
Wolfgang

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: actualtext and encoding

[Hans Hagen]

Wolfgang Schuster wrote:
> Am 07.12.2009 um 09:46 schrieb Hans Hagen:
> 
>> \def\pdfactualtext#1#2%
>>  {\pdfliteral direct{/Span <</ActualText \ctxlua{tex.write(lpdf.tosixteen("#2"))} >> BDC}#1\pdfliteral direct{EMC}}
>>
>> \starttext
>>    text \pdfactualtext{Meier}{Müller} text
>> \stoptext
> 
> Perfect, will this end in the core?

hm, doesn't that kind of functionality demands a bit more 'thinking'? 
what exactly is needed? how does it relate to linebreaks? other content? 
etc .. actually, such a mechanism should be implemented a bit 
differently (maybe attributes and delayed processing) or maybe 
dictionary driven ..

i have no problem with adding this two line hack as it has a \pdf prefix 
anyway so it sits in the category wolfgangs-only -)

Hans

-----------------------------------------------------------------
                                           Hans Hagen | PRAGMA ADE
               Ridderstraat 27 | 8061 GH Hasselt | The Netherlands
      tel: 038 477 53 69 | fax: 038 477 53 74 | www.pragma-ade.com
                                              | www.pragma-pod.nl
-----------------------------------------------------------------
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: actualtext and encoding

[Wolfgang Schuster]

Am 07.12.2009 um 10:11 schrieb Hans Hagen:

> hm, doesn't that kind of functionality demands a bit more 'thinking'? what exactly is needed? how does it relate to linebreaks? other content? etc .. actually, such a mechanism should be implemented a bit differently (maybe attributes and delayed processing) or maybe dictionary driven ..

there is no linebreak in the text because it's a boxed content, a simple version of my macro is

\def\pdfactualtext#1#2%
 {\pdfliteral direct{/Span <</ActualText \ctxlua{tex.write(lpdf.tosixteen("#2"))} >> BDC}#1\pdfliteral direct{EMC}}

\def\ruby#1#2%
  {\dontleavehmode\bgroup
   \setbox\scratchboxone\hbox{#1}%
   \setbox\scratchboxtwo\hbox{#2}%
   \scratchdimen\wd\scratchboxone
   \setbox\scratchbox\vbox
     {\hbox to \scratchdimen{\hss\box\scratchboxtwo\hss}
      \hbox to \scratchdimen{\hss\box\scratchboxone\hss}}%
   \pdfactualtext{\box\scratchbox}{#1 (#2)}%
   \egroup}

\starttext

text \ruby{base text}{ruby text} text

\stoptext

Wolfgang

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: actualtext and encoding

[Hans Hagen]

Wolfgang Schuster wrote:
> Am 07.12.2009 um 10:11 schrieb Hans Hagen:
> 
>> hm, doesn't that kind of functionality demands a bit more 'thinking'? what exactly is needed? how does it relate to linebreaks? other content? etc .. actually, such a mechanism should be implemented a bit differently (maybe attributes and delayed processing) or maybe dictionary driven ..
> 
> there is no linebreak in the text because it's a boxed content, a simple version of my macro is
> 
> \def\pdfactualtext#1#2%
>  {\pdfliteral direct{/Span <</ActualText \ctxlua{tex.write(lpdf.tosixteen("#2"))} >> BDC}#1\pdfliteral direct{EMC}}
> 
> \def\ruby#1#2%
>   {\dontleavehmode\bgroup
>    \setbox\scratchboxone\hbox{#1}%
>    \setbox\scratchboxtwo\hbox{#2}%
>    \scratchdimen\wd\scratchboxone
>    \setbox\scratchbox\vbox
>      {\hbox to \scratchdimen{\hss\box\scratchboxtwo\hss}
>       \hbox to \scratchdimen{\hss\box\scratchboxone\hss}}%
>    \pdfactualtext{\box\scratchbox}{#1 (#2)}%
>    \egroup}
> 
> \starttext
> 
> text \ruby{base text}{ruby text} text
> 
> \stoptext

detail ...

\def\ruby#1#2%
   {\dontleavehmode\bgroup
    \setbox\scratchboxone\hbox{#1}%
    \setbox\scratchboxtwo\hbox{#2}%
 
\scratchdimen\wd\ifdim\wd\scratchboxone>\wd\scratchboxtwo\scratchboxone\else\scratchboxtwo\fi
    \setbox\scratchbox\vbox
      {\hbox to \scratchdimen{\hss\box\scratchboxtwo\hss}
       \hbox to \scratchdimen{\hss\box\scratchboxone\hss}}%
    \pdfactualtext{\box\scratchbox}{#1 (#2)}%
    \egroup}

\starttext
     text \ruby{lua text}{ruby or perl text which is more blabla} text
\stoptext



-----------------------------------------------------------------
                                           Hans Hagen | PRAGMA ADE
               Ridderstraat 27 | 8061 GH Hasselt | The Netherlands
      tel: 038 477 53 69 | fax: 038 477 53 74 | www.pragma-ade.com
                                              | www.pragma-pod.nl
-----------------------------------------------------------------
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: actualtext and encoding

[Wolfgang Schuster]

Am 07.12.2009 um 11:21 schrieb Hans Hagen:

> detail ...
> 
> \def\ruby#1#2%
>  {\dontleavehmode\bgroup
>   \setbox\scratchboxone\hbox{#1}%
>   \setbox\scratchboxtwo\hbox{#2}%
> \scratchdimen\wd\ifdim\wd\scratchboxone>\wd\scratchboxtwo\scratchboxone\else\scratchboxtwo\fi
>   \setbox\scratchbox\vbox
>     {\hbox to \scratchdimen{\hss\box\scratchboxtwo\hss}
>      \hbox to \scratchdimen{\hss\box\scratchboxone\hss}}%
>   \pdfactualtext{\box\scratchbox}{#1 (#2)}%
>   \egroup}
> 
> \starttext
>    text \ruby{lua text}{ruby or perl text which is more blabla} text
> \stoptext

this was just a simplified example, the real implementation is more complex

by default ruby text overlaps the surrounding text (like in my example)
and what you suggested can be activated but it's not so nice because
you get unwanted whitespace in the text

Wolfgang

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________