Question on \setupencoding[default=ec]

Question on \setupencoding[default=ec]

[Steffen Wolfrum]

Hallo,

I have re-read the mailings in the archive concerning proper
hyphenation and I saw
that it is a known problem to have hyphenation in words containing
cedilla, accent or umlaut.

As it is solved in LaTeX with the [T1]{fontenc} package some people
wrote that in ConTeXt the equivalent should be:

\setupencoding[default=ec]

But that's not true (at least for german Umlaute).


A ConTeXt  example:

\language[de]
\mainlanguage[de]
\enableregime[mac]
\setupencoding[default=ec]

\starttext

\showhyphens{alter}

\showhyphens{früher}

\stoptext

doesn't recognize früher (frü-her):

Underfull \hbox (badness 10000) in paragraph at lines 8--8
[] /cmr10/al-ter

Underfull \hbox (badness 10000) in paragraph at lines 10--10
[] /cmr10/fr^^?uher

(the whole log see below)


While a LaTeX example

\documentclass{book}
\usepackage{german}
\usepackage[applemac]{inputenc}
\usepackage[T1]{fontenc}

\begin{document}

\showhyphens{alter}

\showhyphens{früher}

\end{document}

brings the right hyphenation (frü-her)

Underfull \hbox (badness 10000) in paragraph at lines 8--8
[] /ecrm1000/al-ter

Underfull \hbox (badness 10000) in paragraph at lines 10--10
[] /ecrm1000/fr¸-her

(the whole log see below)



Don't ConTeXt and LaTeX use both the same hyphenation patterns?

So what must be done in ConTeXt that it also works?


Thanks for any reply,

Steffen



*********************************************
p.s. context and latex log files:
*********************************************

  TeXExec 3.3 - ConTeXt / PRAGMA ADE 1997-2003

             executable : pdfetex
                 format : cont-en
              inputfile : hypcontext
                 output : pdftex
              interface : en
           current mode : none
                TeX run : 1

This is pdfeTeX, Version 3.14159-1.10b-2.1 (Web2C 7.4.5)
entering extended mode
(./hypcontext.tex{/Users/himmelblau/Library/texmf/pdftex/config/pdftex.cfg}

ConTeXt  ver: 2003.8.21  fmt: 2003.9.6  int: english  mes: english

language       : language en is active
<protectionstate 0>
system         : cont-new loaded
(/usr/local/teTeX/share/texmf.local/tex/context/base/cont-new.tex
systems        : beware: some patches loaded from cont-new.tex!
)
system         : cont-old loaded
(/usr/local/teTeX/share/texmf.local/tex/context/base/cont-old.tex
loading        : Context Old Macros
)
system         : cont-fil loaded
(/usr/local/teTeX/share/texmf.local/tex/context/base/cont-fil.tex
loading        : Context File Synonyms
)
system         : cont-sys loaded
(/usr/local/teTeX/share/texmf.local/tex/context/user/cont-sys.tex)
bodyfont       : 12pt rm is loaded
language       : patterns 2:2-en-2 3:2-uk-2 4:2-de-2 5:2-fr-2 6:2-es-2 7:2-it-2
  8:2-nl-2 loaded
specials       : tex,postscript,rokicki loaded
system         : hypcontext.top loaded
(./hypcontext.top
specials       : loading definition file tpd
(/usr/local/teTeX/share/texmf.local/tex/context/base/spec-tpd.tex
specials       : loading definition file fdf
(/usr/local/teTeX/share/texmf.local/tex/context/base/spec-fdf.tex
<unprotect 3> <unprotect 4>
system (E-TEX) : [line 1907] \ifcsname
<protect 4> <protect 3>)
specials       : fdf loaded
<unprotect 3> <protect 3>)
specials       : fdf,tpd loaded
)
pdftex         : needs map file: original-context-symbol.map
pdftex         : needs map file: pl0-ams-cmr.map
pdftex         : needs map file: original-vogel-symbol.map
systems        : begin file hypcontext at line 6

Underfull \hbox (badness 10000) in paragraph at lines 8--8
[] /cmr10/al-ter

Underfull \hbox (badness 10000) in paragraph at lines 10--10
[] /cmr10/fr^^?uher
systems        : end file hypcontext at line 12
  )
(see the transcript file for additional information)
No pages of output.
Transcript written on hypcontext.log.

            return code : 0
               run time : 2 seconds
   sorting and checking : running texutil

  TeXUtil 7.5 - ConTeXt / PRAGMA ADE 1992-2003

                 action : processing commands, lists and registers
                 option : sorting IJ under Y
                 option : converting high ASCII values
             input file : hypcontext.tui
            output file : hypcontext.tuo
        passed commands : 8
          remapped keys : 0
       register entries : 0 -> 0 entries 0 references
        synonym entries : 0 -> 0 entries
         embedded files : 1

  utility file analysis : another run needed
                TeX run : 2

This is pdfeTeX, Version 3.14159-1.10b-2.1 (Web2C 7.4.5)
entering extended mode
(./hypcontext.tex{/Users/himmelblau/Library/texmf/pdftex/config/pdftex.cfg}

ConTeXt  ver: 2003.8.21  fmt: 2003.9.6  int: english  mes: english

language       : language en is active
<protectionstate 0>
system         : cont-new loaded
(/usr/local/teTeX/share/texmf.local/tex/context/base/cont-new.tex
systems        : beware: some patches loaded from cont-new.tex!
)
system         : cont-old loaded
(/usr/local/teTeX/share/texmf.local/tex/context/base/cont-old.tex
loading        : Context Old Macros
)
system         : cont-fil loaded
(/usr/local/teTeX/share/texmf.local/tex/context/base/cont-fil.tex
loading        : Context File Synonyms
)
system         : cont-sys loaded
(/usr/local/teTeX/share/texmf.local/tex/context/user/cont-sys.tex)
bodyfont       : 12pt rm is loaded
language       : patterns 2:2-en-2 3:2-uk-2 4:2-de-2 5:2-fr-2 6:2-es-2 7:2-it-2
  8:2-nl-2 loaded
specials       : tex,postscript,rokicki loaded
system         : hypcontext.top loaded
(./hypcontext.top
specials       : loading definition file tpd
(/usr/local/teTeX/share/texmf.local/tex/context/base/spec-tpd.tex
specials       : loading definition file fdf
(/usr/local/teTeX/share/texmf.local/tex/context/base/spec-fdf.tex
<unprotect 3> <unprotect 4>
system (E-TEX) : [line 1907] \ifcsname
<protect 4> <protect 3>)
specials       : fdf loaded
<unprotect 3> <protect 3>)
specials       : fdf,tpd loaded
)
pdftex         : needs map file: original-context-symbol.map
pdftex         : needs map file: pl0-ams-cmr.map
pdftex         : needs map file: original-vogel-symbol.map
(./hypcontext.tuo) (./hypcontext.tuo) (./hypcontext.tuo) (./hypcontext.tuo)
(./hypcontext.tuo) (./hypcontext.tuo) (./hypcontext.tuo) (./hypcontext.tuo)
(./hypcontext.tuo) (./hypcontext.tuo) (./hypcontext.tuo) (./hypcontext.tuo)
(./hypcontext.tuo) (./hypcontext.tuo)
systems        : begin file hypcontext at line 6

Underfull \hbox (badness 10000) in paragraph at lines 8--8
[] /cmr10/al-ter

Underfull \hbox (badness 10000) in paragraph at lines 10--10
[] /cmr10/fr^^?uher
systems        : end file hypcontext at line 12
  )
(see the transcript file for additional information)
No pages of output.
Transcript written on hypcontext.log.

            return code : 0
               run time : 1 seconds
   sorting and checking : running texutil

  TeXUtil 7.5 - ConTeXt / PRAGMA ADE 1992-2003

                 action : processing commands, lists and registers
                 option : sorting IJ under Y
                 option : converting high ASCII values
             input file : hypcontext.tui
            output file : hypcontext.tuo
        passed commands : 8
          remapped keys : 0
       register entries : 0 -> 0 entries 0 references
        synonym entries : 0 -> 0 entries
         embedded files : 1

         total run time : 5 seconds

**********************************

This is pdfeTeX, Version 3.14159-1.10b-2.1 (Web2C 7.4.5)
  \write18 enabled.
entering extended mode
(./hyplatex.tex{/Users/himmelblau/Library/texmf/pdftex/config/pdftex.cfg}
LaTeX2e <2001/06/01>
Babel <v3.7h> and hyphenation patterns for american, french, german, ngerman, c
zech, dutch, greek, italian, latin, magyar, russian, spanish, nohyphenation, lo
aded.
(/Users/himmelblau/Library/texmf/tex/latex/base/book.cls
Document Class: book 2001/04/21 v1.4e Standard LaTeX document class
(/Users/himmelblau/Library/texmf/tex/latex/base/bk10.clo))
(/usr/local/teTeX/share/texmf.tetex/tex/generic/german/german.sty
v2.5e 1998-07-08) (/Users/himmelblau/Library/texmf/tex/latex/base/inputenc.sty
(/Users/himmelblau/Library/texmf/tex/latex/base/applemac.def))
(/Users/himmelblau/Library/texmf/tex/latex/base/fontenc.sty
(/Users/himmelblau/Library/texmf/tex/latex/base/t1enc.def)) (./hyplatex.aux)
Underfull \hbox (badness 10000) in paragraph at lines 8--8
[] /ecrm1000/al-ter

Underfull \hbox (badness 10000) in paragraph at lines 10--10
[] /ecrm1000/fr¸-her
(./hyplatex.aux) )
(see the transcript file for additional information)
No pages of output.
Transcript written on hyplatex.log.

Re: Question on \setupencoding[default=ec]

[Jens-Uwe Morawski]

On Wed, 10 Sep 2003 16:39:23 +0200
Steffen Wolfrum <xmailings@estfiles.de> wrote:

> I have re-read the mailings in the archive concerning proper 
> hyphenation and I saw
> that it is a known problem to have hyphenation in words containing 
> cedilla, accent or umlaut.
> 
> As it is solved in LaTeX with the [T1]{fontenc} package some people 
> wrote that in ConTeXt the equivalent should be:

ConTeXt has, AFAIK, no support for ec-encoded CM-like fonts, i.e cm-super.
This will change when the LM-fonts are supported.
 
> \setupencoding[default=ec]
> 
> But that's not true (at least for german Umlaute).

use a font that is available in ec

> \language[de]
> \mainlanguage[de]
> \enableregime[mac]
> \setupencoding[default=ec]

\setupbodyfont[pos]

> \starttext
> 
> \showhyphens{alter}
> 
> \showhyphens{früher}
> 
> \stoptext

Jens

Re: Question on \setupencoding[default=ec]

[Patrick Gundlach]

Hello Steffen,

> I have re-read the mailings in the archive concerning proper
> hyphenation and I saw that it is a known problem to have hyphenation
> in words containing cedilla, accent or umlaut.

Right. 

> As it is solved in LaTeX with the [T1]{fontenc} package some people
> wrote that in ConTeXt the equivalent should be:
>
> \setupencoding[default=ec]
not quite. This does not really do anything, except storing the
defaultencoding. (see enco-ini.tex)

> But that's not true (at least for german Umlaute).

try this: (you need to setup your regime again)

\mainlanguage[de]
\enableregime[il1]
\showhyphens{Bohrtürme} % 1
\setupencoding[default=ec]
\usetypescript [all][computer-modern][\defaultencoding]
\starttext
\showhyphens{Bohrtürme} %2
\switchtobodyfont[cmr]  %3
\showhyphens{Bohrtürme} %4
\showhyphens{alter}
\showhyphens{früher}
\stoptext


%1 is not surprising: /cmr10/Bohrt^^?urme. Awful. %2 is slightly
surprising (/ecrm1000/Bohrt^^?urme), because one would not expect to have to
reload cmr again and it looks as if ecrm is loaded. But when you start
using text here, no font switch takes place. %3 is the necessary step
to enable ec font. %4 is what you want: /ecrm1000/Bohr-tür-me. But
don't ask me why %2 displays what it does. I expected something like
/cmr10/Bohrt^^?urme.

Patrick

-- 
Silent is the goldfish in its bowl

Re: Question on \setupencoding[default=ec]

[Patrick Gundlach]

Hi Jens,

> ConTeXt has, AFAIK, no support for ec-encoded CM-like fonts, i.e cm-super.
> This will change when the LM-fonts are supported.

see my other mail. ConTeXt has support for Jörg Knappens ec-font-project
and aer. I think that cmsuper is activated via map file (?)

Patrick

Re: Question on \setupencoding[default=ec]

[Hans Hagen]

At 18:37 10/09/2003 +0200, you wrote:

>ConTeXt has, AFAIK, no support for ec-encoded CM-like fonts, i.e cm-super.
>This will change when the LM-fonts are supported.

the aer (almost ec) are supported, with a font handler plug in that takes 
care of missing glyphs (like guillemots from plr); actually the 'almost' as 
well as th eneed for this hack triggered the lm font project -)

Hans
-------------------------------------------------------------------------
                                   Hans Hagen | PRAGMA ADE | pragma@wxs.nl
                       Ridderstraat 27 | 8061 GH Hasselt | The Netherlands
  tel: +31 (0)38 477 53 69 | fax: +31 (0)38 477 53 74 | www.pragma-ade.com
-------------------------------------------------------------------------
                        information: http://www.pragma-ade.com/roadmap.pdf
                     documentation: http://www.pragma-ade.com/showcase.pdf
-------------------------------------------------------------------------