Having difficulty getting unicode characters to display in ConTeXT out put PDF

* Having difficulty getting unicode characters to display in ConTeXT out put PDF
@ 2015-04-07 18:40 david.boerschlein
  2015-04-08  7:28 ` Henning Hraban Ramm
  2015-04-08 17:11 ` Having difficulty getting unicode characters to display in ConTeXT output PDF Pablo Rodriguez
  0 siblings, 2 replies; 4+ messages in thread
From: david.boerschlein @ 2015-04-07 18:40 UTC (permalink / raw)
  To: ntg-context

[-- Attachment #1: Type: text/plain, Size: 756 bytes --]

I am having difficulty getting Unicode characters to display correctly in PDF output using ConTeXT.   Also, the PDF Bookmarks are not showing in this example.

ConTeXt  ver: 2014.12.11 12:02 MKIV beta  fmt: 2014.12.15  int: english/english

I am attaching a minimal example.

Would you please give me some pointers and put a working multi-lingual example on the contextgarden.net website?

Thanks much.

David Boerschlein
(214) 412-3275 home office land
(585) 278-4687 cell
www.linkedin.com/in/davidboerschlein

____________________________________________________________
Old School Yearbook Pics
View Class Yearbooks Online Free. Search by School & Year. Look Now!
http://thirdpartyoffers.juno.com/TGL3141/552424cca81e724cc01f5st02duc

[-- Attachment #2: hello_world.pdf --]
[-- Type: application/pdf, Size: 12555 bytes --]

[-- Attachment #3: hello_world.log --]
[-- Type: application/octet-stream, Size: 6638 bytes --]

fonts           > injections > using experimental injector

open source     > 1 > 1 > /opt/context/tex/texmf-context/tex/context/base/cont-yes.mkiv

ConTeXt  ver: 2014.12.11 12:02 MKIV beta  fmt: 2014.12.15  int: english/english

system          > 'cont-new.mkiv' loaded
open source     > 2 > 2 > /opt/context/tex/texmf-context/tex/context/base/cont-new.mkiv
close source    > 2 > 2 > /opt/context/tex/texmf-context/tex/context/base/cont-new.mkiv
system          > files > jobname 'hello_world', input './hello_world', result 'hello_world'
fonts           > latin modern fonts are not preloaded
languages       > language 'en' is active
open source     > 2 > 3 > /var/www/vhosts/door43.org/tools/hello_world.tex
open source     > 3 > 4 > /opt/context/tex/texmf-context/tex/context/base/type-imp-dejavu.mkiv
close source    > 3 > 4 > /opt/context/tex/texmf-context/tex/context/base/type-imp-dejavu.mkiv
fonts           > preloading latin modern fonts (third stage)
fonts           > 'fallback modern-designsize rm 9pt' is loaded
structures      > begin of sectionblock 'frontpart'
structures      > end of sectionblock 'frontpart'
backend         > xmp > using file '/opt/context/tex/texmf-context/tex/context/base/lpdf-pdx.xml'
pages           > flushing realpage 1, userpage 1
pages           > flushing realpage 2, userpage 2
structures      > begin of sectionblock 'bodypart'
structure       > sectioning > section @ level 3 : 0.0.1 -> 1. Russian: Привет мир!
structure       > sectioning > section @ level 3 : 0.0.2 -> 2. Punjabi: ਸਤਿ ਸ੍ਰੀ ਅਕਾਲ ਦੁਨਿਆ!
structure       > sectioning > section @ level 3 : 0.0.3 -> 3. Arabic: مرحبا أيها العالم!
structure       > sectioning > section @ level 3 : 0.0.4 -> 4. Hebrew: שלום העולם!
structure       > sectioning > section @ level 3 : 0.0.5 -> 5. Armenian: Բարեւ աշխարհ!
structures      > end of sectionblock 'bodypart'
pages           > flushing realpage 3, userpage 3
pages           > flushing realpage 4, userpage 4
close source    > 2 > 4 > /var/www/vhosts/door43.org/tools/hello_world.tex
close source    > 1 > 4 > /opt/context/tex/texmf-context/tex/context/base/cont-yes.mkiv

system          > structure > start used structure

used structure  > text: hello_world

system          > structure > stop used structure

system          > files > start used files

used file       >    1: filename=cont-yes.mkiv filetype=tex foundname=/opt/context/tex/texmf-context/tex/context/base/cont-yes.mkiv usedmethod=database
used file       >    2: filename=publ-imp-apa.lua filetype=scripts foundname=/opt/context/tex/texmf-context/tex/context/base/publ-imp-apa.lua usedmethod=database
used file       >    3: filename=cont-new.mkiv filetype=tex foundname=/opt/context/tex/texmf-context/tex/context/base/cont-new.mkiv usedmethod=database
used file       >    4: filename=lang-us.lua filetype=scripts foundname=/opt/context/tex/texmf-context/tex/context/patterns/lang-us.lua usedmethod=database
used file       >    5: filename=/var/www/vhosts/door43.org/tools/hello_world.tex foundname=/var/www/vhosts/door43.org/tools/hello_world.tex usedmethod=direct
used file       >    6: filename=type-imp-DejaVu.mkiv filetype=tex foundname=/opt/context/tex/texmf-context/tex/context/base/type-imp-dejavu.mkiv usedmethod=database
used file       >    7: filename=lm.lfg filetype=tex foundname=/opt/context/tex/texmf-context/tex/context/fonts/lm.lfg usedmethod=database
used file       >    8: filename=lmroman9-regular filetype=otf format=otf foundname=/opt/context/tex/texmf/fonts/opentype/public/lm/lmroman9-regular.otf usedmethod=database
used file       >    9: filename=latinmodern-math.otf filetype=opentypefonts foundname=/opt/context/tex/texmf/fonts/opentype/public/lm-math/latinmodern-math.otf usedmethod=database
used file       >   10: filename=lmroman10-regular filetype=otf format=otf foundname=/opt/context/tex/texmf/fonts/opentype/public/lm/lmroman10-regular.otf usedmethod=database
used file       >   11: filename=lpdf-pdx.xml filetype=tex foundname=/opt/context/tex/texmf-context/tex/context/base/lpdf-pdx.xml usedmethod=database

system          > files > stop used files

system          > options > start commandline options

used option     > currentrun="2"
used option     > fulljobname="./hello_world.tex"
used option     > input="./hello_world.tex"
used option     > kindofrun="2"
used option     > maxnofruns="8"
used option     > no-parse-first-line="true"

system          > options > stop commandline options

system          > options > start commandline files

used file       >    1: ./hello_world.tex

system          > options > stop commandline files

mkiv lua stats  > used config file: selfautoparent:/texmf/web2c/texmfcnf.lua
mkiv lua stats  > used cache path: /opt/context/tex/texmf-cache/luatex-cache/context/5fe67e0bfe781ce0dde776fb1556f32e
mkiv lua stats  > resource resolver: loadtime 0.012 seconds, 0 scans with scantime 0.000 seconds, 0 shared scans, 11 found files, scanned paths: <none>
mkiv lua stats  > stored bytecode data: 359 modules (0.240 sec), 72 tables (0.000 sec), 431 chunks (0.240 sec)
mkiv lua stats  > running in nuts mode: yes
mkiv lua stats  > cleaned up reserved nodes: 44 nodes, 442 lists of 441
mkiv lua stats  > node memory usage: 3 glue, 3 penalty, 16 attribute, 52 glue_spec, 4 attribute_list, 2 temp
mkiv lua stats  > node list callback tasks: 6 unique task lists, 6 instances (re)created, 268 calls
mkiv lua stats  > used backend: pdf (backend for directly generating pdf output)
mkiv lua stats  > loaded patterns: en::2, load time: 0.000
mkiv lua stats  > jobdata time: 0.002 seconds saving, 0.001 seconds loading
mkiv lua stats  > callbacks: 635 direct, 383 indirect, 1018 total
mkiv lua stats  > randomizer: resumed with value 0.64859998768596
mkiv lua stats  > result saved in file: hello_world.pdf, compresslevel 3, objectcompresslevel 3
mkiv lua stats  > loaded fonts: 3 files: latinmodern-math.otf, lmroman10-regular.otf, lmroman9-regular.otf
mkiv lua stats  > fonts load time: 0.194 seconds for 6 fonts, 1 shared in backend, 0 common vectors, 1 common hashes
mkiv lua stats  > used platform: linux-64, type: unix, binary subtree: texmf-linux-64
mkiv lua stats  > luatex banner: this is luatex, version beta-0.79.2 (tex live 2015/dev) (rev 5084)
mkiv lua stats  > control sequences: 40415 of 65536 + 100000
mkiv lua stats  > lua properties: engine: lua, used memory: 59 MB (ctx: 59 MB), hash type: lua, hash chars: min(64,40), symbol mask: utf (τεχ)
mkiv lua stats  > runtime: 0.660 seconds, 4 processed pages, 4 shipped pages, 6.061 pages/second

[-- Attachment #4: hello_world.tex --]
[-- Type: application/octet-stream, Size: 1713 bytes --]

\useregime[utf]
\enableregime[utf]
\definepapersize [Trade][width=5.25in, height=8in]
\setuppapersize [Trade][Trade]
\setuppagenumbering [alternative=doublesided]
\mainlanguage[en]
\usetypescript[DejaVu][uc]
\setupalign[hanging]

\setupbodyfontenvironment[default][em=italic]

\setupspacing[packed]   % normal word space at the end of sentences
\setupwhitespace[none]  % no space between paragraphs
\setupindenting[small, yes]

\setuppagenumbering[location=margin]

\setuplayout[backspace=20mm,
    topspace=36pt,
    bottomspace=36pt,
    header=0mm,
    height=fit,
    bottom=0mm,
    footer=1mm]

% Enables index in PDF document
\placebookmarks[section]
\setupinteractionscreen[option=bookmark]
\setuphead[section][style=\tfd, number=no, before=\blank, after=\blank, align={middle, nothyphenated, verytolerant}]

\setupbodyfont[DejaVu, 9pt]
\setupinterlinespace[line=11pt] % Line spacing

% Let us say hello in many languages
\starttext
    \setupfooter [state=start]
    \page[1]
    \startfrontmatter
        {\midaligned {\tfc{\WORD{Hello World}}}}
        \placecontent[extras={22=page},alternative=c]
    \stopfrontmatter
    \page[yes]
    \startbodymatter
        \section{1. Russian: Привет мир!} Russian: Привет мир! \\
        \section{2. Punjabi: ਸਤਿ ਸ੍ਰੀ ਅਕਾਲ ਦੁਨਿਆ!} Punjabi: ਸਤਿ ਸ੍ਰੀ ਅਕਾਲ ਦੁਨਿਆ! \\
        \section{3. Arabic: مرحبا أيها العالم!} Arabic: مرحبا أيها العالم! \\
        \section{4. Hebrew: שלום העולם!} Hebrew: שלום העולם! \\
        \section{5. Armenian: Բարեւ աշխարհ!} Armenian: Բարեւ աշխարհ! \\
    \stopbodymatter
\stoptext

[-- Attachment #5: hello_world.tuc --]
[-- Type: application/octet-stream, Size: 7053 bytes --]

local utilitydata = { }

utilitydata.comment={
 ["escape"]="[===[ ... ]===]",
 ["file"]="hello_world",
 ["format"]="cont-en",
 ["stamp"]="2014.12.11 12:02",
 ["version"]=1.28,
}

if not utilitydata.job then utilitydata.job = { } end
if not utilitydata.job.variables then utilitydata.job.variables = { } end

utilitydata.job.variables.checksums={
}

if not utilitydata.job then utilitydata.job = { } end
if not utilitydata.job.variables then utilitydata.job.variables = { } end

utilitydata.job.variables.collected={
 ["randomseed"]=0.64859998768596,
}

if not utilitydata.job then utilitydata.job = { } end
if not utilitydata.job.passes then utilitydata.job.passes = { } end

utilitydata.job.passes.collected={
}

if not utilitydata.job then utilitydata.job = { } end
if not utilitydata.job.datasets then utilitydata.job.datasets = { } end

utilitydata.job.datasets.collected={
}

if not utilitydata.job then utilitydata.job = { } end
if not utilitydata.job.pagestates then utilitydata.job.pagestates = { } end

utilitydata.job.pagestates.collected={
}

if not utilitydata.job then utilitydata.job = { } end
if not utilitydata.job.structure then utilitydata.job.structure = { } end

utilitydata.job.structure.collected={
 ["branches"]={},
 ["name"]="hello_world",
 ["type"]="text",
}

if not utilitydata.job then utilitydata.job = { } end
if not utilitydata.job.positions then utilitydata.job.positions = { } end

utilitydata.job.positions.collected={
}

if not utilitydata.structures then utilitydata.structures = { } end
if not utilitydata.structures.specials then utilitydata.structures.specials = { } end

utilitydata.structures.specials.collected={
}

if not utilitydata.structures then utilitydata.structures = { } end
if not utilitydata.structures.counters then utilitydata.structures.counters = { } end

utilitydata.structures.counters.collected={
 ["chemical"]={
  { 0 },
 },
 ["combination"]={
  { 0 },
 },
 ["endnote"]={
  { 0 },
 },
 ["figure"]={
  { 0 },
 },
 ["footnote"]={
  { 0 },
 },
 ["formula"]={
  { 0 },
 },
 ["graphic"]={
  { 0 },
 },
 ["intermezzo"]={
  { 0 },
 },
 ["itemgroup:itemize"]={
  { 0 },
 },
 ["linenote"]={
  { 0 },
 },
 ["paragraph"]={
  { 0 },
 },
 ["realpage"]={
  { 4 },
 },
 ["subpage"]={
  { 0 },
 },
 ["table"]={
  { 0 },
 },
 ["userpage"]={
  { 4 },
 },
}

if not utilitydata.structures then utilitydata.structures = { } end
if not utilitydata.structures.lists then utilitydata.structures.lists = { } end

utilitydata.structures.lists.collected={
 {
  ["metadata"]=1,
  ["numberdata"]=3,
  ["references"]={
   ["block"]="bodypart",
   ["internal"]=1,
   ["realpage"]=3,
   ["section"]=1,
  },
  ["titledata"]={
   ["label"]="section",
   ["title"]="1. Russian: Привет мир!",
  },
 },
 {
  ["metadata"]=1,
  ["numberdata"]=5,
  ["references"]={
   ["block"]="bodypart",
   ["internal"]=2,
   ["realpage"]=3,
   ["section"]=2,
  },
  ["titledata"]={
   ["label"]="section",
   ["title"]="2. Punjabi: ਸਤਿ ਸ੍ਰੀ ਅਕਾਲ ਦੁਨਿਆ!",
  },
 },
 {
  ["metadata"]=1,
  ["numberdata"]=7,
  ["references"]={
   ["block"]="bodypart",
   ["internal"]=3,
   ["realpage"]=3,
   ["section"]=3,
  },
  ["titledata"]={
   ["label"]="section",
   ["title"]="3. Arabic: مرحبا أيها العالم!",
  },
 },
 {
  ["metadata"]=1,
  ["numberdata"]=9,
  ["references"]={
   ["block"]="bodypart",
   ["internal"]=4,
   ["realpage"]=3,
   ["section"]=4,
  },
  ["titledata"]={
   ["label"]="section",
   ["title"]="4. Hebrew: שלום העולם!",
  },
 },
 {
  ["metadata"]=1,
  ["numberdata"]=11,
  ["references"]={
   ["block"]="bodypart",
   ["internal"]=5,
   ["realpage"]=3,
   ["section"]=5,
  },
  ["titledata"]={
   ["label"]="section",
   ["title"]="5. Armenian: Բարեւ աշխարհ!",
  },
 },
}

if not utilitydata.structures then utilitydata.structures = { } end
if not utilitydata.structures.pages then utilitydata.structures.pages = { } end

utilitydata.structures.pages.collected={
 {
  ["block"]="frontpart",
  ["number"]=1,
  ["numberdata"]=12,
  ["prefixdata"]=13,
  ["state"]="start",
 },
 {
  ["block"]="frontpart",
  ["number"]=2,
  ["numberdata"]=12,
  ["prefixdata"]=13,
  ["state"]="start",
 },
 {
  ["block"]="bodypart",
  ["number"]=3,
  ["numberdata"]=12,
  ["prefixdata"]=13,
  ["state"]="start",
 },
 {
  ["block"]="bodypart",
  ["number"]=4,
  ["numberdata"]=12,
  ["prefixdata"]=13,
  ["state"]="start",
 },
}

if not utilitydata.structures then utilitydata.structures = { } end
if not utilitydata.structures.references then utilitydata.structures.references = { } end

utilitydata.structures.references.collected={
}

if not utilitydata.structures then utilitydata.structures = { } end
if not utilitydata.structures.references then utilitydata.structures.references = { } end

utilitydata.structures.references.referred={
}

if not utilitydata.job then utilitydata.job = { } end
if not utilitydata.job.objects then utilitydata.job.objects = { } end

utilitydata.job.objects.collected={
}

if not utilitydata.structures then utilitydata.structures = { } end
if not utilitydata.structures.synonyms then utilitydata.structures.synonyms = { } end

utilitydata.structures.synonyms.collected={
}

if not utilitydata.structures then utilitydata.structures = { } end
if not utilitydata.structures.registers then utilitydata.structures.registers = { } end

utilitydata.structures.registers.collected={
}

if not utilitydata.structures then utilitydata.structures = { } end
if not utilitydata.structures.blocks then utilitydata.structures.blocks = { } end

utilitydata.structures.blocks.collected={
}

if not utilitydata.job then utilitydata.job = { } end
if not utilitydata.job.files then utilitydata.job.files = { } end

utilitydata.job.files.collected={
}

if not utilitydata.publications then utilitydata.publications = { } end

utilitydata.publications.collected={
}

utilitydata.job.packed={
 ["index"]={
  {
   ["catcodes"]=8,
   ["coding"]="tex",
   ["increment"]="yes",
   ["kind"]="section",
   ["name"]="section",
  },
  { 0, 0, 1 },
  {
   ["block"]="bodypart",
   ["hidenumber"]=true,
   ["language"]="en",
   ["numbers"]=2,
   ["set"]="all",
  },
  { 0, 0, 2 },
  {
   ["block"]="bodypart",
   ["hidenumber"]=true,
   ["language"]="en",
   ["numbers"]=4,
   ["set"]="all",
  },
  { 0, 0, 3 },
  {
   ["block"]="bodypart",
   ["hidenumber"]=true,
   ["language"]="en",
   ["numbers"]=6,
   ["set"]="all",
  },
  { 0, 0, 4 },
  {
   ["block"]="bodypart",
   ["hidenumber"]=true,
   ["language"]="en",
   ["numbers"]=8,
   ["set"]="all",
  },
  { 0, 0, 5 },
  {
   ["block"]="bodypart",
   ["hidenumber"]=true,
   ["language"]="en",
   ["numbers"]=10,
   ["set"]="all",
  },
  {
   ["conversionset"]="pagenumber",
  },
  {
   ["connector"]="–",
   ["prefix"]="no",
   ["set"]="part",
  },
 },
 ["keys"]={
  ["directives"]=true,
  ["metadata"]=true,
  ["numberdata"]=true,
  ["numbers"]=true,
  ["pagedata"]=true,
  ["prefixdata"]=true,
  ["processors"]=true,
  ["sectiondata"]=true,
  ["specification"]=true,
 },
 ["version"]=1.02,
}

return utilitydata

[-- Attachment #6: Type: text/plain, Size: 485 bytes --]

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

^ permalink raw reply	[flat|nested] 4+ messages in thread