Re: Error while compiling : ! String contains an invalid utf-8 sequence.

[Alexandre Krispin <k.m.alexandre@gmail.com>]

[-- Attachment #1.1: Type: text/plain, Size: 20280 bytes --]

Hello,

I had no response for the problem related to the script "hanzi", and the
reason may be that I have done a mistake since I have sent a mail only to
Wolfgang Schuster and not to the mailing list.

So in case there would be a solution to solve the problem of misplaced dots
that the script "hanzi" caused, I copy-paste the mail I sent to Wolfgang
Schuster only instead of the mailing list by mistake :

The problem when I switch to the latin script for the bibliography is that
again, japanese words won't wrap, the long japanese titles will go
throughout the page, without going to the next line, as before. And if I
switch to the the hanzi script for the bibliography, japanese titles will
appear correctly, but dots will be misplaced. Some dots will be before the
parenthesis, others will be at the same after parenthesis but with a big
space between it.

Here are the tex and bib file which allow you to reproduce the problem :
%*****************************
*******************************************************************

\usemodule[simplefonts]
\setmainfont[Arno Pro]
\definesimplefonttypeface[jpn][HeiseiMinStd-W3]
%****************************************
\setupbibtex[database=biblio,sort=author]
\setuppublications[alternative=apa-fr,sorttype=bbl,refcommand=authoryear]
%****************************************
\setscript[hanzi] %if this script is turned on, japanese display is ok, but
dots won't  display correctly

\starttext
\completepublications[criterium=all]
\stoptext
%**************************************************************************************************

%**************************************************************************************************
@article{conrad1980transformation,
author = "Conrad Totman",
title = "From {S}akoku to {K}aikoku. {T}he {T}ransformation of
{F}oreign-{P}olicy
{A}ttitudes,
1853-1868",
journal = "Monumenta Nipponica",
year = 1980,
volume = 35,
number = 1,
pages = "1-19",
publisher = "Sophia University",
url = "http://www.jstor.org/stable/2384397",
}

@article{howse2002from,
author = "Robert Howse",
title = "From Politics to Technocracy-and Back Again: The Fate of the
Multilateral Trading Regime",
journal = "The American Journal of International Law",
volume = 96,
number = 1,
month = "January",
year = 2002,
pages = "94-117",
publisher = "American Society of International Law",
url = "http://www.jstor.org/stable/2686127",
}

@article{kato2011tpp,
author = "Katô, Fumiko {\jpn 加藤 文子}",
title = "{TPP} sanka giron wo meguru ikkôsatsu - Iryôbunya wo chûshin ni -
Ôbei no rôdô
shijô to no genjô wo fumaete {\jpn
ＴＰＰ参加議論をめぐる一考察-医療分野を中心に-欧米の労働市場との現状比較をふまえて}
(Une réflexion sur les débats d'adhésion au {TPP}, centrée sur le champ
médical
-- Basée sur une comparaison du marché du travail actuel européen et
nord-américain)",
journal = "Jissen joshi daigaku ningen shakai gakubu kiyô {\jpn
実践女子大学人間社会学部紀要}",
month = "avril",
year = 2011,
pages = "77-88",
publisher = "Jissen joshi daigaku {\jpn 実践女子大学}",
url = "http://ci.nii.ac.jp/naid/110008431857/",
}

@article{kobrain1998mai,
author = "Stephen J. Kobrin",
title = {The {MAI} and the Clash of Globalizations},
journal = "Foreign Policy",
number = 112,
month = "Autumn",
year = 1998,
pages = "97-109",
publisher = "Washington Post Newsweek Interactive LLC",
url = "http://www.jstor.org/stable/1149038",
}

@article{ishihara2011tpp,
author = "Ishihara, Kenji {\jpn 石原健二}",
title = {{TPP} mondai to nihon
nôgyô {\jpn ＴＰＰ問題と日本農業}(Le problème du {TPP} et l'agriculture
japonaise)},
journal = {Jichi sôken {\jpn 自治総研}},
volume = {392},
year = {2011},
month = {June},
pages = {38-58},
publisher = {Chihô jichi sôgô kenkyûjo {\jpn 地方自治総合研究所}},
url = {http://ci.nii.ac.jp/naid/110008454120/},
}

@article{ciccantell2001nafta,
author = "Paul Ciccantell",
title = "{NAFTA} and the Reconstruction of {U.S.} Hegemony: The Raw
Materials
Foundations of Economic Competitiveness",
publisher = "Canadian Journal of Sociology",
journal = "The Canadian Journal of Sociology",
year = 2001,
period = Winter,
volume = 26,
number = 1,
pages = "57-87",
url = "http://www.jstor.org/stable/3341511"
}

@article{robey1999civil,
author = "John S. Robey",
title = "Civil Society and {NAFTA}: Initial Results",
journal = "Annals of the American Academy of Political and Social Science",
publisher = "Sage Publications, Inc.",
year = 1999,
month = "September",
volume = 565,
pages = "113-125",
url = "http://www.jstor.org/stable/1049540"
}


@article{morales1999governance,
author = "Isidro Morales",
title = "{NAFTA}: The Governance of Economic Openness",
journal = "Annals of the American Academy of Political and Social Science",
publisher = "Sage Publications, Inc.",
year = 1999,
month = "September",
volume = 565,
pages = "35-65",
url = "http://www.jstor.org/stable/1049536"
}

@article{morales1999mexican,
author = "Isidro Morales",
title = "The Mexican Crisis and the Weakness of the {NAFTA} Consensus",
journal = "Annals of the American Academy of Political and Social Science",
publisher = "Sage Publications, Inc.",
year = 1997,
month = "March",
volume = 550,
pages = "130-152",
url = "http://www.jstor.org/stable/1047712"
}

@article{uzawa2011tpp,
author = "Hirofumi, Uzawa {\jpn 宇沢弘文} and Uchihashi, Katsuto {\jpn 内橋克人}",
journal = "Sekai {\jpn 世界}",

title = "Taidan {TPP} wa shakaiteki kyôtsû shihon wo hakai suru
{\jpn 対談ＴＰＰは社会的共通資本を破壊する} ({D}iscussion. Le {TPP} détruit le
capital social commun)",

year = 2011,
month = "april",
publisher = "Iwanami shoten {\jpn 岩波書店}",

pages = "62-72",
url = "http://ci.nii.ac.jp/naid/40018706510/",
}
%**************************************************************************************************

Cheers,
Alexandre Krispin

2011/11/28 Alexandre Krispin <k.m.alexandre@gmail.com>

> Yes for sure, thanks to the script Wolfgang Schuster pointed out to me
> earlier in the discussion :
> \setscript[hanzi]
>
>
> 2011/11/28 S Barmeier <severinbarmeier@googlemail.com>
>
>> On 11/27/2011 11:44 PM, ntg-context-request@ntg.nl wrote:
>> > Send ntg-context mailing list submissions to
>> >       ntg-context@ntg.nl
>> >
>> > To subscribe or unsubscribe via the World Wide Web, visit
>> >       http://www.ntg.nl/mailman/listinfo/ntg-context
>> > or, via email, send a message with subject or body 'help' to
>> >       ntg-context-request@ntg.nl
>> >
>> > You can reach the person managing the list at
>> >       ntg-context-owner@ntg.nl
>> >
>> > When replying, please edit your Subject line so it is more specific
>> > than "Re: Contents of ntg-context digest..."
>> >
>> >
>> > Today's Topics:
>> >
>> >    1. error with \showlayout and export (Henning Hraban Ramm)
>> >    2. Re: error with \showlayout and export (Wolfgang Schuster)
>> >    3. page number in margin (Henning Hraban Ramm)
>> >    4. Export to epub (Keith McKay)
>> >    5. Re: Error while compiling : ! String contains an invalid
>> >       utf-8 sequence. (Mojca Miklavec)
>> >    6. Re: Export to epub (Hans Hagen)
>> >
>> >
>> > ----------------------------------------------------------------------
>> >
>> > Message: 1
>> > Date: Sun, 27 Nov 2011 12:11:36 +0100
>> > From: Henning Hraban Ramm <hraban@fiee.net>
>> > To: mailing ConTeXt users list for <ntg-context@ntg.nl>
>> > Subject: [NTG-context] error with \showlayout and export
>> > Message-ID: <4670B7FC-970F-4698-B676-9F8C31AE8971@fiee.net>
>> > Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes
>> >
>> > Hi wizards,
>> >
>> > if I use \showlayout in a project where I setup export=yes, ConTeXt
>> > stops with a fatal error.
>> >
>> > Minimal failing example:
>> >
>> > \setupbackend[export=yes]
>> > \starttext
>> > \showlayout
>> > \stoptext
>> >
>> >
>> > Ixchel:konzept hraban$ context --purge context_test.tex
>> >
>> > mtx-context     | run 1: luatex --fmt="/Users/hraban/Library/texmf/tex/
>> > texmf-cache/luatex-cache/context/2448223e6631addb83df348d74153606/
>> > formats/cont-en" --lua="/Users/hraban/Library/texmf/tex/texmf-cache/
>> > luatex-cache/context/2448223e6631addb83df348d74153606/formats/cont-
>> > en.lui" --backend="pdf" "./context_test.tex" \stoptext
>> > This is LuaTeX, Version beta-0.70.1-2011051908 (rev 4277)
>> >   \write18 enabled.
>> > (context_test.tex
>> >
>> > ConTeXt  ver: 2011.11.24 15:52 MKIV  fmt: 2011.11.25  int: english/
>> > english
>> >
>> > system          > cont-new.mkiv loaded
>> > (/Users/hraban/Library/texmf/tex/texmf-context/tex/context/base/cont-
>> > new.mkiv
>> > system          > beware: some patches loaded from cont-new.mkiv
>> > )
>> > system          > context_test.top loaded
>> > (context_test.top)
>> > fonts           > latin modern fonts are not preloaded
>> > languages       > language en is active
>> > backend         > export > enabling export to xml
>> > {/Users/hraban/Library/texmf/tex/texmf-context/fonts/map/pdftex/
>> > context/mkiv-base.map}
>> > fonts           > preloading latin modern fonts (second stage)
>> > (/Users/hraban/Library/texmf/tex/texmf-context/tex/context/base/type-
>> > siz.mkiv) (/Users/hraban/Library/texmf/tex/texmf-context/tex/context/
>> > base/type-otf.mkiv)
>> > files           > readfile > asked name: 'loc', not found
>> > {/Users/hraban/Library/texmf/tex/texmf-fonts/fonts/map/dvips/lm/lm-
>> > math.map}{/Users/hraban/Library/texmf/tex/texmf-fonts/fonts/map/dvips/
>> > lm/lm-rm.map}
>> > fonts           > virtual math > unable to resolve name mapsfromchar
>> > fonts           > fallback modern rm 12pt is loaded
>> > (/Users/hraban/Library/texmf/tex/texmf-context/tex/context/base/page-
>> > run.mkiv
>> > loading         > ConTeXt Page Macros / Runtime Macros
>> > )
>> > interface       > initialization > loading interface definitions from
>> > 'mult-def.lua'
>> > interface       > initialization > loading interface messages from
>> > 'mult-mes.lua'
>> > metapost        > initializing instance 'metafun' using format 'metafun'
>> > metapost        > loading 'metafun': /Users/hraban/Library/texmf/tex/
>> > texmf-context/metapost/context/base/metafun.mpiv
>> > backend         > xmp > using file '/Users/hraban/Library/texmf/tex/
>> > texmf-context/tex/context/base/lpdf-pdx.xml'
>> > pages           > flushing realpage 1, userpage 1, subpage 1
>> > pages           > flushing realpage 2, userpage 2
>> > pages           > flushing realpage 3, userpage 3
>> > pages           > flushing realpage 4, userpage 4
>> > pages           > flushing realpage 5, userpage 5
>> >   )</Users/hraban/Library/texmf/tex/texmf/fonts/opentype/public/lm/
>> > lmmono10-regular.otf></Users/hraban/Library/texmf/tex/texmf/fonts/
>> > opentype/public/lm/lmmono12-regular.otf></Users/hraban/Library/texmf/
>> > tex/texmf/fonts/opentype/public/lm/lmroman12-regular.otf>
>> > ! LuaTeX error ...exmf/tex/texmf-context/tex/context/base/back-exp.lua:
>> > 1203: attempt to index global 'c' (a nil value).
>> >
>> > system          > tex > error on line 0 in file : LuaTeX error  ...
>> >
>> > <empty file>
>> >
>> > <*> ./context_test.tex
>> >                         \stoptext
>> > ?
>> >
>> >
>> >
>> > Greetlings from Lake Constance!
>> > Hraban
>> > ---
>> > http://www.fiee.net/texnique/
>> > http://wiki.contextgarden.net
>> > https://www.cacert.org (I'm an assurer)
>> >
>> >
>> >
>> > ------------------------------
>> >
>> > Message: 2
>> > Date: Sun, 27 Nov 2011 12:35:10 +0100
>> > From: Wolfgang Schuster <schuster.wolfgang@googlemail.com>
>> > To: mailing list for ConTeXt users <ntg-context@ntg.nl>
>> > Cc: Henning Hraban Ramm <hraban@fiee.net>
>> > Subject: Re: [NTG-context] error with \showlayout and export
>> > Message-ID: <0BCE3119-7D79-43B9-A159-62BC079800B1@googlemail.com>
>> > Content-Type: text/plain; charset=us-ascii
>> >
>> >
>> > Am 27.11.2011 um 12:11 schrieb Henning Hraban Ramm:
>> >
>> >> Hi wizards,
>> >>
>> >> if I use \showlayout in a project where I setup export=yes, ConTeXt
>> stops with a fatal error.
>> >>
>> >> Minimal failing example:
>> >>
>> >> \setupbackend[export=yes]
>> >> \starttext
>> >> \showlayout
>> >> \stoptext
>> >
>> > I think this change in back-exp.lua should work (runs at least without
>> an error message):
>> >
>> > function extras.tabulate(result,element,detail,n,fulltag,di)
>> >     local data = di.data
>> >     for i=1,#data do
>> >         local di = data[i]
>> >         if di.tg == "tabulaterow" then
>> >             local did = di.data
>> >             local content = false
>> >             for i=1,#did do
>> >                 local d = did[i].data
>> > --              local c = d and c.content
>> >                 local c = d and d.content
>> >                 if c and #c > 0 then
>> >                     content = true
>> >                     break
>> >                 end
>> >             end
>> >             if not content then
>> >                 di.element = "" -- or simply remove
>> >             end
>> >         end
>> >     end
>> > end
>> >
>> > Wolfgang
>> >
>> > ------------------------------
>> >
>> > Message: 3
>> > Date: Sun, 27 Nov 2011 13:40:51 +0100
>> > From: Henning Hraban Ramm <hraban@fiee.net>
>> > To: mailing list for ConTeXt users <ntg-context@ntg.nl>
>> > Subject: [NTG-context] page number in margin
>> > Message-ID: <90A69805-BCEC-4A6C-BC89-5FA243C9C802@fiee.net>
>> > Content-Type: text/plain; charset=WINDOWS-1252; format=flowed;
>> >       delsp=yes
>> >
>> > Hi again,
>> >
>> > I?d like to get my page numbers in the margin.
>> > This works:
>> > \setuppagenumbering[alternative=doublesided,location=margin]
>> >
>> > But that way it?s on the bottom of the footer margin; I'd like it on
>> > the top.
>> >
>> > Second variant: Even better, I?d like my page number at the bottom of
>> > the text margin. How can I achieve that?
>> >
>> > location option "marginedge" doesn?t seem to do anything, as far as i
>> > can tell, and "inright" is the same as "margin".
>> >
>> > Greetlings from Lake Constance!
>> > Hraban
>> > ---
>> > http://www.fiee.net/texnique/
>> > http://wiki.contextgarden.net
>> > https://www.cacert.org (I'm an assurer)
>> >
>> >
>> >
>> > ------------------------------
>> >
>> > Message: 4
>> > Date: Sun, 27 Nov 2011 13:03:28 +0000
>> > From: Keith McKay <mckaymeister@gmail.com>
>> > To: Ntg-Context <ntg-context@ntg.nl>
>> > Subject: [NTG-context] Export to epub
>> > Message-ID: <4ED23520.2070103@gmail.com>
>> > Content-Type: text/plain; charset="iso-8859-1"; Format="flowed"
>> >
>> > Hi
>> >
>> > I've been playing about with Export in Context with a view to producing
>> > ePubs.
>> >
>> > When I run the script:
>> >
>> > /mtxrun --script epub --make test.specification
>> >
>> > /the test.tree is prepared but no epub file.  The output shown below has
>> > a couple or 'error' messages which are probably due to the way my text
>> > editor is set up (Scite Version 2.02).  If anyone is using Scite and
>> > producing ePubs I be grateful for some hints on how to set this up so
>> > that inkscape and zip works.
>> >
>> > %%Script Output
>> >
>> > mtx-epub        | creating paths in tree test.tree
>> > mtx-epub        | copying toc.ncx to test.tree/OPS/toc.ncx
>> > mtx-epub        | copying test-styles.css to
>> test.tree/OPS/test-styles.css
>> > mtx-epub        | copying test-images.css to
>> test.tree/OPS/test-images.css
>> > mtx-epub        | copying test.css to test.tree/OPS/test.css
>> > mtx-epub        | copying test.xhtml to test.tree/OPS/test.xhtml
>> > mtx-epub        | running command 'inkscape --export-plain-svg=cow.svg
>> > cow.pdf'
>> >
>> > 'inkscape' is not recognized as an internal or external command,
>> > operable program or batch file.
>> >
>> > mtx-epub        | copying cow.svg to test.tree/OPS/cow.svg
>> > mtx-epub        | copying hacker.jpg to test.tree/OPS/hacker.jpg
>> > mtx-epub        | copying mill.png to test.tree/OPS/mill.png
>> > mtx-epub        | creating archive
>> >
>> > 'zip' is not recognized as an internal or external command,
>> > operable program or batch file.
>> > 'zip' is not recognized as an internal or external command,
>> > operable program or batch file.
>> > 'zip' is not recognized as an internal or external command,
>> > operable program or batch file.
>> >
>> > mtx-epub        | epub archive: test.tree/test.epub>Exit code: 0
>> >
>> > %%End Script Output
>> >
>> > I'm using Minimals ConTeXt  ver: 2011.09.27 20:05 MKIV  fmt: 2011.11.19
>> > int: english/english on a Windows 7 machine and the test.tex file is the
>> > |export-example.tex file renamed from the Minimals distribution|.
>> >
>> > Thanks
>> > Keith McKay
>> >
>> > -------------- next part --------------
>> > An HTML attachment was scrubbed...
>> > URL: <
>> http://www.ntg.nl/pipermail/ntg-context/attachments/20111127/f306eade/attachment-0001.html
>> >
>> >
>> > ------------------------------
>> >
>> > Message: 5
>> > Date: Sun, 27 Nov 2011 14:33:32 +0100
>> > From: Mojca Miklavec <mojca.miklavec.lists@gmail.com>
>> > To: mailing list for ConTeXt users <ntg-context@ntg.nl>
>> > Subject: Re: [NTG-context] Error while compiling : ! String contains
>> >       an invalid utf-8 sequence.
>> > Message-ID:
>> >       <CALBOmsYJRQenBGJdBKtv85RY=
>> zuD_g7OyBMyW7hxXoXc6ZZ7rA@mail.gmail.com>
>> > Content-Type: text/plain; charset=UTF-8
>> >
>> > 2011/11/26 Alexandre Krispin wrote:
>> >> Now that japanese display correctly, there is still another problem.
>> >> Japanese sentences (long titles in bibliography) don't break at the
>> end of
>> >> line. I have tested the behavior of japanese with entire paragraphs,
>> and I
>> >> get the same problem as in the bibliography, lines don't break and go
>> >> "through" the page.
>> >>
>> >> Though I have looked to documentation about chinese on the wiki, none
>> helped
>> >> me to solve this problem. Does someone have any idea ?
>> >
>> > My first guess is that ConTeXt doesn't know how to "hyphenate" / split
>> > words or sentences without space. I don't know what the Japanese
>> > typesetting rules are, but if nothing is implemented yet, it cannot
>> > work.
>> >
>> > Mojca
>>
>> I'm interested in Japanese to work as well... Should be easy - no
>> hyphenation, just split the word when the line is full and continue on
>> the next one. There are some more subtle rules for vertical typesetting
>> (e.g. full stops 。 and commas 、 hang over), but for horizontal
>> typesetting you'd just want to split the line anywhere...
>>
>> Can that be done?
>>
>> Severin
>>
>>
>> ___________________________________________________________________________________
>> If your question is of interest to others as well, please add an entry to
>> the Wiki!
>>
>> maillist : ntg-context@ntg.nl /
>> http://www.ntg.nl/mailman/listinfo/ntg-context
>> webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
>> archive  : http://foundry.supelec.fr/projects/contextrev/
>> wiki     : http://contextgarden.net
>>
>> ___________________________________________________________________________________
>>
>
>
>
> --
>
> ------------------------------------------------------------------------------
> Alexandre KRISPIN
> 41 rue Guynemer  |  93200 Saint-Denis  |  France
> tél : 06 28 76 69 34  |  http://bijutsu.toile-libre.org
>
> ----------------------------------------------------------------------------
>
>


-- 
------------------------------------------------------------------------------
Alexandre KRISPIN
41 rue Guynemer  |  93200 Saint-Denis  |  France
tél : 06 28 76 69 34  |  http://bijutsu.toile-libre.org
----------------------------------------------------------------------------

[-- Attachment #1.2: Type: text/html, Size: 27642 bytes --]

[-- Attachment #2: Type: text/plain, Size: 485 bytes --]

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________