ntg-context - mailing list for ConTeXt users
 help / color / mirror / Atom feed
* Re: Error while compiling : ! String contains an invalid utf-8 sequence.
       [not found] <mailman.901.1322405047.4232.ntg-context@ntg.nl>
@ 2011-11-28  7:08 ` S Barmeier
  2011-11-28  8:42   ` Alexandre Krispin
  0 siblings, 1 reply; 18+ messages in thread
From: S Barmeier @ 2011-11-28  7:08 UTC (permalink / raw)
  To: ntg-context

On 11/27/2011 11:44 PM, ntg-context-request@ntg.nl wrote:
> Send ntg-context mailing list submissions to
> 	ntg-context@ntg.nl
> 
> To subscribe or unsubscribe via the World Wide Web, visit
> 	http://www.ntg.nl/mailman/listinfo/ntg-context
> or, via email, send a message with subject or body 'help' to
> 	ntg-context-request@ntg.nl
> 
> You can reach the person managing the list at
> 	ntg-context-owner@ntg.nl
> 
> When replying, please edit your Subject line so it is more specific
> than "Re: Contents of ntg-context digest..."
> 
> 
> Today's Topics:
> 
>    1. error with \showlayout and export (Henning Hraban Ramm)
>    2. Re: error with \showlayout and export (Wolfgang Schuster)
>    3. page number in margin (Henning Hraban Ramm)
>    4. Export to epub (Keith McKay)
>    5. Re: Error while compiling : ! String contains an invalid
>       utf-8 sequence. (Mojca Miklavec)
>    6. Re: Export to epub (Hans Hagen)
> 
> 
> ----------------------------------------------------------------------
> 
> Message: 1
> Date: Sun, 27 Nov 2011 12:11:36 +0100
> From: Henning Hraban Ramm <hraban@fiee.net>
> To: mailing ConTeXt users list for <ntg-context@ntg.nl>
> Subject: [NTG-context] error with \showlayout and export
> Message-ID: <4670B7FC-970F-4698-B676-9F8C31AE8971@fiee.net>
> Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes
> 
> Hi wizards,
> 
> if I use \showlayout in a project where I setup export=yes, ConTeXt  
> stops with a fatal error.
> 
> Minimal failing example:
> 
> \setupbackend[export=yes]
> \starttext
> \showlayout
> \stoptext
> 
> 
> Ixchel:konzept hraban$ context --purge context_test.tex
> 
> mtx-context     | run 1: luatex --fmt="/Users/hraban/Library/texmf/tex/ 
> texmf-cache/luatex-cache/context/2448223e6631addb83df348d74153606/ 
> formats/cont-en" --lua="/Users/hraban/Library/texmf/tex/texmf-cache/ 
> luatex-cache/context/2448223e6631addb83df348d74153606/formats/cont- 
> en.lui" --backend="pdf" "./context_test.tex" \stoptext
> This is LuaTeX, Version beta-0.70.1-2011051908 (rev 4277)
>   \write18 enabled.
> (context_test.tex
> 
> ConTeXt  ver: 2011.11.24 15:52 MKIV  fmt: 2011.11.25  int: english/ 
> english
> 
> system          > cont-new.mkiv loaded
> (/Users/hraban/Library/texmf/tex/texmf-context/tex/context/base/cont- 
> new.mkiv
> system          > beware: some patches loaded from cont-new.mkiv
> )
> system          > context_test.top loaded
> (context_test.top)
> fonts           > latin modern fonts are not preloaded
> languages       > language en is active
> backend         > export > enabling export to xml
> {/Users/hraban/Library/texmf/tex/texmf-context/fonts/map/pdftex/ 
> context/mkiv-base.map}
> fonts           > preloading latin modern fonts (second stage)
> (/Users/hraban/Library/texmf/tex/texmf-context/tex/context/base/type- 
> siz.mkiv) (/Users/hraban/Library/texmf/tex/texmf-context/tex/context/ 
> base/type-otf.mkiv)
> files           > readfile > asked name: 'loc', not found
> {/Users/hraban/Library/texmf/tex/texmf-fonts/fonts/map/dvips/lm/lm- 
> math.map}{/Users/hraban/Library/texmf/tex/texmf-fonts/fonts/map/dvips/ 
> lm/lm-rm.map}
> fonts           > virtual math > unable to resolve name mapsfromchar
> fonts           > fallback modern rm 12pt is loaded
> (/Users/hraban/Library/texmf/tex/texmf-context/tex/context/base/page- 
> run.mkiv
> loading         > ConTeXt Page Macros / Runtime Macros
> )
> interface       > initialization > loading interface definitions from  
> 'mult-def.lua'
> interface       > initialization > loading interface messages from  
> 'mult-mes.lua'
> metapost        > initializing instance 'metafun' using format 'metafun'
> metapost        > loading 'metafun': /Users/hraban/Library/texmf/tex/ 
> texmf-context/metapost/context/base/metafun.mpiv
> backend         > xmp > using file '/Users/hraban/Library/texmf/tex/ 
> texmf-context/tex/context/base/lpdf-pdx.xml'
> pages           > flushing realpage 1, userpage 1, subpage 1
> pages           > flushing realpage 2, userpage 2
> pages           > flushing realpage 3, userpage 3
> pages           > flushing realpage 4, userpage 4
> pages           > flushing realpage 5, userpage 5
>   )</Users/hraban/Library/texmf/tex/texmf/fonts/opentype/public/lm/ 
> lmmono10-regular.otf></Users/hraban/Library/texmf/tex/texmf/fonts/ 
> opentype/public/lm/lmmono12-regular.otf></Users/hraban/Library/texmf/ 
> tex/texmf/fonts/opentype/public/lm/lmroman12-regular.otf>
> ! LuaTeX error ...exmf/tex/texmf-context/tex/context/base/back-exp.lua: 
> 1203: attempt to index global 'c' (a nil value).
> 
> system          > tex > error on line 0 in file : LuaTeX error  ...
> 
> <empty file>
> 
> <*> ./context_test.tex
>                         \stoptext
> ?
> 
> 
> 
> Greetlings from Lake Constance!
> Hraban
> ---
> http://www.fiee.net/texnique/
> http://wiki.contextgarden.net
> https://www.cacert.org (I'm an assurer)
> 
> 
> 
> ------------------------------
> 
> Message: 2
> Date: Sun, 27 Nov 2011 12:35:10 +0100
> From: Wolfgang Schuster <schuster.wolfgang@googlemail.com>
> To: mailing list for ConTeXt users <ntg-context@ntg.nl>
> Cc: Henning Hraban Ramm <hraban@fiee.net>
> Subject: Re: [NTG-context] error with \showlayout and export
> Message-ID: <0BCE3119-7D79-43B9-A159-62BC079800B1@googlemail.com>
> Content-Type: text/plain; charset=us-ascii
> 
> 
> Am 27.11.2011 um 12:11 schrieb Henning Hraban Ramm:
> 
>> Hi wizards,
>>
>> if I use \showlayout in a project where I setup export=yes, ConTeXt stops with a fatal error.
>>
>> Minimal failing example:
>>
>> \setupbackend[export=yes]
>> \starttext
>> \showlayout
>> \stoptext
> 
> I think this change in back-exp.lua should work (runs at least without an error message):
> 
> function extras.tabulate(result,element,detail,n,fulltag,di)
>     local data = di.data
>     for i=1,#data do
>         local di = data[i]
>         if di.tg == "tabulaterow" then
>             local did = di.data
>             local content = false
>             for i=1,#did do
>                 local d = did[i].data
> --              local c = d and c.content
>                 local c = d and d.content
>                 if c and #c > 0 then
>                     content = true
>                     break
>                 end
>             end
>             if not content then
>                 di.element = "" -- or simply remove
>             end
>         end
>     end
> end
> 
> Wolfgang
> 
> ------------------------------
> 
> Message: 3
> Date: Sun, 27 Nov 2011 13:40:51 +0100
> From: Henning Hraban Ramm <hraban@fiee.net>
> To: mailing list for ConTeXt users <ntg-context@ntg.nl>
> Subject: [NTG-context] page number in margin
> Message-ID: <90A69805-BCEC-4A6C-BC89-5FA243C9C802@fiee.net>
> Content-Type: text/plain; charset=WINDOWS-1252; format=flowed;
> 	delsp=yes
> 
> Hi again,
> 
> I?d like to get my page numbers in the margin.
> This works:
> \setuppagenumbering[alternative=doublesided,location=margin]
> 
> But that way it?s on the bottom of the footer margin; I'd like it on  
> the top.
> 
> Second variant: Even better, I?d like my page number at the bottom of  
> the text margin. How can I achieve that?
> 
> location option "marginedge" doesn?t seem to do anything, as far as i  
> can tell, and "inright" is the same as "margin".
> 
> Greetlings from Lake Constance!
> Hraban
> ---
> http://www.fiee.net/texnique/
> http://wiki.contextgarden.net
> https://www.cacert.org (I'm an assurer)
> 
> 
> 
> ------------------------------
> 
> Message: 4
> Date: Sun, 27 Nov 2011 13:03:28 +0000
> From: Keith McKay <mckaymeister@gmail.com>
> To: Ntg-Context <ntg-context@ntg.nl>
> Subject: [NTG-context] Export to epub
> Message-ID: <4ED23520.2070103@gmail.com>
> Content-Type: text/plain; charset="iso-8859-1"; Format="flowed"
> 
> Hi
> 
> I've been playing about with Export in Context with a view to producing 
> ePubs.
> 
> When I run the script:
> 
> /mtxrun --script epub --make test.specification
> 
> /the test.tree is prepared but no epub file.  The output shown below has 
> a couple or 'error' messages which are probably due to the way my text 
> editor is set up (Scite Version 2.02).  If anyone is using Scite and 
> producing ePubs I be grateful for some hints on how to set this up so 
> that inkscape and zip works.
> 
> %%Script Output
> 
> mtx-epub        | creating paths in tree test.tree
> mtx-epub        | copying toc.ncx to test.tree/OPS/toc.ncx
> mtx-epub        | copying test-styles.css to test.tree/OPS/test-styles.css
> mtx-epub        | copying test-images.css to test.tree/OPS/test-images.css
> mtx-epub        | copying test.css to test.tree/OPS/test.css
> mtx-epub        | copying test.xhtml to test.tree/OPS/test.xhtml
> mtx-epub        | running command 'inkscape --export-plain-svg=cow.svg 
> cow.pdf'
> 
> 'inkscape' is not recognized as an internal or external command,
> operable program or batch file.
> 
> mtx-epub        | copying cow.svg to test.tree/OPS/cow.svg
> mtx-epub        | copying hacker.jpg to test.tree/OPS/hacker.jpg
> mtx-epub        | copying mill.png to test.tree/OPS/mill.png
> mtx-epub        | creating archive
> 
> 'zip' is not recognized as an internal or external command,
> operable program or batch file.
> 'zip' is not recognized as an internal or external command,
> operable program or batch file.
> 'zip' is not recognized as an internal or external command,
> operable program or batch file.
> 
> mtx-epub        | epub archive: test.tree/test.epub>Exit code: 0
> 
> %%End Script Output
> 
> I'm using Minimals ConTeXt  ver: 2011.09.27 20:05 MKIV  fmt: 2011.11.19  
> int: english/english on a Windows 7 machine and the test.tex file is the 
> |export-example.tex file renamed from the Minimals distribution|.
> 
> Thanks
> Keith McKay
> 
> -------------- next part --------------
> An HTML attachment was scrubbed...
> URL: <http://www.ntg.nl/pipermail/ntg-context/attachments/20111127/f306eade/attachment-0001.html>
> 
> ------------------------------
> 
> Message: 5
> Date: Sun, 27 Nov 2011 14:33:32 +0100
> From: Mojca Miklavec <mojca.miklavec.lists@gmail.com>
> To: mailing list for ConTeXt users <ntg-context@ntg.nl>
> Subject: Re: [NTG-context] Error while compiling : ! String contains
> 	an invalid utf-8 sequence.
> Message-ID:
> 	<CALBOmsYJRQenBGJdBKtv85RY=zuD_g7OyBMyW7hxXoXc6ZZ7rA@mail.gmail.com>
> Content-Type: text/plain; charset=UTF-8
> 
> 2011/11/26 Alexandre Krispin wrote:
>> Now that japanese display correctly, there is still another problem.
>> Japanese sentences (long titles in bibliography) don't break at the end of
>> line. I have tested the behavior of japanese with entire paragraphs, and I
>> get the same problem as in the bibliography, lines don't break and go
>> "through" the page.
>>
>> Though I have looked to documentation about chinese on the wiki, none helped
>> me to solve this problem. Does someone have any idea ?
> 
> My first guess is that ConTeXt doesn't know how to "hyphenate" / split
> words or sentences without space. I don't know what the Japanese
> typesetting rules are, but if nothing is implemented yet, it cannot
> work.
> 
> Mojca

I'm interested in Japanese to work as well... Should be easy - no
hyphenation, just split the word when the line is full and continue on
the next one. There are some more subtle rules for vertical typesetting
(e.g. full stops 。 and commas 、 hang over), but for horizontal
typesetting you'd just want to split the line anywhere...

Can that be done?

Severin

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

^ permalink raw reply	[flat|nested] 18+ messages in thread

* Re: Error while compiling : ! String contains an invalid utf-8 sequence.
  2011-11-28  7:08 ` Error while compiling : ! String contains an invalid utf-8 sequence S Barmeier
@ 2011-11-28  8:42   ` Alexandre Krispin
  2011-11-30 12:25     ` Alexandre Krispin
  0 siblings, 1 reply; 18+ messages in thread
From: Alexandre Krispin @ 2011-11-28  8:42 UTC (permalink / raw)
  To: mailing list for ConTeXt users


[-- Attachment #1.1: Type: text/plain, Size: 13396 bytes --]

Yes for sure, thanks to the script Wolfgang Schuster pointed out to me
earlier in the discussion :
\setscript[hanzi]

2011/11/28 S Barmeier <severinbarmeier@googlemail.com>

> On 11/27/2011 11:44 PM, ntg-context-request@ntg.nl wrote:
> > Send ntg-context mailing list submissions to
> >       ntg-context@ntg.nl
> >
> > To subscribe or unsubscribe via the World Wide Web, visit
> >       http://www.ntg.nl/mailman/listinfo/ntg-context
> > or, via email, send a message with subject or body 'help' to
> >       ntg-context-request@ntg.nl
> >
> > You can reach the person managing the list at
> >       ntg-context-owner@ntg.nl
> >
> > When replying, please edit your Subject line so it is more specific
> > than "Re: Contents of ntg-context digest..."
> >
> >
> > Today's Topics:
> >
> >    1. error with \showlayout and export (Henning Hraban Ramm)
> >    2. Re: error with \showlayout and export (Wolfgang Schuster)
> >    3. page number in margin (Henning Hraban Ramm)
> >    4. Export to epub (Keith McKay)
> >    5. Re: Error while compiling : ! String contains an invalid
> >       utf-8 sequence. (Mojca Miklavec)
> >    6. Re: Export to epub (Hans Hagen)
> >
> >
> > ----------------------------------------------------------------------
> >
> > Message: 1
> > Date: Sun, 27 Nov 2011 12:11:36 +0100
> > From: Henning Hraban Ramm <hraban@fiee.net>
> > To: mailing ConTeXt users list for <ntg-context@ntg.nl>
> > Subject: [NTG-context] error with \showlayout and export
> > Message-ID: <4670B7FC-970F-4698-B676-9F8C31AE8971@fiee.net>
> > Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes
> >
> > Hi wizards,
> >
> > if I use \showlayout in a project where I setup export=yes, ConTeXt
> > stops with a fatal error.
> >
> > Minimal failing example:
> >
> > \setupbackend[export=yes]
> > \starttext
> > \showlayout
> > \stoptext
> >
> >
> > Ixchel:konzept hraban$ context --purge context_test.tex
> >
> > mtx-context     | run 1: luatex --fmt="/Users/hraban/Library/texmf/tex/
> > texmf-cache/luatex-cache/context/2448223e6631addb83df348d74153606/
> > formats/cont-en" --lua="/Users/hraban/Library/texmf/tex/texmf-cache/
> > luatex-cache/context/2448223e6631addb83df348d74153606/formats/cont-
> > en.lui" --backend="pdf" "./context_test.tex" \stoptext
> > This is LuaTeX, Version beta-0.70.1-2011051908 (rev 4277)
> >   \write18 enabled.
> > (context_test.tex
> >
> > ConTeXt  ver: 2011.11.24 15:52 MKIV  fmt: 2011.11.25  int: english/
> > english
> >
> > system          > cont-new.mkiv loaded
> > (/Users/hraban/Library/texmf/tex/texmf-context/tex/context/base/cont-
> > new.mkiv
> > system          > beware: some patches loaded from cont-new.mkiv
> > )
> > system          > context_test.top loaded
> > (context_test.top)
> > fonts           > latin modern fonts are not preloaded
> > languages       > language en is active
> > backend         > export > enabling export to xml
> > {/Users/hraban/Library/texmf/tex/texmf-context/fonts/map/pdftex/
> > context/mkiv-base.map}
> > fonts           > preloading latin modern fonts (second stage)
> > (/Users/hraban/Library/texmf/tex/texmf-context/tex/context/base/type-
> > siz.mkiv) (/Users/hraban/Library/texmf/tex/texmf-context/tex/context/
> > base/type-otf.mkiv)
> > files           > readfile > asked name: 'loc', not found
> > {/Users/hraban/Library/texmf/tex/texmf-fonts/fonts/map/dvips/lm/lm-
> > math.map}{/Users/hraban/Library/texmf/tex/texmf-fonts/fonts/map/dvips/
> > lm/lm-rm.map}
> > fonts           > virtual math > unable to resolve name mapsfromchar
> > fonts           > fallback modern rm 12pt is loaded
> > (/Users/hraban/Library/texmf/tex/texmf-context/tex/context/base/page-
> > run.mkiv
> > loading         > ConTeXt Page Macros / Runtime Macros
> > )
> > interface       > initialization > loading interface definitions from
> > 'mult-def.lua'
> > interface       > initialization > loading interface messages from
> > 'mult-mes.lua'
> > metapost        > initializing instance 'metafun' using format 'metafun'
> > metapost        > loading 'metafun': /Users/hraban/Library/texmf/tex/
> > texmf-context/metapost/context/base/metafun.mpiv
> > backend         > xmp > using file '/Users/hraban/Library/texmf/tex/
> > texmf-context/tex/context/base/lpdf-pdx.xml'
> > pages           > flushing realpage 1, userpage 1, subpage 1
> > pages           > flushing realpage 2, userpage 2
> > pages           > flushing realpage 3, userpage 3
> > pages           > flushing realpage 4, userpage 4
> > pages           > flushing realpage 5, userpage 5
> >   )</Users/hraban/Library/texmf/tex/texmf/fonts/opentype/public/lm/
> > lmmono10-regular.otf></Users/hraban/Library/texmf/tex/texmf/fonts/
> > opentype/public/lm/lmmono12-regular.otf></Users/hraban/Library/texmf/
> > tex/texmf/fonts/opentype/public/lm/lmroman12-regular.otf>
> > ! LuaTeX error ...exmf/tex/texmf-context/tex/context/base/back-exp.lua:
> > 1203: attempt to index global 'c' (a nil value).
> >
> > system          > tex > error on line 0 in file : LuaTeX error  ...
> >
> > <empty file>
> >
> > <*> ./context_test.tex
> >                         \stoptext
> > ?
> >
> >
> >
> > Greetlings from Lake Constance!
> > Hraban
> > ---
> > http://www.fiee.net/texnique/
> > http://wiki.contextgarden.net
> > https://www.cacert.org (I'm an assurer)
> >
> >
> >
> > ------------------------------
> >
> > Message: 2
> > Date: Sun, 27 Nov 2011 12:35:10 +0100
> > From: Wolfgang Schuster <schuster.wolfgang@googlemail.com>
> > To: mailing list for ConTeXt users <ntg-context@ntg.nl>
> > Cc: Henning Hraban Ramm <hraban@fiee.net>
> > Subject: Re: [NTG-context] error with \showlayout and export
> > Message-ID: <0BCE3119-7D79-43B9-A159-62BC079800B1@googlemail.com>
> > Content-Type: text/plain; charset=us-ascii
> >
> >
> > Am 27.11.2011 um 12:11 schrieb Henning Hraban Ramm:
> >
> >> Hi wizards,
> >>
> >> if I use \showlayout in a project where I setup export=yes, ConTeXt
> stops with a fatal error.
> >>
> >> Minimal failing example:
> >>
> >> \setupbackend[export=yes]
> >> \starttext
> >> \showlayout
> >> \stoptext
> >
> > I think this change in back-exp.lua should work (runs at least without
> an error message):
> >
> > function extras.tabulate(result,element,detail,n,fulltag,di)
> >     local data = di.data
> >     for i=1,#data do
> >         local di = data[i]
> >         if di.tg == "tabulaterow" then
> >             local did = di.data
> >             local content = false
> >             for i=1,#did do
> >                 local d = did[i].data
> > --              local c = d and c.content
> >                 local c = d and d.content
> >                 if c and #c > 0 then
> >                     content = true
> >                     break
> >                 end
> >             end
> >             if not content then
> >                 di.element = "" -- or simply remove
> >             end
> >         end
> >     end
> > end
> >
> > Wolfgang
> >
> > ------------------------------
> >
> > Message: 3
> > Date: Sun, 27 Nov 2011 13:40:51 +0100
> > From: Henning Hraban Ramm <hraban@fiee.net>
> > To: mailing list for ConTeXt users <ntg-context@ntg.nl>
> > Subject: [NTG-context] page number in margin
> > Message-ID: <90A69805-BCEC-4A6C-BC89-5FA243C9C802@fiee.net>
> > Content-Type: text/plain; charset=WINDOWS-1252; format=flowed;
> >       delsp=yes
> >
> > Hi again,
> >
> > I?d like to get my page numbers in the margin.
> > This works:
> > \setuppagenumbering[alternative=doublesided,location=margin]
> >
> > But that way it?s on the bottom of the footer margin; I'd like it on
> > the top.
> >
> > Second variant: Even better, I?d like my page number at the bottom of
> > the text margin. How can I achieve that?
> >
> > location option "marginedge" doesn?t seem to do anything, as far as i
> > can tell, and "inright" is the same as "margin".
> >
> > Greetlings from Lake Constance!
> > Hraban
> > ---
> > http://www.fiee.net/texnique/
> > http://wiki.contextgarden.net
> > https://www.cacert.org (I'm an assurer)
> >
> >
> >
> > ------------------------------
> >
> > Message: 4
> > Date: Sun, 27 Nov 2011 13:03:28 +0000
> > From: Keith McKay <mckaymeister@gmail.com>
> > To: Ntg-Context <ntg-context@ntg.nl>
> > Subject: [NTG-context] Export to epub
> > Message-ID: <4ED23520.2070103@gmail.com>
> > Content-Type: text/plain; charset="iso-8859-1"; Format="flowed"
> >
> > Hi
> >
> > I've been playing about with Export in Context with a view to producing
> > ePubs.
> >
> > When I run the script:
> >
> > /mtxrun --script epub --make test.specification
> >
> > /the test.tree is prepared but no epub file.  The output shown below has
> > a couple or 'error' messages which are probably due to the way my text
> > editor is set up (Scite Version 2.02).  If anyone is using Scite and
> > producing ePubs I be grateful for some hints on how to set this up so
> > that inkscape and zip works.
> >
> > %%Script Output
> >
> > mtx-epub        | creating paths in tree test.tree
> > mtx-epub        | copying toc.ncx to test.tree/OPS/toc.ncx
> > mtx-epub        | copying test-styles.css to
> test.tree/OPS/test-styles.css
> > mtx-epub        | copying test-images.css to
> test.tree/OPS/test-images.css
> > mtx-epub        | copying test.css to test.tree/OPS/test.css
> > mtx-epub        | copying test.xhtml to test.tree/OPS/test.xhtml
> > mtx-epub        | running command 'inkscape --export-plain-svg=cow.svg
> > cow.pdf'
> >
> > 'inkscape' is not recognized as an internal or external command,
> > operable program or batch file.
> >
> > mtx-epub        | copying cow.svg to test.tree/OPS/cow.svg
> > mtx-epub        | copying hacker.jpg to test.tree/OPS/hacker.jpg
> > mtx-epub        | copying mill.png to test.tree/OPS/mill.png
> > mtx-epub        | creating archive
> >
> > 'zip' is not recognized as an internal or external command,
> > operable program or batch file.
> > 'zip' is not recognized as an internal or external command,
> > operable program or batch file.
> > 'zip' is not recognized as an internal or external command,
> > operable program or batch file.
> >
> > mtx-epub        | epub archive: test.tree/test.epub>Exit code: 0
> >
> > %%End Script Output
> >
> > I'm using Minimals ConTeXt  ver: 2011.09.27 20:05 MKIV  fmt: 2011.11.19
> > int: english/english on a Windows 7 machine and the test.tex file is the
> > |export-example.tex file renamed from the Minimals distribution|.
> >
> > Thanks
> > Keith McKay
> >
> > -------------- next part --------------
> > An HTML attachment was scrubbed...
> > URL: <
> http://www.ntg.nl/pipermail/ntg-context/attachments/20111127/f306eade/attachment-0001.html
> >
> >
> > ------------------------------
> >
> > Message: 5
> > Date: Sun, 27 Nov 2011 14:33:32 +0100
> > From: Mojca Miklavec <mojca.miklavec.lists@gmail.com>
> > To: mailing list for ConTeXt users <ntg-context@ntg.nl>
> > Subject: Re: [NTG-context] Error while compiling : ! String contains
> >       an invalid utf-8 sequence.
> > Message-ID:
> >       <CALBOmsYJRQenBGJdBKtv85RY=
> zuD_g7OyBMyW7hxXoXc6ZZ7rA@mail.gmail.com>
> > Content-Type: text/plain; charset=UTF-8
> >
> > 2011/11/26 Alexandre Krispin wrote:
> >> Now that japanese display correctly, there is still another problem.
> >> Japanese sentences (long titles in bibliography) don't break at the end
> of
> >> line. I have tested the behavior of japanese with entire paragraphs,
> and I
> >> get the same problem as in the bibliography, lines don't break and go
> >> "through" the page.
> >>
> >> Though I have looked to documentation about chinese on the wiki, none
> helped
> >> me to solve this problem. Does someone have any idea ?
> >
> > My first guess is that ConTeXt doesn't know how to "hyphenate" / split
> > words or sentences without space. I don't know what the Japanese
> > typesetting rules are, but if nothing is implemented yet, it cannot
> > work.
> >
> > Mojca
>
> I'm interested in Japanese to work as well... Should be easy - no
> hyphenation, just split the word when the line is full and continue on
> the next one. There are some more subtle rules for vertical typesetting
> (e.g. full stops 。 and commas 、 hang over), but for horizontal
> typesetting you'd just want to split the line anywhere...
>
> Can that be done?
>
> Severin
>
>
> ___________________________________________________________________________________
> If your question is of interest to others as well, please add an entry to
> the Wiki!
>
> maillist : ntg-context@ntg.nl /
> http://www.ntg.nl/mailman/listinfo/ntg-context
> webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
> archive  : http://foundry.supelec.fr/projects/contextrev/
> wiki     : http://contextgarden.net
>
> ___________________________________________________________________________________
>



-- 
------------------------------------------------------------------------------
Alexandre KRISPIN
41 rue Guynemer  |  93200 Saint-Denis  |  France
tél : 06 28 76 69 34  |  http://bijutsu.toile-libre.org
----------------------------------------------------------------------------

[-- Attachment #1.2: Type: text/html, Size: 18209 bytes --]

[-- Attachment #2: Type: text/plain, Size: 485 bytes --]

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

^ permalink raw reply	[flat|nested] 18+ messages in thread

* Re: Error while compiling : ! String contains an invalid utf-8 sequence.
  2011-11-28  8:42   ` Alexandre Krispin
@ 2011-11-30 12:25     ` Alexandre Krispin
  0 siblings, 0 replies; 18+ messages in thread
From: Alexandre Krispin @ 2011-11-30 12:25 UTC (permalink / raw)
  To: mailing list for ConTeXt users


[-- Attachment #1.1: Type: text/plain, Size: 20280 bytes --]

Hello,

I had no response for the problem related to the script "hanzi", and the
reason may be that I have done a mistake since I have sent a mail only to
Wolfgang Schuster and not to the mailing list.

So in case there would be a solution to solve the problem of misplaced dots
that the script "hanzi" caused, I copy-paste the mail I sent to Wolfgang
Schuster only instead of the mailing list by mistake :

The problem when I switch to the latin script for the bibliography is that
again, japanese words won't wrap, the long japanese titles will go
throughout the page, without going to the next line, as before. And if I
switch to the the hanzi script for the bibliography, japanese titles will
appear correctly, but dots will be misplaced. Some dots will be before the
parenthesis, others will be at the same after parenthesis but with a big
space between it.

Here are the tex and bib file which allow you to reproduce the problem :
%*****************************
*******************************************************************

\usemodule[simplefonts]
\setmainfont[Arno Pro]
\definesimplefonttypeface[jpn][HeiseiMinStd-W3]
%****************************************
\setupbibtex[database=biblio,sort=author]
\setuppublications[alternative=apa-fr,sorttype=bbl,refcommand=authoryear]
%****************************************
\setscript[hanzi] %if this script is turned on, japanese display is ok, but
dots won't  display correctly

\starttext
\completepublications[criterium=all]
\stoptext
%**************************************************************************************************

%**************************************************************************************************
@article{conrad1980transformation,
author = "Conrad Totman",
title = "From {S}akoku to {K}aikoku. {T}he {T}ransformation of
{F}oreign-{P}olicy
{A}ttitudes,
1853-1868",
journal = "Monumenta Nipponica",
year = 1980,
volume = 35,
number = 1,
pages = "1-19",
publisher = "Sophia University",
url = "http://www.jstor.org/stable/2384397",
}

@article{howse2002from,
author = "Robert Howse",
title = "From Politics to Technocracy-and Back Again: The Fate of the
Multilateral Trading Regime",
journal = "The American Journal of International Law",
volume = 96,
number = 1,
month = "January",
year = 2002,
pages = "94-117",
publisher = "American Society of International Law",
url = "http://www.jstor.org/stable/2686127",
}

@article{kato2011tpp,
author = "Katô, Fumiko {\jpn 加藤 文子}",
title = "{TPP} sanka giron wo meguru ikkôsatsu - Iryôbunya wo chûshin ni -
Ôbei no rôdô
shijô to no genjô wo fumaete {\jpn
TPP参加議論をめぐる一考察-医療分野を中心に-欧米の労働市場との現状比較をふまえて}
(Une réflexion sur les débats d'adhésion au {TPP}, centrée sur le champ
médical
-- Basée sur une comparaison du marché du travail actuel européen et
nord-américain)",
journal = "Jissen joshi daigaku ningen shakai gakubu kiyô {\jpn
実践女子大学人間社会学部紀要}",
month = "avril",
year = 2011,
pages = "77-88",
publisher = "Jissen joshi daigaku {\jpn 実践女子大学}",
url = "http://ci.nii.ac.jp/naid/110008431857/",
}

@article{kobrain1998mai,
author = "Stephen J. Kobrin",
title = {The {MAI} and the Clash of Globalizations},
journal = "Foreign Policy",
number = 112,
month = "Autumn",
year = 1998,
pages = "97-109",
publisher = "Washington Post Newsweek Interactive LLC",
url = "http://www.jstor.org/stable/1149038",
}

@article{ishihara2011tpp,
author = "Ishihara, Kenji {\jpn 石原健二}",
title = {{TPP} mondai to nihon
nôgyô {\jpn TPP問題と日本農業}(Le problème du {TPP} et l'agriculture
japonaise)},
journal = {Jichi sôken {\jpn 自治総研}},
volume = {392},
year = {2011},
month = {June},
pages = {38-58},
publisher = {Chihô jichi sôgô kenkyûjo {\jpn 地方自治総合研究所}},
url = {http://ci.nii.ac.jp/naid/110008454120/},
}

@article{ciccantell2001nafta,
author = "Paul Ciccantell",
title = "{NAFTA} and the Reconstruction of {U.S.} Hegemony: The Raw
Materials
Foundations of Economic Competitiveness",
publisher = "Canadian Journal of Sociology",
journal = "The Canadian Journal of Sociology",
year = 2001,
period = Winter,
volume = 26,
number = 1,
pages = "57-87",
url = "http://www.jstor.org/stable/3341511"
}

@article{robey1999civil,
author = "John S. Robey",
title = "Civil Society and {NAFTA}: Initial Results",
journal = "Annals of the American Academy of Political and Social Science",
publisher = "Sage Publications, Inc.",
year = 1999,
month = "September",
volume = 565,
pages = "113-125",
url = "http://www.jstor.org/stable/1049540"
}


@article{morales1999governance,
author = "Isidro Morales",
title = "{NAFTA}: The Governance of Economic Openness",
journal = "Annals of the American Academy of Political and Social Science",
publisher = "Sage Publications, Inc.",
year = 1999,
month = "September",
volume = 565,
pages = "35-65",
url = "http://www.jstor.org/stable/1049536"
}

@article{morales1999mexican,
author = "Isidro Morales",
title = "The Mexican Crisis and the Weakness of the {NAFTA} Consensus",
journal = "Annals of the American Academy of Political and Social Science",
publisher = "Sage Publications, Inc.",
year = 1997,
month = "March",
volume = 550,
pages = "130-152",
url = "http://www.jstor.org/stable/1047712"
}

@article{uzawa2011tpp,
author = "Hirofumi, Uzawa {\jpn 宇沢弘文} and Uchihashi, Katsuto {\jpn 内橋克人}",
journal = "Sekai {\jpn 世界}",

title = "Taidan {TPP} wa shakaiteki kyôtsû shihon wo hakai suru
{\jpn 対談TPPは社会的共通資本を破壊する} ({D}iscussion. Le {TPP} détruit le
capital social commun)",

year = 2011,
month = "april",
publisher = "Iwanami shoten {\jpn 岩波書店}",

pages = "62-72",
url = "http://ci.nii.ac.jp/naid/40018706510/",
}
%**************************************************************************************************

Cheers,
Alexandre Krispin

2011/11/28 Alexandre Krispin <k.m.alexandre@gmail.com>

> Yes for sure, thanks to the script Wolfgang Schuster pointed out to me
> earlier in the discussion :
> \setscript[hanzi]
>
>
> 2011/11/28 S Barmeier <severinbarmeier@googlemail.com>
>
>> On 11/27/2011 11:44 PM, ntg-context-request@ntg.nl wrote:
>> > Send ntg-context mailing list submissions to
>> >       ntg-context@ntg.nl
>> >
>> > To subscribe or unsubscribe via the World Wide Web, visit
>> >       http://www.ntg.nl/mailman/listinfo/ntg-context
>> > or, via email, send a message with subject or body 'help' to
>> >       ntg-context-request@ntg.nl
>> >
>> > You can reach the person managing the list at
>> >       ntg-context-owner@ntg.nl
>> >
>> > When replying, please edit your Subject line so it is more specific
>> > than "Re: Contents of ntg-context digest..."
>> >
>> >
>> > Today's Topics:
>> >
>> >    1. error with \showlayout and export (Henning Hraban Ramm)
>> >    2. Re: error with \showlayout and export (Wolfgang Schuster)
>> >    3. page number in margin (Henning Hraban Ramm)
>> >    4. Export to epub (Keith McKay)
>> >    5. Re: Error while compiling : ! String contains an invalid
>> >       utf-8 sequence. (Mojca Miklavec)
>> >    6. Re: Export to epub (Hans Hagen)
>> >
>> >
>> > ----------------------------------------------------------------------
>> >
>> > Message: 1
>> > Date: Sun, 27 Nov 2011 12:11:36 +0100
>> > From: Henning Hraban Ramm <hraban@fiee.net>
>> > To: mailing ConTeXt users list for <ntg-context@ntg.nl>
>> > Subject: [NTG-context] error with \showlayout and export
>> > Message-ID: <4670B7FC-970F-4698-B676-9F8C31AE8971@fiee.net>
>> > Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes
>> >
>> > Hi wizards,
>> >
>> > if I use \showlayout in a project where I setup export=yes, ConTeXt
>> > stops with a fatal error.
>> >
>> > Minimal failing example:
>> >
>> > \setupbackend[export=yes]
>> > \starttext
>> > \showlayout
>> > \stoptext
>> >
>> >
>> > Ixchel:konzept hraban$ context --purge context_test.tex
>> >
>> > mtx-context     | run 1: luatex --fmt="/Users/hraban/Library/texmf/tex/
>> > texmf-cache/luatex-cache/context/2448223e6631addb83df348d74153606/
>> > formats/cont-en" --lua="/Users/hraban/Library/texmf/tex/texmf-cache/
>> > luatex-cache/context/2448223e6631addb83df348d74153606/formats/cont-
>> > en.lui" --backend="pdf" "./context_test.tex" \stoptext
>> > This is LuaTeX, Version beta-0.70.1-2011051908 (rev 4277)
>> >   \write18 enabled.
>> > (context_test.tex
>> >
>> > ConTeXt  ver: 2011.11.24 15:52 MKIV  fmt: 2011.11.25  int: english/
>> > english
>> >
>> > system          > cont-new.mkiv loaded
>> > (/Users/hraban/Library/texmf/tex/texmf-context/tex/context/base/cont-
>> > new.mkiv
>> > system          > beware: some patches loaded from cont-new.mkiv
>> > )
>> > system          > context_test.top loaded
>> > (context_test.top)
>> > fonts           > latin modern fonts are not preloaded
>> > languages       > language en is active
>> > backend         > export > enabling export to xml
>> > {/Users/hraban/Library/texmf/tex/texmf-context/fonts/map/pdftex/
>> > context/mkiv-base.map}
>> > fonts           > preloading latin modern fonts (second stage)
>> > (/Users/hraban/Library/texmf/tex/texmf-context/tex/context/base/type-
>> > siz.mkiv) (/Users/hraban/Library/texmf/tex/texmf-context/tex/context/
>> > base/type-otf.mkiv)
>> > files           > readfile > asked name: 'loc', not found
>> > {/Users/hraban/Library/texmf/tex/texmf-fonts/fonts/map/dvips/lm/lm-
>> > math.map}{/Users/hraban/Library/texmf/tex/texmf-fonts/fonts/map/dvips/
>> > lm/lm-rm.map}
>> > fonts           > virtual math > unable to resolve name mapsfromchar
>> > fonts           > fallback modern rm 12pt is loaded
>> > (/Users/hraban/Library/texmf/tex/texmf-context/tex/context/base/page-
>> > run.mkiv
>> > loading         > ConTeXt Page Macros / Runtime Macros
>> > )
>> > interface       > initialization > loading interface definitions from
>> > 'mult-def.lua'
>> > interface       > initialization > loading interface messages from
>> > 'mult-mes.lua'
>> > metapost        > initializing instance 'metafun' using format 'metafun'
>> > metapost        > loading 'metafun': /Users/hraban/Library/texmf/tex/
>> > texmf-context/metapost/context/base/metafun.mpiv
>> > backend         > xmp > using file '/Users/hraban/Library/texmf/tex/
>> > texmf-context/tex/context/base/lpdf-pdx.xml'
>> > pages           > flushing realpage 1, userpage 1, subpage 1
>> > pages           > flushing realpage 2, userpage 2
>> > pages           > flushing realpage 3, userpage 3
>> > pages           > flushing realpage 4, userpage 4
>> > pages           > flushing realpage 5, userpage 5
>> >   )</Users/hraban/Library/texmf/tex/texmf/fonts/opentype/public/lm/
>> > lmmono10-regular.otf></Users/hraban/Library/texmf/tex/texmf/fonts/
>> > opentype/public/lm/lmmono12-regular.otf></Users/hraban/Library/texmf/
>> > tex/texmf/fonts/opentype/public/lm/lmroman12-regular.otf>
>> > ! LuaTeX error ...exmf/tex/texmf-context/tex/context/base/back-exp.lua:
>> > 1203: attempt to index global 'c' (a nil value).
>> >
>> > system          > tex > error on line 0 in file : LuaTeX error  ...
>> >
>> > <empty file>
>> >
>> > <*> ./context_test.tex
>> >                         \stoptext
>> > ?
>> >
>> >
>> >
>> > Greetlings from Lake Constance!
>> > Hraban
>> > ---
>> > http://www.fiee.net/texnique/
>> > http://wiki.contextgarden.net
>> > https://www.cacert.org (I'm an assurer)
>> >
>> >
>> >
>> > ------------------------------
>> >
>> > Message: 2
>> > Date: Sun, 27 Nov 2011 12:35:10 +0100
>> > From: Wolfgang Schuster <schuster.wolfgang@googlemail.com>
>> > To: mailing list for ConTeXt users <ntg-context@ntg.nl>
>> > Cc: Henning Hraban Ramm <hraban@fiee.net>
>> > Subject: Re: [NTG-context] error with \showlayout and export
>> > Message-ID: <0BCE3119-7D79-43B9-A159-62BC079800B1@googlemail.com>
>> > Content-Type: text/plain; charset=us-ascii
>> >
>> >
>> > Am 27.11.2011 um 12:11 schrieb Henning Hraban Ramm:
>> >
>> >> Hi wizards,
>> >>
>> >> if I use \showlayout in a project where I setup export=yes, ConTeXt
>> stops with a fatal error.
>> >>
>> >> Minimal failing example:
>> >>
>> >> \setupbackend[export=yes]
>> >> \starttext
>> >> \showlayout
>> >> \stoptext
>> >
>> > I think this change in back-exp.lua should work (runs at least without
>> an error message):
>> >
>> > function extras.tabulate(result,element,detail,n,fulltag,di)
>> >     local data = di.data
>> >     for i=1,#data do
>> >         local di = data[i]
>> >         if di.tg == "tabulaterow" then
>> >             local did = di.data
>> >             local content = false
>> >             for i=1,#did do
>> >                 local d = did[i].data
>> > --              local c = d and c.content
>> >                 local c = d and d.content
>> >                 if c and #c > 0 then
>> >                     content = true
>> >                     break
>> >                 end
>> >             end
>> >             if not content then
>> >                 di.element = "" -- or simply remove
>> >             end
>> >         end
>> >     end
>> > end
>> >
>> > Wolfgang
>> >
>> > ------------------------------
>> >
>> > Message: 3
>> > Date: Sun, 27 Nov 2011 13:40:51 +0100
>> > From: Henning Hraban Ramm <hraban@fiee.net>
>> > To: mailing list for ConTeXt users <ntg-context@ntg.nl>
>> > Subject: [NTG-context] page number in margin
>> > Message-ID: <90A69805-BCEC-4A6C-BC89-5FA243C9C802@fiee.net>
>> > Content-Type: text/plain; charset=WINDOWS-1252; format=flowed;
>> >       delsp=yes
>> >
>> > Hi again,
>> >
>> > I?d like to get my page numbers in the margin.
>> > This works:
>> > \setuppagenumbering[alternative=doublesided,location=margin]
>> >
>> > But that way it?s on the bottom of the footer margin; I'd like it on
>> > the top.
>> >
>> > Second variant: Even better, I?d like my page number at the bottom of
>> > the text margin. How can I achieve that?
>> >
>> > location option "marginedge" doesn?t seem to do anything, as far as i
>> > can tell, and "inright" is the same as "margin".
>> >
>> > Greetlings from Lake Constance!
>> > Hraban
>> > ---
>> > http://www.fiee.net/texnique/
>> > http://wiki.contextgarden.net
>> > https://www.cacert.org (I'm an assurer)
>> >
>> >
>> >
>> > ------------------------------
>> >
>> > Message: 4
>> > Date: Sun, 27 Nov 2011 13:03:28 +0000
>> > From: Keith McKay <mckaymeister@gmail.com>
>> > To: Ntg-Context <ntg-context@ntg.nl>
>> > Subject: [NTG-context] Export to epub
>> > Message-ID: <4ED23520.2070103@gmail.com>
>> > Content-Type: text/plain; charset="iso-8859-1"; Format="flowed"
>> >
>> > Hi
>> >
>> > I've been playing about with Export in Context with a view to producing
>> > ePubs.
>> >
>> > When I run the script:
>> >
>> > /mtxrun --script epub --make test.specification
>> >
>> > /the test.tree is prepared but no epub file.  The output shown below has
>> > a couple or 'error' messages which are probably due to the way my text
>> > editor is set up (Scite Version 2.02).  If anyone is using Scite and
>> > producing ePubs I be grateful for some hints on how to set this up so
>> > that inkscape and zip works.
>> >
>> > %%Script Output
>> >
>> > mtx-epub        | creating paths in tree test.tree
>> > mtx-epub        | copying toc.ncx to test.tree/OPS/toc.ncx
>> > mtx-epub        | copying test-styles.css to
>> test.tree/OPS/test-styles.css
>> > mtx-epub        | copying test-images.css to
>> test.tree/OPS/test-images.css
>> > mtx-epub        | copying test.css to test.tree/OPS/test.css
>> > mtx-epub        | copying test.xhtml to test.tree/OPS/test.xhtml
>> > mtx-epub        | running command 'inkscape --export-plain-svg=cow.svg
>> > cow.pdf'
>> >
>> > 'inkscape' is not recognized as an internal or external command,
>> > operable program or batch file.
>> >
>> > mtx-epub        | copying cow.svg to test.tree/OPS/cow.svg
>> > mtx-epub        | copying hacker.jpg to test.tree/OPS/hacker.jpg
>> > mtx-epub        | copying mill.png to test.tree/OPS/mill.png
>> > mtx-epub        | creating archive
>> >
>> > 'zip' is not recognized as an internal or external command,
>> > operable program or batch file.
>> > 'zip' is not recognized as an internal or external command,
>> > operable program or batch file.
>> > 'zip' is not recognized as an internal or external command,
>> > operable program or batch file.
>> >
>> > mtx-epub        | epub archive: test.tree/test.epub>Exit code: 0
>> >
>> > %%End Script Output
>> >
>> > I'm using Minimals ConTeXt  ver: 2011.09.27 20:05 MKIV  fmt: 2011.11.19
>> > int: english/english on a Windows 7 machine and the test.tex file is the
>> > |export-example.tex file renamed from the Minimals distribution|.
>> >
>> > Thanks
>> > Keith McKay
>> >
>> > -------------- next part --------------
>> > An HTML attachment was scrubbed...
>> > URL: <
>> http://www.ntg.nl/pipermail/ntg-context/attachments/20111127/f306eade/attachment-0001.html
>> >
>> >
>> > ------------------------------
>> >
>> > Message: 5
>> > Date: Sun, 27 Nov 2011 14:33:32 +0100
>> > From: Mojca Miklavec <mojca.miklavec.lists@gmail.com>
>> > To: mailing list for ConTeXt users <ntg-context@ntg.nl>
>> > Subject: Re: [NTG-context] Error while compiling : ! String contains
>> >       an invalid utf-8 sequence.
>> > Message-ID:
>> >       <CALBOmsYJRQenBGJdBKtv85RY=
>> zuD_g7OyBMyW7hxXoXc6ZZ7rA@mail.gmail.com>
>> > Content-Type: text/plain; charset=UTF-8
>> >
>> > 2011/11/26 Alexandre Krispin wrote:
>> >> Now that japanese display correctly, there is still another problem.
>> >> Japanese sentences (long titles in bibliography) don't break at the
>> end of
>> >> line. I have tested the behavior of japanese with entire paragraphs,
>> and I
>> >> get the same problem as in the bibliography, lines don't break and go
>> >> "through" the page.
>> >>
>> >> Though I have looked to documentation about chinese on the wiki, none
>> helped
>> >> me to solve this problem. Does someone have any idea ?
>> >
>> > My first guess is that ConTeXt doesn't know how to "hyphenate" / split
>> > words or sentences without space. I don't know what the Japanese
>> > typesetting rules are, but if nothing is implemented yet, it cannot
>> > work.
>> >
>> > Mojca
>>
>> I'm interested in Japanese to work as well... Should be easy - no
>> hyphenation, just split the word when the line is full and continue on
>> the next one. There are some more subtle rules for vertical typesetting
>> (e.g. full stops 。 and commas 、 hang over), but for horizontal
>> typesetting you'd just want to split the line anywhere...
>>
>> Can that be done?
>>
>> Severin
>>
>>
>> ___________________________________________________________________________________
>> If your question is of interest to others as well, please add an entry to
>> the Wiki!
>>
>> maillist : ntg-context@ntg.nl /
>> http://www.ntg.nl/mailman/listinfo/ntg-context
>> webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
>> archive  : http://foundry.supelec.fr/projects/contextrev/
>> wiki     : http://contextgarden.net
>>
>> ___________________________________________________________________________________
>>
>
>
>
> --
>
> ------------------------------------------------------------------------------
> Alexandre KRISPIN
> 41 rue Guynemer  |  93200 Saint-Denis  |  France
> tél : 06 28 76 69 34  |  http://bijutsu.toile-libre.org
>
> ----------------------------------------------------------------------------
>
>


-- 
------------------------------------------------------------------------------
Alexandre KRISPIN
41 rue Guynemer  |  93200 Saint-Denis  |  France
tél : 06 28 76 69 34  |  http://bijutsu.toile-libre.org
----------------------------------------------------------------------------

[-- Attachment #1.2: Type: text/html, Size: 27642 bytes --]

[-- Attachment #2: Type: text/plain, Size: 485 bytes --]

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

^ permalink raw reply	[flat|nested] 18+ messages in thread

* Re: Error while compiling : ! String contains an invalid utf-8 sequence.
  2011-12-07 16:37       ` Alexandre Krispin
@ 2011-12-07 17:45         ` Hans Hagen
  0 siblings, 0 replies; 18+ messages in thread
From: Hans Hagen @ 2011-12-07 17:45 UTC (permalink / raw)
  To: mailing list for ConTeXt users

On 7-12-2011 17:37, Alexandre Krispin wrote:
> Thank you for your answer !
>
> Finally I am back to Latex until this problem is fixed. Though I have no
> knowledge about it, it seemed to me that the problem I got was more related
> to hanzi script than to bibtex, since the final problem of misplaced dots I
> had appeared only with hanzi script.
>
> Hans Hagen did not replied to it. That's why I suppose that one day if this
> problem related to hanzi script becomes a problem of general interest,
> maybe it will be fixed...

As mentioned on this list using a unicode (utf) engine with bibtex is 
somewhat tricky. Interesting is that a similar problem occurred with 
url's: bibtex has hard coded line lengths and if I'm right there has 
been a fix that made lines wrap on spaces. However that does not help 
with scripts that have no spaces. Somewhat strange is that bibtex was 
not made compliant to other tex related programs in the sense that one 
can configure the line length (which we would then set to 1000 or so).

In spite of repeated announcements of bibtex 1.0 (which would probably 
not fix this issue anyway) it looks like the program is deep frozen. 
Unfortunately it also has frozen some conventions that make it hard to 
replace it.

Fixing it is probably something that an able programmer can do while 
watching a movie at the same time were it not that touching bibtex seems 
to be some kind of sacrilege.

I can imagine that someone makes a copy of bibtex, say ctxbibtex, 
patches it to accept long lines and that we ship that one with context.

Hans

-----------------------------------------------------------------
                                           Hans Hagen | PRAGMA ADE
               Ridderstraat 27 | 8061 GH Hasselt | The Netherlands
     tel: 038 477 53 69 | voip: 087 875 68 74 | www.pragma-ade.com
                                              | www.pragma-pod.nl
-----------------------------------------------------------------
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________


^ permalink raw reply	[flat|nested] 18+ messages in thread

* Re: Error while compiling : ! String contains an invalid utf-8 sequence.
  2011-12-07  8:28     ` Thomas A. Schmitz
@ 2011-12-07 16:37       ` Alexandre Krispin
  2011-12-07 17:45         ` Hans Hagen
  0 siblings, 1 reply; 18+ messages in thread
From: Alexandre Krispin @ 2011-12-07 16:37 UTC (permalink / raw)
  To: mailing list for ConTeXt users


[-- Attachment #1.1: Type: text/plain, Size: 1991 bytes --]

Thank you for your answer !

Finally I am back to Latex until this problem is fixed. Though I have no
knowledge about it, it seemed to me that the problem I got was more related
to hanzi script than to bibtex, since the final problem of misplaced dots I
had appeared only with hanzi script.

Hans Hagen did not replied to it. That's why I suppose that one day if this
problem related to hanzi script becomes a problem of general interest,
maybe it will be fixed...

Cheers,
Alexandre Krispin

2011/12/7 Thomas A. Schmitz <thomas.schmitz@uni-bonn.de>

> On 11/25/2011 09:09 PM, Hans Hagen wrote:
>
>> It makes me wonder how Thomas gets his greek etc done in bibtex.
>>
>
> To be quite honest: I rarely have more than a few words of Greek, and I
> wrap them up in \localgreek{} markup in my bibtex files, so I assume that's
> why I have never run into this problem. But it's another example to show
> that bibtex has huge problems outside of English (ASCII) range. It would be
> great if we could get rid of it ASAP...
>
> Thomas
>
> ______________________________**______________________________**
> _______________________
> If your question is of interest to others as well, please add an entry to
> the Wiki!
>
> maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/**
> listinfo/ntg-context <http://www.ntg.nl/mailman/listinfo/ntg-context>
> webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
> archive  : http://foundry.supelec.fr/**projects/contextrev/<http://foundry.supelec.fr/projects/contextrev/>
> wiki     : http://contextgarden.net
> ______________________________**______________________________**
> _______________________
>



-- 
------------------------------------------------------------------------------
Alexandre KRISPIN
41 rue Guynemer  |  93200 Saint-Denis  |  France
tél : 06 28 76 69 34  |  http://bijutsu.toile-libre.org
----------------------------------------------------------------------------

[-- Attachment #1.2: Type: text/html, Size: 2936 bytes --]

[-- Attachment #2: Type: text/plain, Size: 485 bytes --]

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

^ permalink raw reply	[flat|nested] 18+ messages in thread

* Re: Error while compiling : ! String contains an invalid utf-8 sequence.
  2011-11-25 20:09   ` Hans Hagen
  2011-11-25 22:13     ` Alexandre Krispin
  2011-11-25 23:56     ` Alexandre Krispin
@ 2011-12-07  8:28     ` Thomas A. Schmitz
  2011-12-07 16:37       ` Alexandre Krispin
  2 siblings, 1 reply; 18+ messages in thread
From: Thomas A. Schmitz @ 2011-12-07  8:28 UTC (permalink / raw)
  To: mailing list for ConTeXt users

On 11/25/2011 09:09 PM, Hans Hagen wrote:
> It makes me wonder how Thomas gets his greek etc done in bibtex.

To be quite honest: I rarely have more than a few words of Greek, and I 
wrap them up in \localgreek{} markup in my bibtex files, so I assume 
that's why I have never run into this problem. But it's another example 
to show that bibtex has huge problems outside of English (ASCII) range. 
It would be great if we could get rid of it ASAP...

Thomas
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________


^ permalink raw reply	[flat|nested] 18+ messages in thread

* Re: Error while compiling : ! String contains an invalid utf-8 sequence.
  2011-11-25 23:56     ` Alexandre Krispin
  2011-11-27 13:33       ` Mojca Miklavec
@ 2011-11-28  9:20       ` Wolfgang Schuster
  1 sibling, 0 replies; 18+ messages in thread
From: Wolfgang Schuster @ 2011-11-28  9:20 UTC (permalink / raw)
  To: mailing list for ConTeXt users


Am 26.11.2011 um 00:56 schrieb Alexandre Krispin:

> Now that japanese display correctly, there is still another problem. Japanese sentences (long titles in bibliography) don't break at the end of line. I have tested the behavior of japanese with entire paragraphs, and I get the same problem as in the bibliography, lines don't break and go "through" the page.

As I already told you need “\setscript[hanzi]” to enable linbreaks for chinese and japanese.

Instead of a global setting you can also write

\startscript[hanzi]
…
\stopscript

to enable linebreaking for a area.

Another valid form for \setscript[hanzi] is the command \hanzi which is a shortcut for the longer definition.

> Though I have looked to documentation about chinese on the wiki, none helped me to solve this problem. Does someone have any idea ?
> 
> Here is a minimal example with a paragraph sample in japanese :
> %%%%%%%%%beginning of file%%%%%%%%%%
> \usemodule[simplefonts]
> \setmainfont[HeiseiMinStd-W3]
> \definesimplefonttypeface[jpn][HeiseiMinStd-W3]
> \setupbodyfont[12pt]
> \setuptolerance[\v!verytolerant,\v!stretch]

Don’t use the “\v!” prefix for settings in your document, in this case it’s harmless but there can be cases
where you don’t get the expected result of this because in normal text “\v” is a command to place a accent
over the next character (here the “!”).

> \enableregime[utf]

This is not necessary because MkIV use UTF-8 by default.

> \usemodule[typearea]
> \setupTypeArea[bcor=30mm,alphabets=2.6,oneside]

You can’t mix keywords and assignments in the same argument of a setup command,
to use the onside option you have to write “oneside=yes”.

Wolfgang
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________


^ permalink raw reply	[flat|nested] 18+ messages in thread

* Re: Error while compiling : ! String contains an invalid utf-8 sequence.
  2011-11-27 13:33       ` Mojca Miklavec
@ 2011-11-27 16:13         ` Alexandre Krispin
  0 siblings, 0 replies; 18+ messages in thread
From: Alexandre Krispin @ 2011-11-27 16:13 UTC (permalink / raw)
  To: mailing list for ConTeXt users


[-- Attachment #1.1: Type: text/plain, Size: 1770 bytes --]

Thank you !

But with the scripts for chinese characters, I got the expected result :)

Cheers,
Alexandre Krispin

2011/11/27 Mojca Miklavec <mojca.miklavec.lists@gmail.com>

> 2011/11/26 Alexandre Krispin wrote:
> > Now that japanese display correctly, there is still another problem.
> > Japanese sentences (long titles in bibliography) don't break at the end
> of
> > line. I have tested the behavior of japanese with entire paragraphs, and
> I
> > get the same problem as in the bibliography, lines don't break and go
> > "through" the page.
> >
> > Though I have looked to documentation about chinese on the wiki, none
> helped
> > me to solve this problem. Does someone have any idea ?
>
> My first guess is that ConTeXt doesn't know how to "hyphenate" / split
> words or sentences without space. I don't know what the Japanese
> typesetting rules are, but if nothing is implemented yet, it cannot
> work.
>
> Mojca
>
> ___________________________________________________________________________________
> If your question is of interest to others as well, please add an entry to
> the Wiki!
>
> maillist : ntg-context@ntg.nl /
> http://www.ntg.nl/mailman/listinfo/ntg-context
> webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
> archive  : http://foundry.supelec.fr/projects/contextrev/
> wiki     : http://contextgarden.net
>
> ___________________________________________________________________________________
>



-- 
------------------------------------------------------------------------------
Alexandre KRISPIN
41 rue Guynemer  |  93200 Saint-Denis  |  France
tél : 06 28 76 69 34  |  http://bijutsu.toile-libre.org
----------------------------------------------------------------------------

[-- Attachment #1.2: Type: text/html, Size: 2729 bytes --]

[-- Attachment #2: Type: text/plain, Size: 485 bytes --]

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

^ permalink raw reply	[flat|nested] 18+ messages in thread

* Re: Error while compiling : ! String contains an invalid utf-8 sequence.
  2011-11-25 23:56     ` Alexandre Krispin
@ 2011-11-27 13:33       ` Mojca Miklavec
  2011-11-27 16:13         ` Alexandre Krispin
  2011-11-28  9:20       ` Wolfgang Schuster
  1 sibling, 1 reply; 18+ messages in thread
From: Mojca Miklavec @ 2011-11-27 13:33 UTC (permalink / raw)
  To: mailing list for ConTeXt users

2011/11/26 Alexandre Krispin wrote:
> Now that japanese display correctly, there is still another problem.
> Japanese sentences (long titles in bibliography) don't break at the end of
> line. I have tested the behavior of japanese with entire paragraphs, and I
> get the same problem as in the bibliography, lines don't break and go
> "through" the page.
>
> Though I have looked to documentation about chinese on the wiki, none helped
> me to solve this problem. Does someone have any idea ?

My first guess is that ConTeXt doesn't know how to "hyphenate" / split
words or sentences without space. I don't know what the Japanese
typesetting rules are, but if nothing is implemented yet, it cannot
work.

Mojca
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________


^ permalink raw reply	[flat|nested] 18+ messages in thread

* Re: Error while compiling : ! String contains an invalid utf-8 sequence.
  2011-11-26 11:39     ` Wolfgang Schuster
@ 2011-11-26 11:41       ` Alexandre Krispin
  0 siblings, 0 replies; 18+ messages in thread
From: Alexandre Krispin @ 2011-11-26 11:41 UTC (permalink / raw)
  To: mailing list for ConTeXt users


[-- Attachment #1.1: Type: text/plain, Size: 1551 bytes --]

Thanks ! It worked perfectly !

Cheers,
Alexandre Krispin

2011/11/26 Wolfgang Schuster <schuster.wolfgang@googlemail.com>

>
> Am 26.11.2011 um 11:44 schrieb Alexandre Krispin:
>
> > Now that japanese display correctly, there is still another problem.
> Japanese sentences (long titles in bibliography) don't break at the end of
> line. I have tested the behavior of japanese with entire paragraphs, and I
> get the same problem as in the bibliography, lines don't break and go
> "through" the page.
> >
> > Though I have looked to documentation about chinese on the wiki, none
> helped me to solve this problem. Does someone have any idea ?
>
> Add “\setscript[hanzi]” to your document.
>
> Wolfgang
>
>
> ___________________________________________________________________________________
> If your question is of interest to others as well, please add an entry to
> the Wiki!
>
> maillist : ntg-context@ntg.nl /
> http://www.ntg.nl/mailman/listinfo/ntg-context
> webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
> archive  : http://foundry.supelec.fr/projects/contextrev/
> wiki     : http://contextgarden.net
>
> ___________________________________________________________________________________
>



-- 
------------------------------------------------------------------------------
Alexandre KRISPIN
41 rue Guynemer  |  93200 Saint-Denis  |  France
tél : 06 28 76 69 34  |  http://bijutsu.toile-libre.org
----------------------------------------------------------------------------

[-- Attachment #1.2: Type: text/html, Size: 2464 bytes --]

[-- Attachment #2: Type: text/plain, Size: 485 bytes --]

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

^ permalink raw reply	[flat|nested] 18+ messages in thread

* Re: Error while compiling : ! String contains an invalid utf-8 sequence.
  2011-11-26 10:44   ` Alexandre Krispin
@ 2011-11-26 11:39     ` Wolfgang Schuster
  2011-11-26 11:41       ` Alexandre Krispin
  0 siblings, 1 reply; 18+ messages in thread
From: Wolfgang Schuster @ 2011-11-26 11:39 UTC (permalink / raw)
  To: mailing list for ConTeXt users


Am 26.11.2011 um 11:44 schrieb Alexandre Krispin:

> Now that japanese display correctly, there is still another problem. Japanese sentences (long titles in bibliography) don't break at the end of line. I have tested the behavior of japanese with entire paragraphs, and I get the same problem as in the bibliography, lines don't break and go "through" the page.
> 
> Though I have looked to documentation about chinese on the wiki, none helped me to solve this problem. Does someone have any idea ?

Add “\setscript[hanzi]” to your document.

Wolfgang

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________


^ permalink raw reply	[flat|nested] 18+ messages in thread

* Re: Error while compiling : ! String contains an invalid utf-8 sequence.
  2011-11-26  9:35 ` Ulrike Fischer
@ 2011-11-26 10:44   ` Alexandre Krispin
  2011-11-26 11:39     ` Wolfgang Schuster
  0 siblings, 1 reply; 18+ messages in thread
From: Alexandre Krispin @ 2011-11-26 10:44 UTC (permalink / raw)
  To: news3, mailing list for ConTeXt users


[-- Attachment #1.1: Type: text/plain, Size: 7901 bytes --]

Thanks Ulrike ! It seems the 2 messages I sent yesterday have been lost (I
have received a mail which might point out a delivery failure from the
mailing list) though it is written I don't need to send again the message,
in case, here is the copy of mails I sent. Now the only problem remaining
is that japanese sentences are not wrapped (long titles of books go through
the page). And though I took a look to documentation about chinese, I don't
know what I am missing.

*******************************************Beginning of first
mail********************************************************

Hello,

Thanks to all for your answers !

Finally, thanks to an article dealing about Xelatex, bibtex files and utf-8
problem (see
http://skalldan.wordpress.com/2011/08/01/%E3%82%A4%E3%83%B3%E3%83%89%E5%AD%A6%E4%BB%8F%E6%95%99%E5%AD%A6%E3%81%AB%E3%81%8A%E3%81%91%E3%82%8B-utf-8-%E3%81%AB%E3%82%88%E3%82%8B-tex-%E6%96%87%E6%9B%B8%E4%BD%9C%E6%88%90-4/)
I got the idea how to solve my problem.

In the bib file I have surrounded all japanese words by {\jpn }, like in
this minimal example :
%%%%%%%%%beginning of the example%%%%%%%%%%%
@article{uzawa2011tpp,
author = "Hirofumi Uzawa {\jpn 宇沢弘文}, Uchihashi Katsuto {\jpn 内橋克人}",
journal = "Sekai {\jpn 世界}",

title = "Taidan TPP wa shakaiteki kyôtsû shihon wo hakai suru

{\jpn 対談TPPは社会的共通資本を破壊する}",

year = 2011,
month = "april",

publisher = "Iwanami shoten {\jpn 岩波書店}",

pages = "62-72",
url = "http://ci.nii.ac.jp/naid/40018706510/",

note = "test"
}
%%%%%%%%%%%%end of file%%%%%%%%%%%%%%

Then, thanks to the documentation for simplefonts I have introduced a
typeface definition, like in this minimal example :

%%%%%%%%%%beginning of file%%%%%%%%%%%%%
\usemodule[simplefonts]
\setmainfont[Arno Pro]
\definesimplefonttypeface[jpn]
[hiraginokakugothicpro]

\enableregime[utf8]

\setupbibtex[database=biblio]

\starttext

test
\completepublications[criterium=all]
{\jpn 知らない  金 11月 25, 2011  10:21午後}
\stoptext

%%%%%%%%%%end of file%%%%%%%%%%%%%%%

And everything works well when compiling the whole with "context *tex".

The only question remaining in my mind is : is there another way ? Just out
of curiosity, since Hans Hagen mentioned "Thomas" who use greek.

*******************************************End of first
mail********************************************************

And the second mail :

*******************************************Beginning of second
mail********************************************************
Now that japanese display correctly, there is still another problem.
Japanese sentences (long titles in bibliography) don't break at the end of
line. I have tested the behavior of japanese with entire paragraphs, and I
get the same problem as in the bibliography, lines don't break and go
"through" the page.

Though I have looked to documentation about chinese on the wiki, none
helped me to solve this problem. Does someone have any idea ?

Here is a minimal example with a paragraph sample in japanese :
%%%%%%%%%beginning of file%%%%%%%%%%
\usemodule[simplefonts]
\setmainfont[HeiseiMinStd-W3]
\definesimplefonttypeface[jpn]
[HeiseiMinStd-W3]
\setupbodyfont[12pt]
\setuptolerance[\v!verytolerant,\v!stretch]
\enableregime[utf]

\usemodule[typearea]
\setupTypeArea[bcor=30mm,alphabets=2.6,oneside]
%*********************************
\starttext

そしてディズニー原理主義で考えた場合、「一秒24コマの絵」で作るフルアニメが至上。そのルールに照らした場合、「電脳コイル」より「らき☆すた(ハルヒ)」の方が優れている。
ニョロニョロと滑らかに動く。つまりそれだけ動画枚数を多く使ってる。よりフルアニメに近い。よって「電脳コイル<らき☆すた」となる。

コレに作画マニアは反論する。アニメは「アニメーターのスキル」こそが最も重要。「スキル>作画枚数」、だから優れたアニメーターである磯光雄の手掛けた電脳コイルのほうが偉い。
じゃあ磯光雄がフルアニメにしたら?今の2コマ3コマ打ちの磯光雄より偉いの?より優れてるの?

>フルアニメの磯光雄の方が優れている。
この場合、「リミテッドアニメという制約の中で独自の進化をした日本アニメのアイデンティティ」というのが無くなってしまう。「らき☆すた」には勝てるがファンタジアには負ける。
>2、3コマ打ちのリミテッドの磯光雄の方が優れている。
質としては等価(磯光雄の原画)でより量のあるフルアニメよりもリミテッドアニメの方が優れてる、その理由を言語化する必要がある。

じゃあ、そのリミテッドで手に入れた価値とは何?
例えば「フルアニメと同じ価値をリミテッド(より少ない動画枚数=コスト)で作れるという『省エネ』の部分にある」ってこと?ソレだと新たな創作的価値を別に産み出してないよね。
そうでないのなら動きの質がディズニーとはどう違うの?
\stoptext
%%%%%%%%%end of file%%%%%%%%%%%%%

I attach the corresponding pdf file I obtain after compilation.

*******************************************End of second
mail********************************************************


2011/11/26 Ulrike Fischer <news3@nililand.de>

> Am Fri, 25 Nov 2011 19:50:52 +0100 schrieb Alexandre Krispin:
>
> > Hello,
> >
> > I am trying to get japanese displayed in bibliography. But I get the
> error
> > "! String contains an invalid utf-8 sequence." while compiling with the
> > command "context *tex".
>
> > And here is the bib file :
> >
> > %%%%%%%%%%%%%%%beginning of file%%%%%%%
> > @article{uzawa2011tpp,
> > author = "Hirofumi Uzawa 宇沢弘文, Uchihashi Katsuto 内橋克人",
> > journal = "Sekai 世界",
> > title = "Taidan TPP wa shakaiteki kyôtsû shihon wo hakai suru
> > 対談TPPは社会的共通資本を破壊する",
> > year = 2011,
> > month = "april",
> > publisher = "Iwanami shoten 岩波書店",
> > pages = "62-72",
> > url = "http://ci.nii.ac.jp/naid/40018706510/",
> > }
> > %%%%%%%%%%%%%%%end of file%%%%%%%%%%
> >
> > Do someone know how to get ride of utf-8 errors ? Or is this a problem
> with
> > bibtex,
>
> Yes. bibtex is an 8-bit application. Your japanese characters
> consist of three or four 8-bit-blocks. As bibtex has no knowledge
> that these blocks should be keeped together it can happen that
> bibtex breaks them in pieces e.g. at line ends and so you end with
> invalid utf8. You could try to move the blocks a bit around e.g.
> with braces or spaces so that bibtex finds a break point between the
> utf8-chars and not in the middle of one of them.
>
>
> > and then should I use anything else to replace it ?
> > (does something like Biber work ?)
>
> Well in latex with biblatex it works and is the recommended
> solution. But I don't know if context supports biber.
>
>
> --
> Ulrike Fischer
>
>
> ___________________________________________________________________________________
> If your question is of interest to others as well, please add an entry to
> the Wiki!
>
> maillist : ntg-context@ntg.nl /
> http://www.ntg.nl/mailman/listinfo/ntg-context
> webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
> archive  : http://foundry.supelec.fr/projects/contextrev/
> wiki     : http://contextgarden.net
>
> ___________________________________________________________________________________
>



-- 
------------------------------------------------------------------------------
Alexandre KRISPIN
41 rue Guynemer  |  93200 Saint-Denis  |  France
tél : 06 28 76 69 34  |  http://bijutsu.toile-libre.org
----------------------------------------------------------------------------

[-- Attachment #1.2: Type: text/html, Size: 9875 bytes --]

[-- Attachment #2: Type: text/plain, Size: 485 bytes --]

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

^ permalink raw reply	[flat|nested] 18+ messages in thread

* Re: Error while compiling : ! String contains an invalid utf-8 sequence.
  2011-11-25 18:50 Alexandre Krispin
  2011-11-25 19:03 ` Christian
@ 2011-11-26  9:35 ` Ulrike Fischer
  2011-11-26 10:44   ` Alexandre Krispin
  1 sibling, 1 reply; 18+ messages in thread
From: Ulrike Fischer @ 2011-11-26  9:35 UTC (permalink / raw)
  To: ntg-context

Am Fri, 25 Nov 2011 19:50:52 +0100 schrieb Alexandre Krispin:

> Hello,
> 
> I am trying to get japanese displayed in bibliography. But I get the error
> "! String contains an invalid utf-8 sequence." while compiling with the
> command "context *tex".

> And here is the bib file :
> 
> %%%%%%%%%%%%%%%beginning of file%%%%%%%
> @article{uzawa2011tpp,
> author = "Hirofumi Uzawa 宇沢弘文, Uchihashi Katsuto 内橋克人",
> journal = "Sekai 世界",
> title = "Taidan TPP wa shakaiteki kyôtsû shihon wo hakai suru
> 対談TPPは社会的共通資本を破壊する",
> year = 2011,
> month = "april",
> publisher = "Iwanami shoten 岩波書店",
> pages = "62-72",
> url = "http://ci.nii.ac.jp/naid/40018706510/",
> }
> %%%%%%%%%%%%%%%end of file%%%%%%%%%%
> 
> Do someone know how to get ride of utf-8 errors ? Or is this a problem with
> bibtex, 

Yes. bibtex is an 8-bit application. Your japanese characters
consist of three or four 8-bit-blocks. As bibtex has no knowledge
that these blocks should be keeped together it can happen that
bibtex breaks them in pieces e.g. at line ends and so you end with
invalid utf8. You could try to move the blocks a bit around e.g.
with braces or spaces so that bibtex finds a break point between the
utf8-chars and not in the middle of one of them. 


> and then should I use anything else to replace it ?
> (does something like Biber work ?)

Well in latex with biblatex it works and is the recommended
solution. But I don't know if context supports biber. 


-- 
Ulrike Fischer 

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

^ permalink raw reply	[flat|nested] 18+ messages in thread

* Re: Error while compiling : ! String contains an invalid utf-8 sequence.
  2011-11-25 20:09   ` Hans Hagen
  2011-11-25 22:13     ` Alexandre Krispin
@ 2011-11-25 23:56     ` Alexandre Krispin
  2011-11-27 13:33       ` Mojca Miklavec
  2011-11-28  9:20       ` Wolfgang Schuster
  2011-12-07  8:28     ` Thomas A. Schmitz
  2 siblings, 2 replies; 18+ messages in thread
From: Alexandre Krispin @ 2011-11-25 23:56 UTC (permalink / raw)
  To: mailing list for ConTeXt users


[-- Attachment #1.1: Type: text/plain, Size: 4636 bytes --]

Now that japanese display correctly, there is still another problem.
Japanese sentences (long titles in bibliography) don't break at the end of
line. I have tested the behavior of japanese with entire paragraphs, and I
get the same problem as in the bibliography, lines don't break and go
"through" the page.

Though I have looked to documentation about chinese on the wiki, none
helped me to solve this problem. Does someone have any idea ?

Here is a minimal example with a paragraph sample in japanese :
%%%%%%%%%beginning of file%%%%%%%%%%
\usemodule[simplefonts]
\setmainfont[HeiseiMinStd-W3]
\definesimplefonttypeface[jpn][HeiseiMinStd-W3]
\setupbodyfont[12pt]
\setuptolerance[\v!verytolerant,\v!stretch]
\enableregime[utf]

\usemodule[typearea]
\setupTypeArea[bcor=30mm,alphabets=2.6,oneside]
%*********************************
\starttext

そしてディズニー原理主義で考えた場合、「一秒24コマの絵」で作るフルアニメが至上。そのルールに照らした場合、「電脳コイル」より「らき☆すた(ハルヒ)」の方が優れている。
ニョロニョロと滑らかに動く。つまりそれだけ動画枚数を多く使ってる。よりフルアニメに近い。よって「電脳コイル<らき☆すた」となる。

コレに作画マニアは反論する。アニメは「アニメーターのスキル」こそが最も重要。「スキル>作画枚数」、だから優れたアニメーターである磯光雄の手掛けた電脳コイルのほうが偉い。
じゃあ磯光雄がフルアニメにしたら?今の2コマ3コマ打ちの磯光雄より偉いの?より優れてるの?

>フルアニメの磯光雄の方が優れている。
この場合、「リミテッドアニメという制約の中で独自の進化をした日本アニメのアイデンティティ」というのが無くなってしまう。「らき☆すた」には勝てるがファンタジアには負ける。
>2、3コマ打ちのリミテッドの磯光雄の方が優れている。
質としては等価(磯光雄の原画)でより量のあるフルアニメよりもリミテッドアニメの方が優れてる、その理由を言語化する必要がある。

じゃあ、そのリミテッドで手に入れた価値とは何?
例えば「フルアニメと同じ価値をリミテッド(より少ない動画枚数=コスト)で作れるという『省エネ』の部分にある」ってこと?ソレだと新たな創作的価値を別に産み出してないよね。
そうでないのなら動きの質がディズニーとはどう違うの?
\stoptext
%%%%%%%%%end of file%%%%%%%%%%%%%

I attach the corresponding pdf file I obtain after compilation.

2011/11/25 Hans Hagen <pragma@wxs.nl>

> On 25-11-2011 20:03, Christian wrote:
>
>  Same here. It messes up when converting .bib to .bbl. Maybe check your
>> bbl file, too. Mine looks like this, for example:
>> a={{Hirofumi Uzawa~宇沢弘文}}
>>
>> You could try to write the .bbl file directly yourself, although that is
>> not a comfortable option, if you have many Japanese entries.
>> Apart from that there's not much coming to mind.
>>
>
> It makes me wonder how Thomas gets his greek etc done in bibtex.
>
> Hans
>
>
> ------------------------------**------------------------------**-----
>                                          Hans Hagen | PRAGMA ADE
>              Ridderstraat 27 | 8061 GH Hasselt | The Netherlands
>    tel: 038 477 53 69 | voip: 087 875 68 74 | www.pragma-ade.com
>                                             | www.pragma-pod.nl
> ------------------------------**------------------------------**-----
>
> ______________________________**______________________________**
> _______________________
> If your question is of interest to others as well, please add an entry to
> the Wiki!
>
> maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/**
> listinfo/ntg-context <http://www.ntg.nl/mailman/listinfo/ntg-context>
> webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
> archive  : http://foundry.supelec.fr/**projects/contextrev/<http://foundry.supelec.fr/projects/contextrev/>
> wiki     : http://contextgarden.net
> ______________________________**______________________________**
> _______________________
>



-- 
------------------------------------------------------------------------------
Alexandre KRISPIN
41 rue Guynemer  |  93200 Saint-Denis  |  France
tél : 06 28 76 69 34  |  http://bijutsu.toile-libre.org
----------------------------------------------------------------------------

[-- Attachment #1.2: Type: text/html, Size: 6032 bytes --]

[-- Attachment #2: biblio.pdf --]
[-- Type: application/pdf, Size: 42897 bytes --]

[-- Attachment #3: Type: text/plain, Size: 485 bytes --]

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

^ permalink raw reply	[flat|nested] 18+ messages in thread

* Re: Error while compiling : ! String contains an invalid utf-8 sequence.
  2011-11-25 20:09   ` Hans Hagen
@ 2011-11-25 22:13     ` Alexandre Krispin
  2011-11-25 23:56     ` Alexandre Krispin
  2011-12-07  8:28     ` Thomas A. Schmitz
  2 siblings, 0 replies; 18+ messages in thread
From: Alexandre Krispin @ 2011-11-25 22:13 UTC (permalink / raw)
  To: mailing list for ConTeXt users


[-- Attachment #1.1: Type: text/plain, Size: 3645 bytes --]

Hello,

Thanks to all for your answers !

Finally, thanks to an article dealing about Xelatex, bibtex files and utf-8
problem (see
http://skalldan.wordpress.com/2011/08/01/%E3%82%A4%E3%83%B3%E3%83%89%E5%AD%A6%E4%BB%8F%E6%95%99%E5%AD%A6%E3%81%AB%E3%81%8A%E3%81%91%E3%82%8B-utf-8-%E3%81%AB%E3%82%88%E3%82%8B-tex-%E6%96%87%E6%9B%B8%E4%BD%9C%E6%88%90-4/)
I got the idea how to solve my problem.

In the bib file I have surrounded all japanese words by {\jpn }, like in
this minimal example :
%%%%%%%%%beginning of the example%%%%%%%%%%%
@article{uzawa2011tpp,
author = "Hirofumi Uzawa {\jpn 宇沢弘文}, Uchihashi Katsuto {\jpn 内橋克人}",
journal = "Sekai {\jpn 世界}",
title = "Taidan TPP wa shakaiteki kyôtsû shihon wo hakai suru
{\jpn 対談TPPは社会的共通資本を破壊する}",
year = 2011,
month = "april",
publisher = "Iwanami shoten {\jpn 岩波書店}",
pages = "62-72",
url = "http://ci.nii.ac.jp/naid/40018706510/",
note = "test"
}
%%%%%%%%%%%%end of file%%%%%%%%%%%%%%

Then, thanks to the documentation for simplefonts I have introduced a
typeface definition, like in this minimal example :

%%%%%%%%%%beginning of file%%%%%%%%%%%%%
\usemodule[simplefonts]
\setmainfont[Arno Pro]
\definesimplefonttypeface[jpn][hiraginokakugothicpro]
\enableregime[utf8]

\setupbibtex[database=biblio]

\starttext
test
\completepublications[criterium=all]
{\jpn 知らない  金 11月 25, 2011  10:21午後}
\stoptext

%%%%%%%%%%end of file%%%%%%%%%%%%%%%

And everything works well when compiling the whole with "context *tex".

The only question remaining in my mind is : is there another way ? Just out
of curiosity, since Hans Hagen mentioned "Thomas" who use greek.


2011/11/25 Hans Hagen <pragma@wxs.nl>

> On 25-11-2011 20:03, Christian wrote:
>
>  Same here. It messes up when converting .bib to .bbl. Maybe check your
>> bbl file, too. Mine looks like this, for example:
>> a={{Hirofumi Uzawa~宇沢弘文}}
>>
>> You could try to write the .bbl file directly yourself, although that is
>> not a comfortable option, if you have many Japanese entries.
>> Apart from that there's not much coming to mind.
>>
>
> It makes me wonder how Thomas gets his greek etc done in bibtex.
>
> Hans
>
>
> ------------------------------**------------------------------**-----
>                                          Hans Hagen | PRAGMA ADE
>              Ridderstraat 27 | 8061 GH Hasselt | The Netherlands
>    tel: 038 477 53 69 | voip: 087 875 68 74 | www.pragma-ade.com
>                                             | www.pragma-pod.nl
> ------------------------------**------------------------------**-----
>
> ______________________________**______________________________**
> _______________________
> If your question is of interest to others as well, please add an entry to
> the Wiki!
>
> maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/**
> listinfo/ntg-context <http://www.ntg.nl/mailman/listinfo/ntg-context>
> webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
> archive  : http://foundry.supelec.fr/**projects/contextrev/<http://foundry.supelec.fr/projects/contextrev/>
> wiki     : http://contextgarden.net
> ______________________________**______________________________**
> _______________________
>



-- 
------------------------------------------------------------------------------
Alexandre KRISPIN
41 rue Guynemer  |  93200 Saint-Denis  |  France
tél : 06 28 76 69 34  |  http://bijutsu.toile-libre.org
----------------------------------------------------------------------------

[-- Attachment #1.2: Type: text/html, Size: 5324 bytes --]

[-- Attachment #2: Type: text/plain, Size: 485 bytes --]

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

^ permalink raw reply	[flat|nested] 18+ messages in thread

* Re: Error while compiling : ! String contains an invalid utf-8 sequence.
  2011-11-25 19:03 ` Christian
@ 2011-11-25 20:09   ` Hans Hagen
  2011-11-25 22:13     ` Alexandre Krispin
                       ` (2 more replies)
  0 siblings, 3 replies; 18+ messages in thread
From: Hans Hagen @ 2011-11-25 20:09 UTC (permalink / raw)
  To: mailing list for ConTeXt users

On 25-11-2011 20:03, Christian wrote:

> Same here. It messes up when converting .bib to .bbl. Maybe check your bbl file, too. Mine looks like this, for example:
> a={{Hirofumi Uzawa~宇沢弘文}}
>
> You could try to write the .bbl file directly yourself, although that is not a comfortable option, if you have many Japanese entries.
> Apart from that there's not much coming to mind.

It makes me wonder how Thomas gets his greek etc done in bibtex.

Hans


-----------------------------------------------------------------
                                           Hans Hagen | PRAGMA ADE
               Ridderstraat 27 | 8061 GH Hasselt | The Netherlands
     tel: 038 477 53 69 | voip: 087 875 68 74 | www.pragma-ade.com
                                              | www.pragma-pod.nl
-----------------------------------------------------------------
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

^ permalink raw reply	[flat|nested] 18+ messages in thread

* Re: Error while compiling : ! String contains an invalid utf-8 sequence.
  2011-11-25 18:50 Alexandre Krispin
@ 2011-11-25 19:03 ` Christian
  2011-11-25 20:09   ` Hans Hagen
  2011-11-26  9:35 ` Ulrike Fischer
  1 sibling, 1 reply; 18+ messages in thread
From: Christian @ 2011-11-25 19:03 UTC (permalink / raw)
  To: 'mailing list for ConTeXt users'

> I am trying to get japanese displayed in bibliography. But I get the error "!
> String contains an invalid utf-8 sequence." while compiling with the command
> "context *tex".
> 
> Here is the tex file :
> 
> %%%%%%%%%%%%%%%beginning of file%%%%%%
> \usemodule[simplefonts]
> \setmainfont[hiraginokakugothicpro] %a japanese font \enableregime[utf8]
> \setupbibtex[database=biblio]
> 
> \starttext
> \completepublications
> \stoptext
> %%%%%%%%%%%%%%%%%end of file%%%%%%%%
> 
> And here is the bib file :
> 
> %%%%%%%%%%%%%%%beginning of file%%%%%%%
> @article{uzawa2011tpp,
> author = "Hirofumi Uzawa 宇沢弘文, Uchihashi Katsuto 内橋克人",
> journal = "Sekai 世界",
> title = "Taidan TPP wa shakaiteki kyôtsû shihon wo hakai suru
> 対談TPPは社会的共通資本を破壊する",
> year = 2011,
> month = "april",
> publisher = "Iwanami shoten 岩波書店",
> pages = "62-72",
> url = "http://ci.nii.ac.jp/naid/40018706510/",
> }
> %%%%%%%%%%%%%%%end of file%%%%%%%%%%
> 
> Do someone know how to get ride of utf-8 errors ? Or is this a problem with
> bibtex, and then should I use anything else to replace it ? (does something
> like Biber work ?)
> 

Same here. It messes up when converting .bib to .bbl. Maybe check your bbl file, too. Mine looks like this, for example:
a={{Hirofumi Uzawa~宇沢弘文}}

You could try to write the .bbl file directly yourself, although that is not a comfortable option, if you have many Japanese entries.
Apart from that there's not much coming to mind.

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

^ permalink raw reply	[flat|nested] 18+ messages in thread

* Error while compiling : ! String contains an invalid utf-8 sequence.
@ 2011-11-25 18:50 Alexandre Krispin
  2011-11-25 19:03 ` Christian
  2011-11-26  9:35 ` Ulrike Fischer
  0 siblings, 2 replies; 18+ messages in thread
From: Alexandre Krispin @ 2011-11-25 18:50 UTC (permalink / raw)
  To: ntg-context


[-- Attachment #1.1: Type: text/plain, Size: 1489 bytes --]

Hello,

I am trying to get japanese displayed in bibliography. But I get the error
"! String contains an invalid utf-8 sequence." while compiling with the
command "context *tex".

Here is the tex file :

%%%%%%%%%%%%%%%beginning of file%%%%%%
\usemodule[simplefonts]
\setmainfont[hiraginokakugothicpro] %a japanese font
\enableregime[utf8]
\setupbibtex[database=biblio]

\starttext
\completepublications
\stoptext
%%%%%%%%%%%%%%%%%end of file%%%%%%%%

And here is the bib file :

%%%%%%%%%%%%%%%beginning of file%%%%%%%
@article{uzawa2011tpp,
author = "Hirofumi Uzawa 宇沢弘文, Uchihashi Katsuto 内橋克人",
journal = "Sekai 世界",
title = "Taidan TPP wa shakaiteki kyôtsû shihon wo hakai suru
対談TPPは社会的共通資本を破壊する",
year = 2011,
month = "april",
publisher = "Iwanami shoten 岩波書店",
pages = "62-72",
url = "http://ci.nii.ac.jp/naid/40018706510/",
}
%%%%%%%%%%%%%%%end of file%%%%%%%%%%

Do someone know how to get ride of utf-8 errors ? Or is this a problem with
bibtex, and then should I use anything else to replace it ? (does something
like Biber work ?)

Thanks for your help.

Cheers,
Alexandre Krispin

-- 
------------------------------------------------------------------------------
Alexandre KRISPIN
41 rue Guynemer  |  93200 Saint-Denis  |  France
tél : 06 28 76 69 34  |  http://bijutsu.toile-libre.org
----------------------------------------------------------------------------

[-- Attachment #1.2: Type: text/html, Size: 1852 bytes --]

[-- Attachment #2: Type: text/plain, Size: 485 bytes --]

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

^ permalink raw reply	[flat|nested] 18+ messages in thread

end of thread, other threads:[~2011-12-07 17:45 UTC | newest]

Thread overview: 18+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
     [not found] <mailman.901.1322405047.4232.ntg-context@ntg.nl>
2011-11-28  7:08 ` Error while compiling : ! String contains an invalid utf-8 sequence S Barmeier
2011-11-28  8:42   ` Alexandre Krispin
2011-11-30 12:25     ` Alexandre Krispin
2011-11-25 18:50 Alexandre Krispin
2011-11-25 19:03 ` Christian
2011-11-25 20:09   ` Hans Hagen
2011-11-25 22:13     ` Alexandre Krispin
2011-11-25 23:56     ` Alexandre Krispin
2011-11-27 13:33       ` Mojca Miklavec
2011-11-27 16:13         ` Alexandre Krispin
2011-11-28  9:20       ` Wolfgang Schuster
2011-12-07  8:28     ` Thomas A. Schmitz
2011-12-07 16:37       ` Alexandre Krispin
2011-12-07 17:45         ` Hans Hagen
2011-11-26  9:35 ` Ulrike Fischer
2011-11-26 10:44   ` Alexandre Krispin
2011-11-26 11:39     ` Wolfgang Schuster
2011-11-26 11:41       ` Alexandre Krispin

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).