ntg-context - mailing list for ConTeXt users
 help / color / mirror / Atom feed
From: Paul Menzel <paulepanter@users.sourceforge.net>
To: ntg-context@ntg.nl
Subject: Re: t-filter: no table created when Unicode characters are included
Date: Sat, 30 Apr 2011 09:37:05 +0200	[thread overview]
Message-ID: <1304149025.5773.17.camel@mattotaupa> (raw)
In-Reply-To: <alpine.LNX.2.01.1104291800250.13168@ybpnyubfg.ybpnyqbznva>


[-- Attachment #1.1.1: Type: text/plain, Size: 5533 bytes --]

Am Freitag, den 29.04.2011, 18:13 -0400 schrieb Aditya Mahajan:
> On Fri, 29 Apr 2011, Paul Menzel wrote:

> > the filter module installed using
> >
> > 	$ ./first-setup.sh --extras="t-filter"
> >
> > does not work with the following example, which is also attached.
> >
> >        \usemodule[filter]
> >        \defineexternalfilter[rest][filtercommand={pandoc -f rst -t context -o \externalfilteroutputfile\space \externalfilterinputfile}]
> >        \starttext
> >        There should be a table here.
> >        \startrest
> >        =========	=========
> >          test            table
> >        =========	=========
> >        α                 b
> >        c                 d
> >        ========	========
> >        \stoprest
> >        \stoptext
> >
> > The output file `minimal-temp-rest.tex` is just empty.
> >
> > Replacing »α« by »a« solves the problem.
> 
> Weird.
> 
> > Running `filtercommand` in a terminal produces the *correct* output
> > though and no empty file.
> >
> > Is that a known problem?
> 
> No. The content of the file should not affect whether the filter is run or 
> not. Can you add \traceexternalfilters on the top and check the output 
> (look for lines starting with t-filter).

You already added it in your commit of the test file.

        […]
        resolvers       > modules > loaded: 'filter'
        (t-filter.tex
        loading         > ConTeXt User Module / Filter
        resolvers       > modules > loaded: 'module-catcodes'
        (t-module-catcodes.tex
        loading         > ConTeXt User Module / Module Catcodes
        )) (/opt/context/tex/texmf-context/tex/context/base/type-siz.mkiv) (/opt/context/tex/texmf-context/tex/context/base/type-otf.mkiv){/opt/context/tex/texmf-context/fonts/map/pdftex/context/mkiv-tx.map}{/opt/context/tex/texmf/fonts/map/dvips/lm/lm-math.map}{/opt/context/tex/texmf/fonts/map/dvips/lm/lm-rm.map}{/opt/context/tex/texmf-context/fonts/map/pdftex/context/mkiv-base.map}
        fonts           > virtual math > the mapping is incomplete for 'txmath' at 7pt
        system          > begin file tests/rest at line 11
        t-filter        > current filter : rest
        t-filter        > base file : rest-temp-rest
        t-filter        > input file : rest-temp-rest.tmp
        t-filter        > output file : rest-temp-rest.tex
        t-filter        > command : pandoc -f rst -t context -o rest-temp-rest.tex rest-temp-rest.tmp
        (rest-temp-rest.tex)
        backend         > xmp > using file '/opt/context/tex/texmf-context/tex/context/base/lpdf-pdx.xml'
        pages           > flushing realpage 1, userpage 1, subpage 1
        system          > end file tests/rest at line 21
         )</opt/context/tex/texmf/fonts/opentype/public/tex-gyre/texgyretermes-regular.otf>
        […]
        $ more rest-temp-rest.t*
        ::::::::::::::
        rest-temp-rest.tex
        ::::::::::::::
        ::::::::::::::
        rest-temp-rest.tmp
        ::::::::::::::
        =========       =========
          test            table
        =========       =========
        α                 b
        c                 d
        ========        ========

Please find `rest.log` attached.

> > I also include a patch adding this example into `tests/` in [1].
> 
> Thanks. I added it to the test suite.

You can save the mbox file and use `git am path/to/mbox` next time.

> The file works correctly on my machine.

That is weired.

> Which version of pandoc are you using?

        $ pandoc --version
        pandoc 1.5.1.1
        Compiled with syntax highlighting support for:
        Ada, Alert, Asp, Awk, Bash, Bibtex, C, Cmake, Coldfusion, Commonlisp, Cpp, Css,
        D, Djangotemplate, Doxygen, Dtd, Eiffel, Erlang, Fortran, Haskell, Html, Java,
        Javadoc, Javascript, Json, Latex, Lex, LiterateHaskell, Lua, Makefile, Matlab,
        Mediawiki, Modula3, Nasm, Objectivec, Ocaml, Octave, Pascal, Perl, Php,
        Postscript, Prolog, Python, Relaxngcompact, Rhtml, Ruby, Scala, Scheme, Sgml,
        Sql, SqlMysql, SqlPostgresql, Tcl, Texinfo, Xml, Xslt, Yacc
        Copyright (C) 2006-2010 John MacFarlane
        Web:  http://johnmacfarlane.net/pandoc
        This is free software; see the source for copying conditions.  There is no
        warranty, not even for merchantability or fitness for a particular purpose.

As already written in my last mail. Executing the command directly works
fine.

        $ pandoc -f rst -t context -o rest-temp-rest.tex rest-temp-rest.tmp
        $ more rest-temp-rest.t*::::::::::::::
        rest-temp-rest.tex
        ::::::::::::::
        \placetable[here]{none}
        \starttable[|l|l|]
        \HL
        \NC test
        \NC table
        \NC\AR
        \HL
        \NC α
        \NC b
        \NC\AR
        \NC c
        \NC d
        \NC\AR
        \HL
        \stoptable
        ::::::::::::::
        rest-temp-rest.tmp
        ::::::::::::::
        =========       =========
          test            table
        =========       =========
        α                 b
        c                 d
        ========        ========

> Does the error also occur if you use the dev branch from github?

Yes.

>    $git checkout dev
>    $context tests/rest

For the Git newbies. If you do this the first time, you need to do

        $ git checkout -b dev origin/dev

beforehand.


Thanks,

Paul

[-- Attachment #1.1.2: rest.log --]
[-- Type: text/x-log, Size: 4931 bytes --]

(tests/rest.tex

ConTeXt  ver: 2011.04.27 21:50 MKIV  fmt: 2011.4.29  int: english/english

system          > cont-new.mkiv loaded
(/opt/context/tex/texmf-context/tex/context/base/cont-new.mkiv
system          > beware: some patches loaded from cont-new.mkiv
)
system          > rest.top loaded
system          > options > begin of optionfile
system          > options >
system          > options > % runtime options files (command line driven)
system          > options > \unprotect
system          > options > % feedback and basic job control
system          > options > % handy for special styles
system          > options > \startluacode
system          > options > document = document or { }
system          > options > document.arguments={
system          > options > }
system          > options > document.files={
system          > options >  "tests/rest",
system          > options > }
system          > options > \stopluacode
system          > options > % process info
system          > options > \setupsystem[inputfile=tests/rest]
system          > options > \setupsystem[\c!n=2,\c!m=3]
system          > options > % modes
system          > options > % options (not that important)
system          > options > \startsetups *runtime:options
system          > options > \stopsetups
system          > options > % styles and modules
system          > options > \startsetups *runtime:modules
system          > options > \stopsetups
system          > options > % done
system          > options > \protect \endinput
system          > options >
system          > options > end of optionfile
(rest.top)
fonts           > latin modern fonts are not preloaded
languages       > language en is active
resolvers       > modules > loaded: 'filter'
(t-filter.tex
loading         > ConTeXt User Module / Filter
resolvers       > modules > loaded: 'module-catcodes'
(t-module-catcodes.tex
loading         > ConTeXt User Module / Module Catcodes
)) (/opt/context/tex/texmf-context/tex/context/base/type-siz.mkiv) (/opt/context/tex/texmf-context/tex/context/base/type-otf.mkiv){/opt/context/tex/texmf-context/fonts/map/pdftex/context/mkiv-tx.map}{/opt/context/tex/texmf/fonts/map/dvips/lm/lm-math.map}{/opt/context/tex/texmf/fonts/map/dvips/lm/lm-rm.map}{/opt/context/tex/texmf-context/fonts/map/pdftex/context/mkiv-base.map}
fonts           > virtual math > the mapping is incomplete for 'txmath' at 7pt
system          > begin file tests/rest at line 11
t-filter        > current filter : rest
t-filter        > base file : rest-temp-rest
t-filter        > input file : rest-temp-rest.tmp
t-filter        > output file : rest-temp-rest.tex
t-filter        > command : pandoc -f rst -t context -o rest-temp-rest.tex rest-temp-rest.tmp
(rest-temp-rest.tex)
backend         > xmp > using file '/opt/context/tex/texmf-context/tex/context/base/lpdf-pdx.xml'
pages           > flushing realpage 1, userpage 1, subpage 1
system          > end file tests/rest at line 21
 )</opt/context/tex/texmf/fonts/opentype/public/tex-gyre/texgyretermes-regular.otf>
mkiv lua stats  > used config file          - selfautoparent:/texmf/web2c/texmfcnf.lua
mkiv lua stats  > used cache path           - /opt/context/tex/texmf-cache/luatex-cache/context/5fe67e0bfe781ce0dde776fb1556f32e
mkiv lua stats  > input load time           - 0.010 seconds
mkiv lua stats  > stored bytecode data      - 284 modules, 58 tables, 342 chunks
mkiv lua stats  > loaded tex modules        - 2 requested, 2 found (*-filter *-module-catcodes), 0 missing
mkiv lua stats  > cleaned up reserved nodes - 33 nodes, 9 lists of 423
mkiv lua stats  > node memory usage         - 19 glue_spec
mkiv lua stats  > node list callback tasks  - 6 unique task lists, 5 instances (re)created, 2397 calls
mkiv lua stats  > used backend              - pdf (backend for directly generating pdf output)
mkiv lua stats  > loaded patterns           - en::2
mkiv lua stats  > callbacks                 - 2529 direct, 3469 indirect, 5998 total
mkiv lua stats  > randomizer                - resumed with value 0.81004799567631
mkiv lua stats  > lxml preparation time     - 0.000 seconds, 0 nodes, 15 lpath calls, 0 cached calls
mkiv lua stats  > result saved in file      - rest.pdf
mkiv lua stats  > loaded fonts              - 12 files: lmmono10-regular.otf lmsans10-regular.otf texgyretermes-bold.otf texgyretermes-bolditalic.otf texgyretermes-regular.otf rtxmi.tfm rtxptmri.tfm rtxr.tfm txex.tfm txsy.tfm txsya.tfm txsyb.tfm
mkiv lua stats  > fonts load time           - 0.308 seconds 
mkiv lua stats  > luatex banner             - this is luatex, version beta-0.66.0-2011041216
mkiv lua stats  > control sequences         - 30417 of 165536
mkiv lua stats  > current memory usage      - 25 MB (ctx: 26 MB)
mkiv lua stats  > runtime                   - 0.997 seconds, 1 processed pages, 1 shipped pages, 1.003 pages/second


[-- Attachment #1.2: This is a digitally signed message part --]
[-- Type: application/pgp-signature, Size: 198 bytes --]

[-- Attachment #2: Type: text/plain, Size: 485 bytes --]

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

  reply	other threads:[~2011-04-30  7:37 UTC|newest]

Thread overview: 23+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2011-04-29 21:09 Paul Menzel
2011-04-29 21:17 ` [t-filter] [PATCH] tests: add test file for reST (reStructuredText) Paul Menzel
2011-04-29 22:13 ` t-filter: no table created when Unicode characters are included Aditya Mahajan
2011-04-30  7:37   ` Paul Menzel [this message]
2011-04-30 15:10     ` Aditya Mahajan
2011-05-01 10:48       ` Paul Menzel
2011-05-01 12:12       ` Peter Münster
2011-05-01 14:29         ` Aditya Mahajan
2011-05-01 18:27           ` Peter Münster
2011-05-01 18:52           ` Peter Münster
2011-05-01 19:05             ` Aditya Mahajan
2011-05-01 19:09               ` Aditya Mahajan
2011-05-02 15:30                 ` Paul Menzel
2011-05-27  8:53                   ` [solved] " Paul Menzel
2011-06-23 14:31                     ` yoraxe
2011-06-23 16:30                       ` Aditya Mahajan
2011-06-23 19:59                         ` t-filter: how to use math-mode yoraxe
2011-06-23 21:08                           ` yoraxe
2011-06-23 23:23                           ` Aditya Mahajan
2011-06-25 10:58                             ` yoraxe
2011-04-30 21:00 ` t-filter: no table created when Unicode characters are included Philipp Gesang
2011-05-20  9:24   ` t-rst: Unicode character not printed (was: t-filter: no table created when Unicode characters are included) Paul Menzel
2011-05-20  9:54     ` Philipp Gesang

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=1304149025.5773.17.camel@mattotaupa \
    --to=paulepanter@users.sourceforge.net \
    --cc=ntg-context@ntg.nl \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body. 
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).