simpleslides + combinepages != qpdf

simpleslides + combinepages != qpdf

[Reviczky, Adam]

Hi

Here's another qpdf problem I've encountered lately. Not sure if it's ConTeXt's fault (simpleslides perhaps?) or qpdf.

Given the following very minimalistic examples:
% slides.tex
\usemodule[simpleslides][style=BigNumber,font=Helvetica]
\starttext
\placeTitle
\stoptext

%handout.tex
\setuppapersize
  [A4][A4] % or [A4,landscape][A4,landscape]
\setuplayout
  [header=0pt,footer=1cm,backspace=1cm,topspace=1cm,width=middle,height=middle]
\setupfootertexts
  [presentation---\currentdate\space---\space\pagenumber]
\starttext
  \combinepages[slides][nx=2,ny=3,frame=on]
\stoptext

context slides.tex && qpdf --linearize slides.pdf slidesout.pdf
=> results in the expected outputs

context handout.tex
=> compiles fine and output is as expected

qpdf --linearize handout.pdf handoutout.pdf
=> aborts with the following error:
object stream 21 (object 31 0, file position 1601): unknown token while reading object (nullnullnullnull)

All with context beta 2011.05.01 and luatex r4233

Can anyone confirm this? Any thoughts?

Adam
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: simpleslides + combinepages != qpdf

[Aditya Mahajan]

On Mon, 2 May 2011, Reviczky, Adam wrote:

> Hi
>
> Here's another qpdf problem I've encountered lately. Not sure if it's ConTeXt's fault (simpleslides perhaps?) or qpdf.

Does the problem appear if you use do not use simpleslides? If not, does 
it appear if you use style=default? This will help narrowing down the 
cause.

Aditya
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: simpleslides + combinepages != qpdf

[Reviczky, Adam]

> the PNG_FP_1 i have added recently, it's defined in png.h. Must be some
> configure problem, maybe system png.h is used instead of the one coming
> with the libpng within luatex. i don't have the problem here. Sorry,
> needs investigation...

I was indeed using the system's libpng, my bad.
Strange though, that this comes out just now.

Anyhow, thanks.

Adam
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: simpleslides + combinepages != qpdf

[Hartmut Henkel]

[-- Attachment #1: Type: TEXT/PLAIN, Size: 3468 bytes --]

On Tue, 3 May 2011, Reviczky, Adam wrote:

> > found it: There were 4 null objects in an ObjStm in handout.pdf, stored
> > now compress: "nullnullnullnull" (not yet so in 0.70.x). Each null
> > object has a correct pointer to its begin (the 'n'), so one should
> > suppose that an object ends at the character ('l') just before the start
> > ('n') of the next null object. Like in the TeX string pool.
> >
> > But qpdf gives an error about a "nullnullnullnull" object (fully
> > ignoring the start of the 2nd null object!), and also Adobe Reader 9
> > quits with an error. Interestingly xpdf displays the file handout.pdf
> > without any problem. The problem is fixed by adding a space at to the
> > end of each object within an ObjStm, so there is now "null null null
> > null", see SVN 4242. No comment in the PDF Ref. on this. Looks like a
> > flaw in qpdf and the Reader?
> >
> > Regards, Hartmut
>
> Thanks Hartmut for fixing this!
>
> On another note I can't seem to compile the latest trunk anymore, it fails with:
>
> ...
> mv -f .deps/libluatex_a-writejp2.Tpo .deps/libluatex_a-writejp2.Po
> CWEBINPUTS=../../../source/texk/web2c/luatexdir/image TEXMFCNF=../../../source/texk/web2c/../kpathsea ./ctangle writepng.w
> This is CTANGLE, Version 3.64 (TeX Live 2011)
>
> Writing the output file (writepng.c):.....500.
> Done.
> (No errors were found.)
> gcc -DHAVE_CONFIG_H -I. -I../../../source/texk/web2c -I./w2c  -I/home/reviczky/Downloads/test/luatex-dir/luatex-0.70.0~svn201105022255r{revno}/build/texk -I/home/reviczky/Downloads/test/luatex-dir/luatex-0.70.0~svn201105022255r{revno}/source/texk -DNO_DEBUG  -I/usr/include/libpng12   -DPOPPLER_VERSION=\"0.16.4\" -I/usr/include/poppler   -I/home/reviczky/Downloads/test/luatex-dir/luatex-0.70.0~svn201105022255r{revno}/build/libs/obsdcompat -I/home/reviczky/Downloads/test/luatex-dir/luatex-0.70.0~svn201105022255r{revno}/source/libs/obsdcompat -I../../../source/texk/web2c/libmd5 -I../../../source/texk/web2c/luatexdir -I../../../source/texk/web2c/luatexdir/lua51 -DpdfTeX -I../../../source/texk/web2c/synctexdir -DSYNCTEX_ENGINE_H='<synctex-luatex.h>'  -Wall -Wunused -Wimplicit -Wreturn-type -Wdeclaration-after-statement -Wno-unknown-pragmas -Wmissing-prototypes -Wmissing-declarations -g -Wall -O2 -Wdeclaration-after-statement -MT libluatex_a-writepng.o -MD -MP -MF .deps/libluatex_a-writepng.Tpo -c -o libluatex_a-writepng.o `test -f 'writepng.c' || echo '../../../source/texk/web2c/'`writepng.c
> ../../../source/texk/web2c/luatexdir/image/writepng.w: In function ‘write_png’:
> ../../../source/texk/web2c/luatexdir/image/writepng.w:558:19: error: ‘PNG_FP_1’ undeclared (first use in this function)
> ../../../source/texk/web2c/luatexdir/image/writepng.w:558:19: note: each undeclared identifier is reported only once for each function it appears in
> make[1]: *** [libluatex_a-writepng.o] Error 1
> make[1]: Leaving directory `/home/reviczky/Downloads/test/luatex-dir/luatex-0.70.0~svn201105022255r{revno}/build/texk/web2c'
> luatex binary not stripped
> ls: cannot access build/texk/web2c/luatex: No such file or directory
> make: *** [build-stamp] Error 2
> ...
>
> Is that a problem on my end?

the PNG_FP_1 i have added recently, it's defined in png.h. Must be some
configure problem, maybe system png.h is used instead of the one coming
with the libpng within luatex. i don't have the problem here. Sorry,
needs investigation...

Regards, Hartmut

[-- Attachment #2: Type: text/plain, Size: 485 bytes --]

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: simpleslides + combinepages != qpdf

[Reviczky, Adam]

> found it: There were 4 null objects in an ObjStm in handout.pdf, stored
> now compress: "nullnullnullnull" (not yet so in 0.70.x). Each null
> object has a correct pointer to its begin (the 'n'), so one should
> suppose that an object ends at the character ('l') just before the start
> ('n') of the next null object. Like in the TeX string pool.
> 
> But qpdf gives an error about a "nullnullnullnull" object (fully
> ignoring the start of the 2nd null object!), and also Adobe Reader 9
> quits with an error. Interestingly xpdf displays the file handout.pdf
> without any problem. The problem is fixed by adding a space at to the
> end of each object within an ObjStm, so there is now "null null null
> null", see SVN 4242. No comment in the PDF Ref. on this. Looks like a
> flaw in qpdf and the Reader?
> 
> Regards, Hartmut

Thanks Hartmut for fixing this!

On another note I can't seem to compile the latest trunk anymore, it fails with:

...
mv -f .deps/libluatex_a-writejp2.Tpo .deps/libluatex_a-writejp2.Po
CWEBINPUTS=../../../source/texk/web2c/luatexdir/image TEXMFCNF=../../../source/texk/web2c/../kpathsea ./ctangle writepng.w
This is CTANGLE, Version 3.64 (TeX Live 2011)

Writing the output file (writepng.c):.....500.
Done.
(No errors were found.)
gcc -DHAVE_CONFIG_H -I. -I../../../source/texk/web2c -I./w2c  -I/home/reviczky/Downloads/test/luatex-dir/luatex-0.70.0~svn201105022255r{revno}/build/texk -I/home/reviczky/Downloads/test/luatex-dir/luatex-0.70.0~svn201105022255r{revno}/source/texk -DNO_DEBUG  -I/usr/include/libpng12   -DPOPPLER_VERSION=\"0.16.4\" -I/usr/include/poppler   -I/home/reviczky/Downloads/test/luatex-dir/luatex-0.70.0~svn201105022255r{revno}/build/libs/obsdcompat -I/home/reviczky/Downloads/test/luatex-dir/luatex-0.70.0~svn201105022255r{revno}/source/libs/obsdcompat -I../../../source/texk/web2c/libmd5 -I../../../source/texk/web2c/luatexdir -I../../../source/texk/web2c/luatexdir/lua51 -DpdfTeX -I../../../source/texk/web2c/synctexdir -DSYNCTEX_ENGINE_H='<synctex-luatex.h>'  -Wall -Wunused -Wimplicit -Wreturn-type -Wdeclaration-after-statement -Wno-unknown-pragmas -Wmissing-prototypes -Wmissing-declarations -g -Wall -O2 -Wdeclaration-after-statement -MT libluatex_a-writepng.o -MD -MP -MF .deps/libluatex_a-writepng.Tpo -c -o libluatex_a-writepng.o `test -f 'writepng.c' || echo '../../../source/texk/web2c/'`writepng.c
../../../source/texk/web2c/luatexdir/image/writepng.w: In function ‘write_png’:
../../../source/texk/web2c/luatexdir/image/writepng.w:558:19: error: ‘PNG_FP_1’ undeclared (first use in this function)
../../../source/texk/web2c/luatexdir/image/writepng.w:558:19: note: each undeclared identifier is reported only once for each function it appears in
make[1]: *** [libluatex_a-writepng.o] Error 1
make[1]: Leaving directory `/home/reviczky/Downloads/test/luatex-dir/luatex-0.70.0~svn201105022255r{revno}/build/texk/web2c'
luatex binary not stripped
ls: cannot access build/texk/web2c/luatex: No such file or directory
make: *** [build-stamp] Error 2
...

Is that a problem on my end?

Adam
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: simpleslides + combinepages != qpdf

[Hartmut Henkel]

On Mon, 2 May 2011, Hartmut Henkel wrote:

> On Mon, 2 May 2011, Reviczky, Adam wrote:
>
> > Right, I have a feeling that this is MetaPost related, hence the random problems with different styles.
> >
> > I can reproduce this now without simpleslides too, using only metapost.
> >
> > Here's a minimal example:
> >
> > Get logo_ignite.mp from: http://pastebin.com/raw.php?i=VqvcWniu
> >
> > % slides.tex
> > \startreusableMPgraphic{ignite}
> >   input logo_ignite;
> > \stopreusableMPgraphic
> > \starttext
> > \reuseMPgraphic{ignite}
> > \stoptext
> >
> > %handout.tex
> > \setuppapersize
> >   [A4][A4] % or [A4,landscape][A4,landscape]
> > \setuplayout
> >   [header=0pt,footer=1cm,backspace=1cm,topspace=1cm,width=middle,height=middle]
> > \setupfootertexts
> >   [presentation---\currentdate\space---\space\pagenumber]
> > \starttext
> >   \combinepages[slides][nx=2,ny=3,frame=on]
> > \stoptext
> >
> > context slides.tex && context handout.tex && qpdf --linearize handout.pdf out.pdf
> >
> > results in:
> > object stream 21 (object 31 0, file position 1547): unknown token while reading object (nullnullnullnull)
> >
> > ConTeXt  ver: 2011.05.01 12:50 MKIV  fmt: 2011.5.2  int: english/english
> > mkiv lua stats  > luatex banner             - this is luatex, version beta-0.71.0-2011050213 (rev 4233)
>
> seems to be a bug in luatex beta-0.71.0-2011050213 (rev 4233).
> Checking...

found it: There were 4 null objects in an ObjStm in handout.pdf, stored
now compress: "nullnullnullnull" (not yet so in 0.70.x). Each null
object has a correct pointer to its begin (the 'n'), so one should
suppose that an object ends at the character ('l') just before the start
('n') of the next null object. Like in the TeX string pool.

But qpdf gives an error about a "nullnullnullnull" object (fully
ignoring the start of the 2nd null object!), and also Adobe Reader 9
quits with an error. Interestingly xpdf displays the file handout.pdf
without any problem. The problem is fixed by adding a space at to the
end of each object within an ObjStm, so there is now "null null null
null", see SVN 4242. No comment in the PDF Ref. on this. Looks like a
flaw in qpdf and the Reader?

Regards, Hartmut
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: simpleslides + combinepages != qpdf

[Hartmut Henkel]

On Mon, 2 May 2011, Reviczky, Adam wrote:

> Right, I have a feeling that this is MetaPost related, hence the random problems with different styles.
>
> I can reproduce this now without simpleslides too, using only metapost.
>
> Here's a minimal example:
>
> Get logo_ignite.mp from: http://pastebin.com/raw.php?i=VqvcWniu
>
> % slides.tex
> \startreusableMPgraphic{ignite}
>   input logo_ignite;
> \stopreusableMPgraphic
> \starttext
> \reuseMPgraphic{ignite}
> \stoptext
>
> %handout.tex
> \setuppapersize
>   [A4][A4] % or [A4,landscape][A4,landscape]
> \setuplayout
>   [header=0pt,footer=1cm,backspace=1cm,topspace=1cm,width=middle,height=middle]
> \setupfootertexts
>   [presentation---\currentdate\space---\space\pagenumber]
> \starttext
>   \combinepages[slides][nx=2,ny=3,frame=on]
> \stoptext
>
> context slides.tex && context handout.tex && qpdf --linearize handout.pdf out.pdf
>
> results in:
> object stream 21 (object 31 0, file position 1547): unknown token while reading object (nullnullnullnull)
>
> ConTeXt  ver: 2011.05.01 12:50 MKIV  fmt: 2011.5.2  int: english/english
> mkiv lua stats  > luatex banner             - this is luatex, version beta-0.71.0-2011050213 (rev 4233)

seems to be a bug in luatex beta-0.71.0-2011050213 (rev 4233).
Checking...

Regards, Hartmut
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: simpleslides + combinepages != qpdf

[Reviczky, Adam]

Right, I have a feeling that this is MetaPost related, hence the random problems with different styles.

I can reproduce this now without simpleslides too, using only metapost.

Here's a minimal example:

Get logo_ignite.mp from: http://pastebin.com/raw.php?i=VqvcWniu

% slides.tex
\startreusableMPgraphic{ignite}
  input logo_ignite;
\stopreusableMPgraphic
\starttext
\reuseMPgraphic{ignite}
\stoptext

%handout.tex
\setuppapersize
  [A4][A4] % or [A4,landscape][A4,landscape]
\setuplayout
  [header=0pt,footer=1cm,backspace=1cm,topspace=1cm,width=middle,height=middle]
\setupfootertexts
  [presentation---\currentdate\space---\space\pagenumber]
\starttext
  \combinepages[slides][nx=2,ny=3,frame=on]
\stoptext

context slides.tex && context handout.tex && qpdf --linearize handout.pdf out.pdf

results in:
object stream 21 (object 31 0, file position 1547): unknown token while reading object (nullnullnullnull)

ConTeXt  ver: 2011.05.01 12:50 MKIV  fmt: 2011.5.2  int: english/english
mkiv lua stats  > luatex banner             - this is luatex, version beta-0.71.0-2011050213 (rev 4233)

Adam
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: simpleslides + combinepages != qpdf

[Reviczky, Adam]

Hmm, well, I can reproduce this on my presentation even with style=default ...

Adam
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: simpleslides + combinepages != qpdf

[Reviczky, Adam]

> Does the problem appear if you use do not use simpleslides? If not, does 
> it appear if you use style=default? This will help narrowing down the 
> cause.

I've tried a "Hello world" file and also a non-simpleslides presentation tex file, all of them work.

So it seems it's simpleslides and yeah, you where right, it's the styles.
I'm using "Split" for my presentation and as for the minimal I've provided BigNumber, both fail at some point.
Using style=default, does not have this problem with qpdf.

I'm still trying out different styles and different slide content ...

Adam
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________