4000 pages limit?

4000 pages limit?

[Marco Pessotto]

Hello there. 

Yesterday I was trying to typeset a very, very long document (about 3000
pages in A4). Well, mkiv died with a 

PANIC: unprotected error in call to Lua API (stack overflow (out of stack space))

It's easily reproducible with a simple

\starttext
\dorecurse{50000}{
\input knuth
}

Once it reaches page 4000 it will die.

I'm obviously going to split the document, because a pdf of 4000 pages
is just insane, but now I'm curious if this is a known limit.

Bests

-- 
Marco

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: 4000 pages limit?

[luigi scarso]

On Thu, Dec 16, 2010 at 8:12 PM, Marco Pessotto <melmothx@gmail.com> wrote:
>
> Hello there.
>
> Yesterday I was trying to typeset a very, very long document (about 3000
> pages in A4). Well, mkiv died with a
>
> PANIC: unprotected error in call to Lua API (stack overflow (out of stack space))
>
> It's easily reproducible with a simple
>
> \starttext
> \dorecurse{50000}{
> \input knuth
> }
Confirmed
\starttext
\dorecurse{50000}{
\input knuth
}\stoptext
die with

pages           > flushing realpage 3987, userpage 3987
PANIC: unprotected error in call to Lua API (stack overflow (out of
stack space))

-- 
luigi
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: 4000 pages limit?

[Jonas Stein]

> Yesterday I was trying to typeset a very, very long document (about 3000
> pages in A4). Well, mkiv died with a 
>
> PANIC: unprotected error in call to Lua API (stack overflow (out of stack space))
>
> It's easily reproducible with a simple
>
> \starttext
> \dorecurse{50000}{
> \input knuth
> }
>
> Once it reaches page 4000 it will die.

i could run this
\starttext     
\dorecurse{50000}{narf \page}
\stoptext 

==
pdfTeX warning: pdftex: no GlyphToUnicode entry has been inserted yet!
Output written on test.pdf (50000 pages, 10574005 bytes).
Transcript written on test.log.
TeXExec | runtime: 310.679998
==

and got 50000 pages in one pdf.
Okular is quite slow in opening it and needs 200 MB RAM, but it works.

But i could not use Ctrl-C to break the loop. 
I think that is a bug, or not?

i use this context:
http://packages.debian.org/experimental/context

Kind regards,

-- 
Jonas Stein <news@jonasstein.de>

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: 4000 pages limit?

[luigi scarso]

On Fri, Dec 17, 2010 at 12:04 AM, Jonas Stein <news@jonasstein.de> wrote:
>> Yesterday I was trying to typeset a very, very long document (about 3000
>> pages in A4). Well, mkiv died with a
>>
>> PANIC: unprotected error in call to Lua API (stack overflow (out of stack space))
>>
>> It's easily reproducible with a simple
>>
>> \starttext
>> \dorecurse{50000}{
>> \input knuth
>> }
\starttext
 \dorecurse{50000}{
 \input knuth
 }\stoptext
also fails after page  [1619.1619]) with
! TeX capacity exceeded, sorry [pool size=1254582].


> i could run this
> \starttext
> \dorecurse{50000}{narf \page}
> \stoptext
pdftex is ok
luatex fails with
pages           > flushing realpage 3987, userpage 3987
PANIC: unprotected error in call to Lua API (stack overflow (out of
stack space))

> I think that is a bug, or not?
yes, I think so.

-- 
luigi
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: 4000 pages limit?

[Hans Hagen]

On 16-12-2010 8:31, luigi scarso wrote:
> On Thu, Dec 16, 2010 at 8:12 PM, Marco Pessotto<melmothx@gmail.com>  wrote:
>>
>> Hello there.
>>
>> Yesterday I was trying to typeset a very, very long document (about 3000
>> pages in A4). Well, mkiv died with a
>>
>> PANIC: unprotected error in call to Lua API (stack overflow (out of stack space))
>>
>> It's easily reproducible with a simple
>>
>> \starttext
>> \dorecurse{50000}{
>> \input knuth
>> }
> Confirmed
> \starttext
> \dorecurse{50000}{
> \input knuth
> }\stoptext
> die with
>
> pages>  flushing realpage 3987, userpage 3987
> PANIC: unprotected error in call to Lua API (stack overflow (out of
> stack space))

its hard to figure out where it happens so probably taco has to run a 
variant with debugging on; maybe a core luatex function is not cleaning 
up the stack

Hans

-----------------------------------------------------------------
                                           Hans Hagen | PRAGMA ADE
               Ridderstraat 27 | 8061 GH Hasselt | The Netherlands
     tel: 038 477 53 69 | voip: 087 875 68 74 | www.pragma-ade.com
                                              | www.pragma-pod.nl
-----------------------------------------------------------------
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: 4000 pages limit?

[Taco Hoekwater]

On 12/17/2010 07:52 AM, luigi scarso wrote:
> On Fri, Dec 17, 2010 at 12:04 AM, Jonas Stein<news@jonasstein.de>  wrote:
>>> Yesterday I was trying to typeset a very, very long document (about 3000
>>> pages in A4). Well, mkiv died with a
>>>
>>> PANIC: unprotected error in call to Lua API (stack overflow (out of stack space))
>>>
>>> It's easily reproducible with a simple
>>>
>>> \starttext
>>> \dorecurse{50000}{
>>> \input knuth
>>> }
> \starttext
>   \dorecurse{50000}{
>   \input knuth
>   }\stoptext
> also fails after page  [1619.1619]) with
> ! TeX capacity exceeded, sorry [pool size=1254582].

That is mkii, right? (I am not interested in that)

> PANIC: unprotected error in call to Lua API (stack overflow (out of
> stack space))
>
>> I think that is a bug, or not?
> yes, I think so.

Yes it was a bug, fixed in the luatex source repository now.

Best wishes,
Taco


___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: 4000 pages limit?

[Vedran Miletić]

[-- Attachment #1.1: Type: text/plain, Size: 1213 bytes --]

2010/12/17 Taco Hoekwater <taco@elvenkind.com>

> On 12/17/2010 07:52 AM, luigi scarso wrote:
>
>> On Fri, Dec 17, 2010 at 12:04 AM, Jonas Stein<news@jonasstein.de>  wrote:
>>
>>> Yesterday I was trying to typeset a very, very long document (about 3000
>>>> pages in A4). Well, mkiv died with a
>>>>
>>>> PANIC: unprotected error in call to Lua API (stack overflow (out of
>>>> stack space))
>>>>
>>>> It's easily reproducible with a simple
>>>>
>>>> \starttext
>>>> \dorecurse{50000}{
>>>> \input knuth
>>>> }
>>>>
>>> \starttext
>>  \dorecurse{50000}{
>>  \input knuth
>>  }\stoptext
>> also fails after page  [1619.1619]) with
>> ! TeX capacity exceeded, sorry [pool size=1254582].
>>
>
> That is mkii, right? (I am not interested in that)
>
>
>  PANIC: unprotected error in call to Lua API (stack overflow (out of
>> stack space))
>>
>>  I think that is a bug, or not?
>>>
>> yes, I think so.
>>
>
> Yes it was a bug, fixed in the luatex source repository now.
>

How high is the limit now? Just curious, since I saw LuaTeX building _a
paragraph_ lasting few hundred pages without problems (on the other hand,
pdfTeX couldn't do it).

Regards,

Vedran Miletić

[-- Attachment #1.2: Type: text/html, Size: 2318 bytes --]

[-- Attachment #2: Type: text/plain, Size: 486 bytes --]

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: 4000 pages limit?

[Martin Schröder]

2010/12/17 Vedran Miletić <rivanvx@gmail.com>:
> How high is the limit now? Just curious, since I saw LuaTeX building _a
> paragraph_ lasting few hundred pages without problems (on the other hand,
> pdfTeX couldn't do it).

Which limit? For the simple knuth case most likely the size of your harddisk
is the limit (iff luatex can generate PDFs >4GB :). And you'll get problems
with pdfs with millions of objects (i.e. pages), as readers can't cope with
them.

Best
   Martin
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: 4000 pages limit?

[Taco Hoekwater]

On 12/17/2010 10:44 AM, Vedran Miletić wrote:
>
> How high is the limit now?

There is nothing hardcoded anywhere, but I suspect that after a few
million pages some limit somewhere will be reached eventually: either
the harddisk gets full, or your pdf reader will be unable to open the
pdf due to its internal limits (luatex will happily create 10GB pdfs).

Best wishes,
Taco
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: 4000 pages limit?

[Alan BRASLAU]

On Friday 17 December 2010 10:49:27 Martin Schröder wrote:
> And you'll get problems with pdfs with millions of objects (i.e. pages), as 
readers can't cope with them.

Which readers: do you refer to computer programs or to humans?
(This is what Herbert Simon calls bounded rationality.)

Alan
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: 4000 pages limit?

[Hans Hagen]

On 17-12-2010 10:44, Vedran Miletić wrote:

> How high is the limit now? Just curious, since I saw LuaTeX building _a
> paragraph_ lasting few hundred pages without problems (on the other hand,
> pdfTeX couldn't do it).

I've done tests with tens of thousands of pages with mkiv with no 
problem so there must be something special going on now.

Hans

-----------------------------------------------------------------
                                           Hans Hagen | PRAGMA ADE
               Ridderstraat 27 | 8061 GH Hasselt | The Netherlands
     tel: 038 477 53 69 | voip: 087 875 68 74 | www.pragma-ade.com
                                              | www.pragma-pod.nl
-----------------------------------------------------------------
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: 4000 pages limit?

[Martin Schröder]

2010/12/17 Taco Hoekwater <taco@elvenkind.com>:
> pdf due to its internal limits (luatex will happily create 10GB pdfs).

The code allows ca. 1TB; that should be enough for everyone (I hope I don't live
to see the day that it isn't :).

Best
   Martin
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: 4000 pages limit?

[Martin Schröder]

2010/12/17 Alan BRASLAU <alan.braslau@cea.fr>:
> Which readers: do you refer to computer programs or to humans?

Programs. You'll hit implementation limits in Adobe Reader.

Best
   Martin
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________