* Would Multiple Processes Cause: luatex: execution interrupted
@ 2011-07-04 21:24 Raymond LeClair
2011-07-04 21:35 ` Taco Hoekwater
0 siblings, 1 reply; 6+ messages in thread
From: Raymond LeClair @ 2011-07-04 21:24 UTC (permalink / raw)
To: mailing list for ConTeXt users
I run context in a task queue with four worker processes. It is possible that context is invoked simultaneously to process distinct input files by tasks running in separate worker processes. I see periodic fatal errors, as follows:
mtx-context | fatal error: no return code, message: luatex: execution interrupted
However, the same input files can be processed by context directly without errors. Is it possible that context running in simultaneous but separate processes conflict?
This is LuaTeX, Version beta-0.70.1-2011051923 (rev 4277)
ConTeXt ver: 2011.05.18 18:04 MKIV fmt: 2011.7.2 int: english/english
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!
maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage : http://www.pragma-ade.nl / http://tex.aanhet.net
archive : http://foundry.supelec.fr/projects/contextrev/
wiki : http://contextgarden.net
___________________________________________________________________________________
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: Would Multiple Processes Cause: luatex: execution interrupted
2011-07-04 21:24 Would Multiple Processes Cause: luatex: execution interrupted Raymond LeClair
@ 2011-07-04 21:35 ` Taco Hoekwater
2011-07-05 2:23 ` Raymond LeClair
0 siblings, 1 reply; 6+ messages in thread
From: Taco Hoekwater @ 2011-07-04 21:35 UTC (permalink / raw)
To: mailing list for ConTeXt users; +Cc: mailing list for ConTeXt users
On 4 jul. 2011, at 23:24, Raymond LeClair <raymond.leclair@synterein.com> wrote:
> I run context in a task queue with four worker processes. It is possible that context is invoked simultaneously to process distinct input files by tasks running in separate worker processes. I see periodic fatal errors, as follows:
>
> mtx-context | fatal error: no return code, message: luatex: execution interrupted
That is a 'hard' luatex crash. Because context calls luatex in a subprocess, it can be problematic to find the actual cause, unfortunately.
> However, the same input files can be processed by context directly without errors. Is it possible that context running in simultaneous but separate processes conflict?
>
Quite possibly (but that is very hard to verify and would be even harder to debug). Best practise is to give each process its own temporary directory, just in case.
Best wishes,
Taco
> This is LuaTeX, Version beta-0.70.1-2011051923 (rev 4277)
> ConTeXt ver: 2011.05.18 18:04 MKIV fmt: 2011.7.2 int: english/english
>
> ___________________________________________________________________________________
> If your question is of interest to others as well, please add an entry to the Wiki!
>
> maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
> webpage : http://www.pragma-ade.nl / http://tex.aanhet.net
> archive : http://foundry.supelec.fr/projects/contextrev/
> wiki : http://contextgarden.net
> ___________________________________________________________________________________
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!
maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage : http://www.pragma-ade.nl / http://tex.aanhet.net
archive : http://foundry.supelec.fr/projects/contextrev/
wiki : http://contextgarden.net
___________________________________________________________________________________
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: Would Multiple Processes Cause: luatex: execution interrupted
2011-07-04 21:35 ` Taco Hoekwater
@ 2011-07-05 2:23 ` Raymond LeClair
2011-07-05 6:11 ` luigi scarso
0 siblings, 1 reply; 6+ messages in thread
From: Raymond LeClair @ 2011-07-05 2:23 UTC (permalink / raw)
To: mailing list for ConTeXt users
Thanks for your reply!
On Jul 4, 2011, at 5:35 PM, Taco Hoekwater wrote:
> Quite possibly (but that is very hard to verify and would be even harder to debug). Best practise is to give each process its own temporary directory, just in case.
This is, in fact, guaranteed by design: each file resides in a directly which is named using a uuid.
Is it possible that context or luatex are creating files in a common directory, say the cache directory, and access by one process locks the file for access by another?
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!
maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage : http://www.pragma-ade.nl / http://tex.aanhet.net
archive : http://foundry.supelec.fr/projects/contextrev/
wiki : http://contextgarden.net
___________________________________________________________________________________
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: Would Multiple Processes Cause: luatex: execution interrupted
2011-07-05 2:23 ` Raymond LeClair
@ 2011-07-05 6:11 ` luigi scarso
2011-07-05 6:15 ` Taco Hoekwater
0 siblings, 1 reply; 6+ messages in thread
From: luigi scarso @ 2011-07-05 6:11 UTC (permalink / raw)
To: mailing list for ConTeXt users
On Tue, Jul 5, 2011 at 4:23 AM, Raymond LeClair
<raymond.leclair@synterein.com> wrote:
> Thanks for your reply!
>
> On Jul 4, 2011, at 5:35 PM, Taco Hoekwater wrote:
>
>> Quite possibly (but that is very hard to verify and would be even harder to debug). Best practise is to give each process its own temporary directory, just in case.
>
> This is, in fact, guaranteed by design: each file resides in a directly which is named using a uuid.
>
> Is it possible that context or luatex are creating files in a common directory, say the cache directory, and access by one process locks the file for access by another?
It's possible: say for example that each task rebuild the format at
every run just to be sure. The format is shared by all instances for
the same minimals or TeXLive, so conflicts may arise.
The same for example for the font cache.
--
luigi
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!
maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage : http://www.pragma-ade.nl / http://tex.aanhet.net
archive : http://foundry.supelec.fr/projects/contextrev/
wiki : http://contextgarden.net
___________________________________________________________________________________
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: Would Multiple Processes Cause: luatex: execution interrupted
2011-07-05 6:11 ` luigi scarso
@ 2011-07-05 6:15 ` Taco Hoekwater
2011-07-05 15:15 ` Raymond LeClair
0 siblings, 1 reply; 6+ messages in thread
From: Taco Hoekwater @ 2011-07-05 6:15 UTC (permalink / raw)
To: ntg-context
On 07/05/2011 08:11 AM, luigi scarso wrote:
> On Tue, Jul 5, 2011 at 4:23 AM, Raymond LeClair
> <raymond.leclair@synterein.com> wrote:
>> Thanks for your reply!
>>
>> On Jul 4, 2011, at 5:35 PM, Taco Hoekwater wrote:
>>
>>> Quite possibly (but that is very hard to verify and would be even harder to debug). Best practise is to give each process its own temporary directory, just in case.
>>
>> This is, in fact, guaranteed by design: each file resides in a directly which is named using a uuid.
>>
>> Is it possible that context or luatex are creating files in a common directory, say the cache directory, and access by one process locks the file for access by another?
> It's possible: say for example that each task rebuild the format at
> every run just to be sure. The format is shared by all instances for
> the same minimals or TeXLive, so conflicts may arise.
> The same for example for the font cache.
Possible but, I think, quite unlikely. Another possibility is that you
simply run out of memory?
Best wishes,
Taco
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!
maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage : http://www.pragma-ade.nl / http://tex.aanhet.net
archive : http://foundry.supelec.fr/projects/contextrev/
wiki : http://contextgarden.net
___________________________________________________________________________________
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: Would Multiple Processes Cause: luatex: execution interrupted
2011-07-05 6:15 ` Taco Hoekwater
@ 2011-07-05 15:15 ` Raymond LeClair
0 siblings, 0 replies; 6+ messages in thread
From: Raymond LeClair @ 2011-07-05 15:15 UTC (permalink / raw)
To: mailing list for ConTeXt users
Taco,
Thanks for your reply!
You are correct, the issue appears to be memory. The system is hosted on a linode, the smallest of which is 512 MB RAM. I increased this to 1024 MB RAM and this appears to fix the problem.
Very much appreciate your help.
Ray.
On Jul 5, 2011, at 2:15 AM, Taco Hoekwater wrote:
> On 07/05/2011 08:11 AM, luigi scarso wrote:
>> On Tue, Jul 5, 2011 at 4:23 AM, Raymond LeClair
>> <raymond.leclair@synterein.com> wrote:
>>> Thanks for your reply!
>>>
>>> On Jul 4, 2011, at 5:35 PM, Taco Hoekwater wrote:
>>>
>>>> Quite possibly (but that is very hard to verify and would be even harder to debug). Best practise is to give each process its own temporary directory, just in case.
>>>
>>> This is, in fact, guaranteed by design: each file resides in a directly which is named using a uuid.
>>>
>>> Is it possible that context or luatex are creating files in a common directory, say the cache directory, and access by one process locks the file for access by another?
>> It's possible: say for example that each task rebuild the format at
>> every run just to be sure. The format is shared by all instances for
>> the same minimals or TeXLive, so conflicts may arise.
>> The same for example for the font cache.
>
> Possible but, I think, quite unlikely. Another possibility is that you simply run out of memory?
>
> Best wishes,
> Taco
>
>
> ___________________________________________________________________________________
> If your question is of interest to others as well, please add an entry to the Wiki!
>
> maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
> webpage : http://www.pragma-ade.nl / http://tex.aanhet.net
> archive : http://foundry.supelec.fr/projects/contextrev/
> wiki : http://contextgarden.net
> ___________________________________________________________________________________
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!
maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage : http://www.pragma-ade.nl / http://tex.aanhet.net
archive : http://foundry.supelec.fr/projects/contextrev/
wiki : http://contextgarden.net
___________________________________________________________________________________
^ permalink raw reply [flat|nested] 6+ messages in thread
end of thread, other threads:[~2011-07-05 15:15 UTC | newest]
Thread overview: 6+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2011-07-04 21:24 Would Multiple Processes Cause: luatex: execution interrupted Raymond LeClair
2011-07-04 21:35 ` Taco Hoekwater
2011-07-05 2:23 ` Raymond LeClair
2011-07-05 6:11 ` luigi scarso
2011-07-05 6:15 ` Taco Hoekwater
2011-07-05 15:15 ` Raymond LeClair
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).