context (lmtx) segfaults on x86_64 linux

context (lmtx) segfaults on x86_64 linux

[Vladimir Lomov]

[-- Attachment #1.1: Type: text/plain, Size: 610 bytes --]

Hello,
today I updated lmtx and on simple
  
  $ context --version

I get segfault (in the same time luametatex --version works fine).
Running under gdb shows me that the problem might be in one of 'realloc'
calls.

The context from Context Suite (mkiv) works fine.

P.S. I tested on two systems, both runs Archlinux x86_64.

---
WBR, Vladimir Lomov

-- 
Carelessly planned projects take three times longer to complete than expected.
Carefully planned projects take four times longer to complete than expected,
mostly because the planners expect their planning to reduce the time it takes.

[-- Attachment #1.2: signature.asc --]
[-- Type: application/pgp-signature, Size: 228 bytes --]

[-- Attachment #2: Type: text/plain, Size: 493 bytes --]

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://context.aanhet.net
archive  : https://bitbucket.org/phg/context-mirror/commits/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: context (lmtx) segfaults on x86_64 linux

[Hans Hagen]

On 9/10/2019 4:11 PM, Vladimir Lomov wrote:
> Hello,
> today I updated lmtx and on simple
>    
>    $ context --version
> 
> I get segfault (in the same time luametatex --version works fine).
> Running under gdb shows me that the problem might be in one of 'realloc'
> calls.
> 
> The context from Context Suite (mkiv) works fine.
> 
> P.S. I tested on two systems, both runs Archlinux x86_64.
can you completely wipe the texmf-cache directory and then run

mtxrun --generate
context --make

(there is a change in bytecode that gets not automatically noticed that 
can give that crash)

Hans

-----------------------------------------------------------------
                                           Hans Hagen | PRAGMA ADE
               Ridderstraat 27 | 8061 GH Hasselt | The Netherlands
        tel: 038 477 53 69 | www.pragma-ade.nl | www.pragma-pod.nl
-----------------------------------------------------------------
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://context.aanhet.net
archive  : https://bitbucket.org/phg/context-mirror/commits/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: context (lmtx) segfaults on x86_64 linux

[Aditya Mahajan]

On Tue, 10 Sep 2019, Hans Hagen wrote:

> On 9/10/2019 4:11 PM, Vladimir Lomov wrote:
>> Hello,
>> today I updated lmtx and on simple
>>
>>    $ context --version
>> 
>> I get segfault (in the same time luametatex --version works fine).
>> Running under gdb shows me that the problem might be in one of 'realloc'
>> calls.
>> 
>> The context from Context Suite (mkiv) works fine.
>> 
>> P.S. I tested on two systems, both runs Archlinux x86_64.
> can you completely wipe the texmf-cache directory and then run
>
> mtxrun --generate
> context --make
>
> (there is a change in bytecode that gets not automatically noticed that 
> can give that crash)

I had the same issue and completely wiping the texmf-cache fixes it.

@Vladimir: If you are using the luametatex package from AUR, then the 
texmf-cache is located at $HOME/.cache/luametatex.

Aditya
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://context.aanhet.net
archive  : https://bitbucket.org/phg/context-mirror/commits/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: context (lmtx) segfaults on x86_64 linux

[Henri Menke]

[-- Attachment #1.1.1: Type: text/plain, Size: 1673 bytes --]

On 9/11/19 3:50 AM, Aditya Mahajan wrote:
> On Tue, 10 Sep 2019, Hans Hagen wrote:
> 
>> On 9/10/2019 4:11 PM, Vladimir Lomov wrote:
>>> Hello,
>>> today I updated lmtx and on simple
>>>
>>>    $ context --version
>>>
>>> I get segfault (in the same time luametatex --version works fine).
>>> Running under gdb shows me that the problem might be in one of 'realloc'
>>> calls.
>>>
>>> The context from Context Suite (mkiv) works fine.
>>>
>>> P.S. I tested on two systems, both runs Archlinux x86_64.
>> can you completely wipe the texmf-cache directory and then run
>>
>> mtxrun --generate
>> context --make
>>
>> (there is a change in bytecode that gets not automatically noticed that 
>> can give that crash)
> 
> I had the same issue and completely wiping the texmf-cache fixes it.
> 
> @Vladimir: If you are using the luametatex package from AUR, then the 
> texmf-cache is located at $HOME/.cache/luametatex.

I'm receiving the super helpful error message:

    ! error (lua): function call: no

Maybe some sort of cache versioning is in order to at least give a better error.

Cheers, Henri

> 
> Aditya
> ___________________________________________________________________________________
> If your question is of interest to others as well, please add an entry to the Wiki!
> 
> maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
> webpage  : http://www.pragma-ade.nl / http://context.aanhet.net
> archive  : https://bitbucket.org/phg/context-mirror/commits/
> wiki     : http://contextgarden.net
> ___________________________________________________________________________________
> 


[-- Attachment #1.2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 833 bytes --]

[-- Attachment #2: Type: text/plain, Size: 493 bytes --]

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://context.aanhet.net
archive  : https://bitbucket.org/phg/context-mirror/commits/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: context (lmtx) segfaults on x86_64 linux

[Vladimir Lomov]

[-- Attachment #1.1: Type: text/plain, Size: 1824 bytes --]

Hello,
** Henri Menke [2019-09-11 11:19:57 +1200]:

> On 9/11/19 3:50 AM, Aditya Mahajan wrote:
>> On Tue, 10 Sep 2019, Hans Hagen wrote:
>> 
>>> On 9/10/2019 4:11 PM, Vladimir Lomov wrote:
>>>> Hello,
>>>> today I updated lmtx and on simple
>>>>
>>>>    $ context --version
>>>>
>>>> I get segfault (in the same time luametatex --version works fine).
>>>> Running under gdb shows me that the problem might be in one of 'realloc'
>>>> calls.
>>>>
>>>> The context from Context Suite (mkiv) works fine.
>>>>
>>>> P.S. I tested on two systems, both runs Archlinux x86_64.
>>> can you completely wipe the texmf-cache directory and then run
>>>
>>> mtxrun --generate
>>> context --make
>>>
>>> (there is a change in bytecode that gets not automatically noticed that 
>>> can give that crash)
>> 
>> I had the same issue and completely wiping the texmf-cache fixes it.
>> 
>> @Vladimir: If you are using the luametatex package from AUR, then the 
>> texmf-cache is located at $HOME/.cache/luametatex.

No, I don't use the package from AUR, I simply do

  /usr/local/opt/lmtx $ sudo ./install.sh

but I explicitly set TEXMFCACHE=$HOME/.cache/lmtx (for context suite I
set it to $HOME/.cache/context-suite).

> I'm receiving the super helpful error message:
> 
>     ! error (lua): function call: no
> 
> Maybe some sort of cache versioning is in order to at least give a better error.

It didn't occured to me that the problem may be with the cache, it would
be helpfull if context/luametatex will give error message, something
like "cache version mismatch" and exit.

> Cheers, Henri
> 
>> 
>> Aditya

---
WBR, Vladimir Lomov



-- 
Sometimes I live in the country,
And sometimes I live in town.
And sometimes I have a great notion,
To jump in the river and drown.

[-- Attachment #1.2: signature.asc --]
[-- Type: application/pgp-signature, Size: 228 bytes --]

[-- Attachment #2: Type: text/plain, Size: 493 bytes --]

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://context.aanhet.net
archive  : https://bitbucket.org/phg/context-mirror/commits/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: context (lmtx) segfaults on x86_64 linux

[Hans Hagen]

> but I explicitly set TEXMFCACHE=$HOME/.cache/lmtx (for context suite I
> set it to $HOME/.cache/context-suite).



>> I'm receiving the super helpful error message:
>>
>>      ! error (lua): function call: no
>>
>> Maybe some sort of cache versioning is in order to at least give a better error.
> 
> It didn't occured to me that the problem may be with the cache, it would
> be helpfull if context/luametatex will give error message, something
> like "cache version mismatch" and exit.
hm, i have the same cache for both (different files are used)

so what does the tikz that fails look like (mwe)

Hans

-----------------------------------------------------------------
                                           Hans Hagen | PRAGMA ADE
               Ridderstraat 27 | 8061 GH Hasselt | The Netherlands
        tel: 038 477 53 69 | www.pragma-ade.nl | www.pragma-pod.nl
-----------------------------------------------------------------
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://context.aanhet.net
archive  : https://bitbucket.org/phg/context-mirror/commits/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: context (lmtx) segfaults on x86_64 linux

[Vladimir Lomov]

[-- Attachment #1.1: Type: text/plain, Size: 10832 bytes --]

Hello,
** Hans Hagen [2019-09-11 08:39:03 +0200]:

>
>> but I explicitly set TEXMFCACHE=$HOME/.cache/lmtx (for context suite I
>> set it to $HOME/.cache/context-suite).
>
>>> I'm receiving the super helpful error message:
>>>
>>>      ! error (lua): function call: no
>>>
>>> Maybe some sort of cache versioning is in order to at least give a better error.
>>
>> It didn't occured to me that the problem may be with the cache, it would
>> be helpfull if context/luametatex will give error message, something
>> like "cache version mismatch" and exit.

> hm, i have the same cache for both (different files are used)

That's strange. AFAIR, I splitted the caches because they were different
and I checked this again: I deleted TEXMFCACHE directories (lmtx and
context-suite ones), regenerated both using

  $ mtxrun --generate; context --make

(using the right mtxrun,
/usr/local/opt/context/tex/texmf-linux-64/bin/mtxrun and
/usr/local/opt/lmtx/tex/texmf-linux-64/bin/mtxrun in my case) and
checked the generated files. They have identical names, for example,

CONTEXT SUITE:

-------------------------------------- 8< --------------------------------------
$ tree $TEXMFCACHE | sed -e "s@$HOME/.cache/@@"
context-suite
└── luatex-cache
    └── context
        └── 5fe67e0bfe781ce0dde776fb1556f32e
            ├── formats
            │   └── luatex
            │       ├── cont-en.fmt
            │       ├── cont-en.log
            │       ├── cont-en.lui
            │       └── cont-en.luv
            └── trees
                ├── 3952aa25b6a1b9f9f8d3eeb6e65f0039.lua
                ├── 3952aa25b6a1b9f9f8d3eeb6e65f0039.luc
                ├── 3f406286dc3075cdfb044f836920f46a.lua
                ├── 3f406286dc3075cdfb044f836920f46a.luc
                ├── 3f6978edf9feb817ad6c1f21fc262031.lua
                ├── 3f6978edf9feb817ad6c1f21fc262031.luc
                ├── 71c82419867f9a0df8a150196c03c86f.lua
                ├── 71c82419867f9a0df8a150196c03c86f.luc
                ├── 73630a261795d9c53610a28af4550cbc.lua
                ├── 73630a261795d9c53610a28af4550cbc.luc
                ├── dcb651482955ac31eaab7723b70e0184.lua
                ├── dcb651482955ac31eaab7723b70e0184.luc
                ├── fb39a92c95ceca857c3f2d0ee48a2ad3.lua
                └── fb39a92c95ceca857c3f2d0ee48a2ad3.luc

6 directories, 18 files
-------------------------------------- 8< --------------------------------------


-------------------------------------- 8< --------------------------------------
LANG=en_US.UTF-8 ls -goR $TEXMFCACHE/ | sed -e "s@$HOME/.cache/@@"
context-suite/:
total 0
drwxr-xr-x 3 21 Sep 11 15:28 luatex-cache

context-suite/luatex-cache:
total 0
drwxr-xr-x 3 46 Sep 11 15:28 context

context-suite/luatex-cache/context:
total 0
drwxr-xr-x 4 34 Sep 11 15:28 5fe67e0bfe781ce0dde776fb1556f32e

context-suite/luatex-cache/context/5fe67e0bfe781ce0dde776fb1556f32e:
total 4
drwxr-xr-x 3   20 Sep 11 15:28 formats
drwxr-xr-x 2 4096 Sep 11 15:28 trees

context-suite/luatex-cache/context/5fe67e0bfe781ce0dde776fb1556f32e/formats:
total 0
drwxr-xr-x 2 82 Sep 11 15:28 luatex

context-suite/luatex-cache/context/5fe67e0bfe781ce0dde776fb1556f32e/formats/luatex:
total 11044
-rw-r--r-- 1 10878224 Sep 11 15:28 cont-en.fmt
-rw-r--r-- 1   414753 Sep 11 15:28 cont-en.log
-rw-r--r-- 1     4118 Sep 11 15:28 cont-en.lui
-rw-r--r-- 1      263 Sep 11 15:28 cont-en.luv

context-suite/luatex-cache/context/5fe67e0bfe781ce0dde776fb1556f32e/trees:
total 752
-rw-r--r-- 1  78031 Sep 11 15:28 3952aa25b6a1b9f9f8d3eeb6e65f0039.lua
-rw-r--r-- 1  45351 Sep 11 15:28 3952aa25b6a1b9f9f8d3eeb6e65f0039.luc
-rw-r--r-- 1    403 Sep 11 15:28 3f406286dc3075cdfb044f836920f46a.lua
-rw-r--r-- 1    398 Sep 11 15:28 3f406286dc3075cdfb044f836920f46a.luc
-rw-r--r-- 1   2026 Sep 11 15:28 3f6978edf9feb817ad6c1f21fc262031.lua
-rw-r--r-- 1   1371 Sep 11 15:28 3f6978edf9feb817ad6c1f21fc262031.luc
-rw-r--r-- 1    407 Sep 11 15:28 71c82419867f9a0df8a150196c03c86f.lua
-rw-r--r-- 1    400 Sep 11 15:28 71c82419867f9a0df8a150196c03c86f.luc
-rw-r--r-- 1    403 Sep 11 15:28 73630a261795d9c53610a28af4550cbc.lua
-rw-r--r-- 1    398 Sep 11 15:28 73630a261795d9c53610a28af4550cbc.luc
-rw-r--r-- 1 164062 Sep 11 15:28 dcb651482955ac31eaab7723b70e0184.lua
-rw-r--r-- 1  86572 Sep 11 15:28 dcb651482955ac31eaab7723b70e0184.luc
-rw-r--r-- 1 225577 Sep 11 15:28 fb39a92c95ceca857c3f2d0ee48a2ad3.lua
-rw-r--r-- 1 117644 Sep 11 15:28 fb39a92c95ceca857c3f2d0ee48a2ad3.luc
-------------------------------------- 8< --------------------------------------

###############################################################################

LUAMETATEX:

-------------------------------------- 8< --------------------------------------
tree $TEXMFCACHE/ | sed -e "s@$HOME/.cache/@@"
lmtx/
└── luatex-cache
    └── context
        └── 5fe67e0bfe781ce0dde776fb1556f32e
            ├── formats
            │   └── luametatex
            │       ├── cont-en.fmt
            │       ├── cont-en.log
            │       ├── cont-en.lui
            │       └── cont-en.luv
            └── trees
                ├── 3952aa25b6a1b9f9f8d3eeb6e65f0039.lua
                ├── 3952aa25b6a1b9f9f8d3eeb6e65f0039.luc
                ├── 3f406286dc3075cdfb044f836920f46a.lua
                ├── 3f406286dc3075cdfb044f836920f46a.luc
                ├── 3f6978edf9feb817ad6c1f21fc262031.lua
                ├── 3f6978edf9feb817ad6c1f21fc262031.luc
                ├── 71c82419867f9a0df8a150196c03c86f.lua
                ├── 71c82419867f9a0df8a150196c03c86f.luc
                ├── 73630a261795d9c53610a28af4550cbc.lua
                ├── 73630a261795d9c53610a28af4550cbc.luc
                ├── dcb651482955ac31eaab7723b70e0184.lua
                ├── dcb651482955ac31eaab7723b70e0184.luc
                ├── fb39a92c95ceca857c3f2d0ee48a2ad3.lua
                └── fb39a92c95ceca857c3f2d0ee48a2ad3.luc

6 directories, 18 files
-------------------------------------- 8< --------------------------------------

-------------------------------------- 8< --------------------------------------
LANG=en_US.UTF-8 ls -goR $TEXMFCACHE/ | sed -e "s@$HOME/.cache/@@"
lmtx/:
total 0
drwxr-xr-x 3 21 Sep 11 15:29 luatex-cache

lmtx/luatex-cache:
total 0
drwxr-xr-x 3 46 Sep 11 15:29 context

lmtx/luatex-cache/context:
total 0
drwxr-xr-x 4 34 Sep 11 15:29 5fe67e0bfe781ce0dde776fb1556f32e

lmtx/luatex-cache/context/5fe67e0bfe781ce0dde776fb1556f32e:
total 4
drwxr-xr-x 3   24 Sep 11 15:29 formats
drwxr-xr-x 2 4096 Sep 11 15:29 trees

lmtx/luatex-cache/context/5fe67e0bfe781ce0dde776fb1556f32e/formats:
total 0
drwxr-xr-x 2 82 Sep 11 15:29 luametatex

lmtx/luatex-cache/context/5fe67e0bfe781ce0dde776fb1556f32e/formats/luametatex:
total 17148
-rw-r--r-- 1 17165315 Sep 11 15:29 cont-en.fmt
-rw-r--r-- 1   377257 Sep 11 15:29 cont-en.log
-rw-r--r-- 1     4118 Sep 11 15:29 cont-en.lui
-rw-r--r-- 1      257 Sep 11 15:29 cont-en.luv

lmtx/luatex-cache/context/5fe67e0bfe781ce0dde776fb1556f32e/trees:
total 452
-rw-r--r-- 1    365 Sep 11 15:29 3952aa25b6a1b9f9f8d3eeb6e65f0039.lua
-rw-r--r-- 1    367 Sep 11 15:29 3952aa25b6a1b9f9f8d3eeb6e65f0039.luc
-rw-r--r-- 1    361 Sep 11 15:29 3f406286dc3075cdfb044f836920f46a.lua
-rw-r--r-- 1    365 Sep 11 15:29 3f406286dc3075cdfb044f836920f46a.luc
-rw-r--r-- 1    489 Sep 11 15:29 3f6978edf9feb817ad6c1f21fc262031.lua
-rw-r--r-- 1    465 Sep 11 15:29 3f6978edf9feb817ad6c1f21fc262031.luc
-rw-r--r-- 1    365 Sep 11 15:29 71c82419867f9a0df8a150196c03c86f.lua
-rw-r--r-- 1    367 Sep 11 15:29 71c82419867f9a0df8a150196c03c86f.luc
-rw-r--r-- 1    361 Sep 11 15:29 73630a261795d9c53610a28af4550cbc.lua
-rw-r--r-- 1    365 Sep 11 15:29 73630a261795d9c53610a28af4550cbc.luc
-rw-r--r-- 1  79655 Sep 11 15:29 dcb651482955ac31eaab7723b70e0184.lua
-rw-r--r-- 1  43851 Sep 11 15:29 dcb651482955ac31eaab7723b70e0184.luc
-rw-r--r-- 1 189893 Sep 11 15:29 fb39a92c95ceca857c3f2d0ee48a2ad3.lua
-rw-r--r-- 1  98765 Sep 11 15:29 fb39a92c95ceca857c3f2d0ee48a2ad3.luc
-------------------------------------- 8< --------------------------------------


The files under 'formats' are "safe" because they are in different
directories but files in 'trees' not only have identical names but also
differ in sizes.

I don't know why both caches have the same directory under
'luatex-cache', I thought it is related to a directory where
mtxrun/context installed but seems I'm wrong.

To be sure that I use correct "package"/"distribution" I often run
commands

  $ context --version

and get for ConTeXt Suite:

  mtx-context     | ConTeXt Process Management 1.03
  mtx-context     |
  mtx-context     | main context file: /usr/local/opt/context/tex/texmf-context/tex/context/base/mkiv/context.mkiv
  mtx-context     | current version: 2019.09.09 13:44
  mtx-context     | main context file: /usr/local/opt/context/tex/texmf-context/tex/context/base/mkiv/context.mkxl
  mtx-context     | current version: 2019.09.09 13:44

and for luametatex:

  mtx-context     | ConTeXt Process Management 1.03
  mtx-context     |
  mtx-context     | main context file: /usr/local/opt/lmtx/tex/texmf-context/tex/context/base/mkiv/context.mkiv
  mtx-context     | current version: 2019.07.24 11:31
  mtx-context     | main context file: /usr/local/opt/lmtx/tex/texmf-context/tex/context/base/mkiv/context.mkxl
  mtx-context     | current version: 2019.09.09 13:55

so I'm sure that this is different "context"s (I'm curious why current
version of mkiv files are different but I suppose it is related to other
"system" files of context).

Is it "safe" to simply run always

  $ mtxrun --generate; context --make

after each context/lmtx update? May be one should add there commands in
'install.sh'?

> so what does the tikz that fails look like (mwe)

I didn't say anything about tikz (I prefer metapost or asymptote
actually).

> Hans
> 
> -----------------------------------------------------------------
>                                           Hans Hagen | PRAGMA ADE
>               Ridderstraat 27 | 8061 GH Hasselt | The Netherlands
>        tel: 038 477 53 69 | www.pragma-ade.nl | www.pragma-pod.nl
> -----------------------------------------------------------------

---
WBR, Vladimir Lomov

-- 
echo "Congratulations.  You aren't running Eunice."
		-- Larry Wall in Configure from the perl distribution

[-- Attachment #1.2: signature.asc --]
[-- Type: application/pgp-signature, Size: 228 bytes --]

[-- Attachment #2: Type: text/plain, Size: 493 bytes --]

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://context.aanhet.net
archive  : https://bitbucket.org/phg/context-mirror/commits/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: context (lmtx) segfaults on x86_64 linux

[Hans Hagen]

On 9/11/2019 10:14 AM, Vladimir Lomov wrote:

> so I'm sure that this is different "context"s (I'm curious why current
> version of mkiv files are different but I suppose it is related to other
> "system" files of context).

the lmtx files can have different solutions because luametatex has some 
possibilities that luatex hasn't (yet or never will have)

> Is it "safe" to simply run always
> 
>    $ mtxrun --generate; context --make
> 
> after each context/lmtx update? May be one should add there commands in
> 'install.sh'?

normally this will happen automatically but there are rare cases when it 
might fail, for instance in lmtx because there is a change in bytecode 
that gets unnoticed (we use the still experimental lua 5.4 there)

Hans

-----------------------------------------------------------------
                                           Hans Hagen | PRAGMA ADE
               Ridderstraat 27 | 8061 GH Hasselt | The Netherlands
        tel: 038 477 53 69 | www.pragma-ade.nl | www.pragma-pod.nl
-----------------------------------------------------------------
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://context.aanhet.net
archive  : https://bitbucket.org/phg/context-mirror/commits/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: context (lmtx) segfaults on x86_64 linux

[Vladimir Lomov]

[-- Attachment #1.1: Type: text/plain, Size: 1477 bytes --]

Hello,
** Hans Hagen [2019-09-11 10:38:21 +0200]:

> On 9/11/2019 10:14 AM, Vladimir Lomov wrote:
> 
>> so I'm sure that this is different "context"s (I'm curious why current
>> version of mkiv files are different but I suppose it is related to other
>> "system" files of context).
> 
> the lmtx files can have different solutions because luametatex has some
> possibilities that luatex hasn't (yet or never will have)

Got it.

>> Is it "safe" to simply run always
>> 
>>    $ mtxrun --generate; context --make
>> 
>> after each context/lmtx update? May be one should add there commands in
>> 'install.sh'?
> 
> normally this will happen automatically but there are rare cases when it
> might fail, for instance in lmtx because there is a change in bytecode that
> gets unnoticed (we use the still experimental lua 5.4 there)

Got it, so as lmtx has "experimental" status, one should pay more
attention, be prepared to run manually 'mtxrun --generate ; context
--make', ok with me.

Thank you Hans for clarification.

> Hans
> 
> -----------------------------------------------------------------
>                                           Hans Hagen | PRAGMA ADE
>               Ridderstraat 27 | 8061 GH Hasselt | The Netherlands
>        tel: 038 477 53 69 | www.pragma-ade.nl | www.pragma-pod.nl
> -----------------------------------------------------------------

---
WBR, Vladimir Lomov

-- 
Subject to change without notice.

[-- Attachment #1.2: signature.asc --]
[-- Type: application/pgp-signature, Size: 228 bytes --]

[-- Attachment #2: Type: text/plain, Size: 493 bytes --]

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://context.aanhet.net
archive  : https://bitbucket.org/phg/context-mirror/commits/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: context (lmtx) segfaults on x86_64 linux

[Hans Hagen]

On 9/11/2019 10:14 AM, Vladimir Lomov wrote:

> LUAMETATEX:
> 
> -------------------------------------- 8< --------------------------------------
> tree $TEXMFCACHE/ | sed -e "s@$HOME/.cache/@@"
> lmtx/
> └── luatex-cache
>      └── context
>          └── 5fe67e0bfe781ce0dde776fb1556f32e
>              ├── formats
>              │   └── luametatex
>              │       ├── cont-en.fmt
>              │       ├── cont-en.log
>              │       ├── cont-en.lui
>              │       └── cont-en.luv

these are regular lua files

>              └── trees
>                  ├── 3952aa25b6a1b9f9f8d3eeb6e65f0039.lua
>                  ├── 3952aa25b6a1b9f9f8d3eeb6e65f0039.luc
>                  ├── 3f406286dc3075cdfb044f836920f46a.lua
>                  ├── 3f406286dc3075cdfb044f836920f46a.luc
>                  ├── 3f6978edf9feb817ad6c1f21fc262031.lua
>                  ├── 3f6978edf9feb817ad6c1f21fc262031.luc
>                  ├── 71c82419867f9a0df8a150196c03c86f.lua
>                  ├── 71c82419867f9a0df8a150196c03c86f.luc
>                  ├── 73630a261795d9c53610a28af4550cbc.lua
>                  ├── 73630a261795d9c53610a28af4550cbc.luc
>                  ├── dcb651482955ac31eaab7723b70e0184.lua
>                  ├── dcb651482955ac31eaab7723b70e0184.luc
>                  ├── fb39a92c95ceca857c3f2d0ee48a2ad3.lua
>                  └── fb39a92c95ceca857c3f2d0ee48a2ad3.luc
actually these *.luc files should be *.lud files so I need to check that

Hans

-----------------------------------------------------------------
                                           Hans Hagen | PRAGMA ADE
               Ridderstraat 27 | 8061 GH Hasselt | The Netherlands
        tel: 038 477 53 69 | www.pragma-ade.nl | www.pragma-pod.nl
-----------------------------------------------------------------
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://context.aanhet.net
archive  : https://bitbucket.org/phg/context-mirror/commits/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: context (lmtx) segfaults on x86_64 linux

[Vladimir Lomov]

[-- Attachment #1.1: Type: text/plain, Size: 2484 bytes --]

Hello
** Hans Hagen [2019-09-11 10:54:41 +0200]:

> On 9/11/2019 10:14 AM, Vladimir Lomov wrote:
> 
>> LUAMETATEX:
>> 
>> -------------------------------------- 8< --------------------------------------
>> tree $TEXMFCACHE/ | sed -e "s@$HOME/.cache/@@"
>> lmtx/
>> └── luatex-cache
>>      └── context
>>          └── 5fe67e0bfe781ce0dde776fb1556f32e
>>              ├── formats
>>              │   └── luametatex
>>              │       ├── cont-en.fmt
>>              │       ├── cont-en.log
>>              │       ├── cont-en.lui
>>              │       └── cont-en.luv
> 
> these are regular lua files

The last two, Ok.

> 
>>              └── trees
>>                  ├── 3952aa25b6a1b9f9f8d3eeb6e65f0039.lua
>>                  ├── 3952aa25b6a1b9f9f8d3eeb6e65f0039.luc
>>                  ├── 3f406286dc3075cdfb044f836920f46a.lua
>>                  ├── 3f406286dc3075cdfb044f836920f46a.luc
>>                  ├── 3f6978edf9feb817ad6c1f21fc262031.lua
>>                  ├── 3f6978edf9feb817ad6c1f21fc262031.luc
>>                  ├── 71c82419867f9a0df8a150196c03c86f.lua
>>                  ├── 71c82419867f9a0df8a150196c03c86f.luc
>>                  ├── 73630a261795d9c53610a28af4550cbc.lua
>>                  ├── 73630a261795d9c53610a28af4550cbc.luc
>>                  ├── dcb651482955ac31eaab7723b70e0184.lua
>>                  ├── dcb651482955ac31eaab7723b70e0184.luc
>>                  ├── fb39a92c95ceca857c3f2d0ee48a2ad3.lua
>>                  └── fb39a92c95ceca857c3f2d0ee48a2ad3.luc
> actually these *.luc files should be *.lud files so I need to check that

That make sense, lua, (lub), luc, lud but even lua files are different
or do you mean that luc/lud are generated (compiled) from lua and then
contex don't read them only luc/lud?

> 
> Hans
> 
> -----------------------------------------------------------------
>                                           Hans Hagen | PRAGMA ADE
>               Ridderstraat 27 | 8061 GH Hasselt | The Netherlands
>        tel: 038 477 53 69 | www.pragma-ade.nl | www.pragma-pod.nl
> -----------------------------------------------------------------

---
WBR, Vladimir Lomov

-- 
Besides, REAL computers have a rename() system call.    :-)
		-- Larry Wall in <7937@jpl-devvax.JPL.NASA.GOV>

[-- Attachment #1.2: signature.asc --]
[-- Type: application/pgp-signature, Size: 228 bytes --]

[-- Attachment #2: Type: text/plain, Size: 493 bytes --]

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://context.aanhet.net
archive  : https://bitbucket.org/phg/context-mirror/commits/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: context (lmtx) segfaults on x86_64 linux

[Hans Hagen]

On 9/11/2019 11:02 AM, Vladimir Lomov wrote:

>>>               │       ├── cont-en.lui
>>>               │       └── cont-en.luv
>>
>> these are regular lua files
> 
> The last two, Ok.

Indeed. These are startup related files.

> That make sense, lua, (lub), luc, lud but even lua files are different
> or do you mean that luc/lud are generated (compiled) from lua and then
> contex don't read them only luc/lud?
The lua files are probably not that different but indeed the other ones 
are bytecode files and normally read (with the lua files as fallbacks in 
case of a failure) which is more efficient (a =lua, c = luatex bytecode 
(5.3), b = luajit bytecode (hybrid 5.1 / 5.2), d = luametatex bytecode 
(5.4). At some point the jit variant might be dropped and in the long 
run we might only have luametatex.

Hans

-----------------------------------------------------------------
                                           Hans Hagen | PRAGMA ADE
               Ridderstraat 27 | 8061 GH Hasselt | The Netherlands
        tel: 038 477 53 69 | www.pragma-ade.nl | www.pragma-pod.nl
-----------------------------------------------------------------
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://context.aanhet.net
archive  : https://bitbucket.org/phg/context-mirror/commits/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: context (lmtx) segfaults on x86_64 linux

[Hans Hagen]

On 9/11/2019 1:19 AM, Henri Menke wrote:
> On 9/11/19 3:50 AM, Aditya Mahajan wrote:
>> On Tue, 10 Sep 2019, Hans Hagen wrote:
>>
>>> On 9/10/2019 4:11 PM, Vladimir Lomov wrote:
>>>> Hello,
>>>> today I updated lmtx and on simple
>>>>
>>>>     $ context --version
>>>>
>>>> I get segfault (in the same time luametatex --version works fine).
>>>> Running under gdb shows me that the problem might be in one of 'realloc'
>>>> calls.
>>>>
>>>> The context from Context Suite (mkiv) works fine.
>>>>
>>>> P.S. I tested on two systems, both runs Archlinux x86_64.
>>> can you completely wipe the texmf-cache directory and then run
>>>
>>> mtxrun --generate
>>> context --make
>>>
>>> (there is a change in bytecode that gets not automatically noticed that
>>> can give that crash)
>>
>> I had the same issue and completely wiping the texmf-cache fixes it.
>>
>> @Vladimir: If you are using the luametatex package from AUR, then the
>> texmf-cache is located at $HOME/.cache/luametatex.
> 
> I'm receiving the super helpful error message:
> 
>      ! error (lua): function call: no

there is not much context to present there as it means that deep down a 
bad function token is expanded, something under control of the macro 
package, which then has/is messed up

> Maybe some sort of cache versioning is in order to at least give a better error.

for now, adding

\ifdefined\pdfsavepos\else
     \let\pdfsavepos \savepos
     \let\pdflastxpos\lastxpos
     \let\pdflastypos\lastypos
\fi

to cont-new.mkiv seems to work ok

Hans

-----------------------------------------------------------------
                                           Hans Hagen | PRAGMA ADE
               Ridderstraat 27 | 8061 GH Hasselt | The Netherlands
        tel: 038 477 53 69 | www.pragma-ade.nl | www.pragma-pod.nl
-----------------------------------------------------------------
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://context.aanhet.net
archive  : https://bitbucket.org/phg/context-mirror/commits/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: context (lmtx) segfaults on x86_64 linux

[Vladimir Lomov]

[-- Attachment #1.1: Type: text/plain, Size: 1791 bytes --]

Hello,
** Hans Hagen [2019-09-10 17:18:45 +0200]:

> On 9/10/2019 4:11 PM, Vladimir Lomov wrote:
>> Hello,
>> today I updated lmtx and on simple
>>    $ context --version
>> 
>> I get segfault (in the same time luametatex --version works fine).
>> Running under gdb shows me that the problem might be in one of 'realloc'
>> calls.
>> 
>> The context from Context Suite (mkiv) works fine.
>> 
>> P.S. I tested on two systems, both runs Archlinux x86_64.
> can you completely wipe the texmf-cache directory and then run
> 
> mtxrun --generate
> context --make
> 
> (there is a change in bytecode that gets not automatically noticed that can
> give that crash)

Yes, that "fixed" the problem, thank you.

> Hans
> 
> -----------------------------------------------------------------
>                                           Hans Hagen | PRAGMA ADE
>               Ridderstraat 27 | 8061 GH Hasselt | The Netherlands
>        tel: 038 477 53 69 | www.pragma-ade.nl | www.pragma-pod.nl
> -----------------------------------------------------------------

---
WBR, Vladimir Lomov

-- 
Got a wife and kids in Baltimore Jack,
I went out for a ride and never came back.
Like a river that don't know where it's flowing,
I took a wrong turn and I just kept going.

	Everybody's got a hungry heart.
	Everybody's got a hungry heart.
	Lay down your money and you play your part,
	Everybody's got a hungry heart.

I met her in a Kingstown bar,
We fell in love, I knew it had to end.
We took what we had and we ripped it apart,
Now here I am down in Kingstown again.

Everybody needs a place to rest,
Everybody wants to have a home.
Don't make no difference what nobody says,
Ain't nobody likes to be alone.
		-- Bruce Springsteen, "Hungry Heart"

[-- Attachment #1.2: signature.asc --]
[-- Type: application/pgp-signature, Size: 228 bytes --]

[-- Attachment #2: Type: text/plain, Size: 493 bytes --]

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://context.aanhet.net
archive  : https://bitbucket.org/phg/context-mirror/commits/
wiki     : http://contextgarden.net
___________________________________________________________________________________