On Wed, Jun 10, 2020 at = 4:03 AM Hans Hagen <j.hagen@xs4all.= nl> wrote:

Hi,

I uploaded a new version. There have been no changes to the typesetting machinery although we're still in the process of finetuning some update= d
low level macros. There was a fix in the font machinery (thanks to Kai) but that will probably go unnoticed as the issue has been there for years.<= br>
Now, that doesn't mean that nothing has been changed. First of all ther= e
is a new data related mechanism. After Wolfgang had updated the
definition files it became official. It was on the agenda for a while
but finally a nice solution surfaced.

The new thing is luatables that obey grouping. Normally what you do at
the lua end is kind of global, but there can be cases where you really
want it to behave like tex: obeying \bgroup/\egroup, { } etc. The
examples given below show that you can create them at the tex end and
access them in tex as well as lua.

\starttext

\dorecurse {100} {
=C2=A0 =C2=A0 =C2=A0\setdatavalue{#1}{#1}
}

\start \tttf \darkred \raggedright \dorecurse {100} {
=C2=A0 =C2=A0 =C2=A0#1=3D\scratchcounter\getdatavalue{#1}\the\scratchcounte= r
} \par \stop \blank

\start \tttf \darkgreen \raggedright \dorecurse {100} {
=C2=A0 =C2=A0 =C2=A0#1=3D\thedatavalue{#1}%
} \par \stop \blank

\bgroup \tttf
=C2=A0 =C2=A0 =C2=A0\newluatable\testtable
=C2=A0 =C2=A0 =C2=A0\setluatable\testtable{ foo =3D 123, bar =3D "456&= quot;, oof =3D "rab" }
=C2=A0 =C2=A0% \inspectluatable\testtable
=C2=A0 =C2=A0 =C2=A0\darkblue
=C2=A0 =C2=A0 =C2=A0foo =3D \getfromluatable\testtable{foo}\par
=C2=A0 =C2=A0 =C2=A0bar =3D \getfromluatable\testtable{bar}\par
=C2=A0 =C2=A0 =C2=A0oof =3D \getfromluatable\testtable{oof}\blank
=C2=A0 =C2=A0 =C2=A0\bgroup
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0\useluatable\testtable
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0\setluatable\testtable{ foo =3D 123123, b= ar =3D "456456" }
=C2=A0 =C2=A0 =C2=A0 =C2=A0% \inspectluatable\testtable
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0\darkmagenta
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0foo =3D \getfromluatable\testtable{foo}\p= ar
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0bar =3D \getfromluatable\testtable{bar}\p= ar
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0oof =3D \getfromluatable\testtable{oof}\b= lank
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0\startluacode
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0local t =3D context.luatabl= es.get("testtable")
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0print(t.foo,t.bar,t.oof) =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0\stopluacode
=C2=A0 =C2=A0 =C2=A0\egroup
=C2=A0 =C2=A0 =C2=A0\darkyellow
=C2=A0 =C2=A0 =C2=A0foo =3D \getfromluatable\testtable{foo}\par
=C2=A0 =C2=A0 =C2=A0bar =3D \getfromluatable\testtable{bar}\par
=C2=A0 =C2=A0 =C2=A0oof =3D \getfromluatable\testtable{oof}\blank
=C2=A0 =C2=A0 =C2=A0\startluacode
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0local t =3D context.luatables.get("t= esttable")
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0print(t.foo,t.bar,t.oof)
=C2=A0 =C2=A0 =C2=A0\stopluacode
=C2=A0 =C2=A0% \inspectluatable\testtable
\egroup

\bgroup \tttf
=C2=A0 =C2=A0 =C2=A0\newluatable\moretable
=C2=A0 =C2=A0 =C2=A0\setluatable\moretable{ 1, "foo" }
=C2=A0 =C2=A0 =C2=A0\darkblue
=C2=A0 =C2=A0 =C2=A0[1] =3D \getfromluatable\moretable{1}\par
=C2=A0 =C2=A0 =C2=A0[2] =3D \idxfromluatable\moretable 2 \blank
=C2=A0 =C2=A0 =C2=A0\bgroup
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0\useluatable\moretable
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0\setluatable\moretable{ foo =3D 123123, b= ar =3D "456456" }
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0\darkmagenta
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0[1] =3D \getfromluatable\moretable{1}\par=
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0[2] =3D \idxfromluatable\moretable 2 \bla= nk
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0\startluacode
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0local t =3D context.luatabl= es.get("moretable")
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0print(t[1],t[2])
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0\stopluacode
=C2=A0 =C2=A0 =C2=A0\egroup
=C2=A0 =C2=A0 =C2=A0\darkyellow
=C2=A0 =C2=A0 =C2=A0[1] =3D \getfromluatable\moretable{1}\par
=C2=A0 =C2=A0 =C2=A0[2] =3D \idxfromluatable\moretable 2 \blank
=C2=A0 =C2=A0 =C2=A0\startluacode
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0local t =3D context.luatables.get("m= oretable")
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0print(t[1],t[2])
=C2=A0 =C2=A0 =C2=A0\stopluacode
\egroup

\stoptext

This is only available in lmtx (until i see a real reason to cook up an alternative for mkiv, which is unlikely as no context code depends on
this being available, at least not now). The datavalue macro you see
there can be used to create massive amounts of numeric variable
independent of counters, not that we really need it, but it was very
cheap to implement.

At the engine level there also have been some changes but these should
not be visible for users. We just mention:

- extensions to the macro definition and expansion mechanisms (for
instance optional arguments, optional delimiters, and silent error
recovery; there will be some explanation in the evenmore document and at some point - when stable - in the manual) .. this permits some cleaner
low level code; only things were done that had no impact on performance (as macro definition and expansion is used a lot) and didn't make the <= br> code messy (it actually became cleaner)

- some additional substring (ok, tex has no string, just tokens) parsing capabilities with optional tokens, which again permits a bit cleaner low level code

- a slightly reorganized handling of tokens (one of tex's basic data structures) in the lua token interface so that we get a more meaningful and robust subsystem (basically getting rid of funny numbers) ... this
also will be discussed in an evenmore chapter .. not that users need it (i think)

- as a side effect (or necessity) some low level recoding (and
abstraction) had to happen but as far as we can see it works ok (i admit it was a slow, tedious job with lots of intermediate testing on the
suite to make sure nothign was broken) .. in the end it was all doable
because most of the preparation was already done over the last years

- in the process we got rid of a traditional tex data structure that was left over from the 32 bit times but no longer needed in our 64 bit
luatex/luametatex universe (i might backport that simplification to
luatex some day) ... it discards some checking and saves the same amount of memory that we had on the early day pc's (where we ran whole tex job= s
in that amount)

Of course ... all kind of small improvenments ... hopefully for the best,
Hans

-----------------------------------------------------------------
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0Hans Hagen | PRAGMA ADE
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Ridderstraat 27 | 80= 61 GH Hasselt | The Netherlands
=C2=A0 =C2=A0 =C2=A0 =C2=A0 tel: 038 477 53 69 | www.pragma-ade.nl | www.= pragma-pod.nl
-----------------------------------------------------------------
___________________________________________________________________________= ________
If your question is of interest to others as well, please add an entry to t= he Wiki!

maillist : ntg-cont= ext@ntg.nl / http://www.ntg.nl/mailman/listinfo/nt= g-context
webpage=C2=A0 : http://www.pragma-ade.nl / http://context.aanhet.net=
archive=C2=A0 : https://bitbucket.org/phg/context-m= irror/commits/
wiki=C2=A0 =C2=A0 =C2=A0: http://contextgarden.net
___________________________________________________________________________= ________