[NTG-context] Memory consumption in new upload

[NTG-context] Memory consumption in new upload

[Shiv Shankar Dayal]

[-- Attachment #1.1: Type: text/plain, Size: 264 bytes --]

Thanks for new upload. I see that memory consumption is much less than
previous version. So
once again, thanks a lot.

I am curious about what has changed in recent upload, that memory
consumption is about 60% of earlier versions.

-- 
Respect,
Shiv Shankar Dayal

[-- Attachment #1.2: Type: text/html, Size: 513 bytes --]

[-- Attachment #2: Type: text/plain, Size: 511 bytes --]

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / https://mailman.ntg.nl/mailman3/lists/ntg-context.ntg.nl
webpage  : https://www.pragma-ade.nl / https://context.aanhet.net (mirror)
archive  : https://github.com/contextgarden/context
wiki     : https://wiki.contextgarden.net
___________________________________________________________________________________

[NTG-context] Re: Memory consumption in new upload

[Hans Hagen]

On 2/17/2024 6:17 PM, Shiv Shankar Dayal wrote:
> Thanks for new upload. I see that memory consumption is much less than 
> previous version. So
> once again, thanks a lot.
> 
> I am curious about what has changed in recent upload, that memory 
> consumption is about 60% of earlier versions.
it's hard to tell what exact consumpiton is becaue for instance when lua 
creates tables, they grow by factors two when then have to (maybe 5.5 is 
a bit less consuming)

on the one hand luametatex is more efficient than luatex due to all kind 
of ímprovements' but some nodes are larger so that takes more memory, 
which is only noticed when one has lots of text on a page (or keeps 
boxes stuff around)

anyway, not that much changed since the previous upload, so maybe you 
just stay below a threshold

I recently generated a 180MB document with 2500 fonts + metapost 
outlines of them and that could bump mem usage (with empty cache) to 30 
GB (less after fonts were cached) but normally we stay around 125 MB for 
a document. Anyway, tex mem consumption can often be neglected compared 
to other applications.

Hans


-----------------------------------------------------------------
                                           Hans Hagen | PRAGMA ADE
               Ridderstraat 27 | 8061 GH Hasselt | The Netherlands
        tel: 038 477 53 69 | www.pragma-ade.nl | www.pragma-pod.nl
-----------------------------------------------------------------

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / https://mailman.ntg.nl/mailman3/lists/ntg-context.ntg.nl
webpage  : https://www.pragma-ade.nl / https://context.aanhet.net (mirror)
archive  : https://github.com/contextgarden/context
wiki     : https://wiki.contextgarden.net
___________________________________________________________________________________

[NTG-context] Re: Memory consumption in new upload

[Shiv Shankar Dayal]

[-- Attachment #1.1: Type: text/plain, Size: 2511 bytes --]

The only change I made was that I started using a 9pt modern font than a 10
pt modern font.

My document decreased from 580+ pages to 500 pages after that.

About your document, I assume you had a lot of Graphics because text only
180MB is too high.
I have only few diagrams and my file size is only 3MB.

On Sun, Feb 18, 2024 at 2:13 AM Hans Hagen <j.hagen@xs4all.nl> wrote:

> On 2/17/2024 6:17 PM, Shiv Shankar Dayal wrote:
> > Thanks for new upload. I see that memory consumption is much less than
> > previous version. So
> > once again, thanks a lot.
> >
> > I am curious about what has changed in recent upload, that memory
> > consumption is about 60% of earlier versions.
> it's hard to tell what exact consumpiton is becaue for instance when lua
> creates tables, they grow by factors two when then have to (maybe 5.5 is
> a bit less consuming)
>
> on the one hand luametatex is more efficient than luatex due to all kind
> of ímprovements' but some nodes are larger so that takes more memory,
> which is only noticed when one has lots of text on a page (or keeps
> boxes stuff around)
>
> anyway, not that much changed since the previous upload, so maybe you
> just stay below a threshold
>
> I recently generated a 180MB document with 2500 fonts + metapost
> outlines of them and that could bump mem usage (with empty cache) to 30
> GB (less after fonts were cached) but normally we stay around 125 MB for
> a document. Anyway, tex mem consumption can often be neglected compared
> to other applications.
>
> Hans
>
>
> -----------------------------------------------------------------
>                                            Hans Hagen | PRAGMA ADE
>                Ridderstraat 27 | 8061 GH Hasselt | The Netherlands
>         tel: 038 477 53 69 | www.pragma-ade.nl | www.pragma-pod.nl
> -----------------------------------------------------------------
>
>
> ___________________________________________________________________________________
> If your question is of interest to others as well, please add an entry to
> the Wiki!
>
> maillist : ntg-context@ntg.nl /
> https://mailman.ntg.nl/mailman3/lists/ntg-context.ntg.nl
> webpage  : https://www.pragma-ade.nl / https://context.aanhet.net (mirror)
> archive  : https://github.com/contextgarden/context
> wiki     : https://wiki.contextgarden.net
>
> ___________________________________________________________________________________
>


-- 
Respect,
Shiv Shankar Dayal

[-- Attachment #1.2: Type: text/html, Size: 3761 bytes --]

[-- Attachment #2: Type: text/plain, Size: 511 bytes --]

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / https://mailman.ntg.nl/mailman3/lists/ntg-context.ntg.nl
webpage  : https://www.pragma-ade.nl / https://context.aanhet.net (mirror)
archive  : https://github.com/contextgarden/context
wiki     : https://wiki.contextgarden.net
___________________________________________________________________________________

[NTG-context] Re: Memory consumption in new upload

[Shiv Shankar Dayal]

[-- Attachment #1.1: Type: text/plain, Size: 2871 bytes --]

I assume you would have created typescripts for those fonts. Can you please
add them to
ConTeXt distribution, at least for the popular fonts?

On Sun, Feb 18, 2024 at 3:12 AM Shiv Shankar Dayal <
shivshankar.dayal@gmail.com> wrote:

> The only change I made was that I started using a 9pt modern font than a
> 10 pt modern font.
>
> My document decreased from 580+ pages to 500 pages after that.
>
> About your document, I assume you had a lot of Graphics because text only
> 180MB is too high.
> I have only few diagrams and my file size is only 3MB.
>
> On Sun, Feb 18, 2024 at 2:13 AM Hans Hagen <j.hagen@xs4all.nl> wrote:
>
>> On 2/17/2024 6:17 PM, Shiv Shankar Dayal wrote:
>> > Thanks for new upload. I see that memory consumption is much less than
>> > previous version. So
>> > once again, thanks a lot.
>> >
>> > I am curious about what has changed in recent upload, that memory
>> > consumption is about 60% of earlier versions.
>> it's hard to tell what exact consumpiton is becaue for instance when lua
>> creates tables, they grow by factors two when then have to (maybe 5.5 is
>> a bit less consuming)
>>
>> on the one hand luametatex is more efficient than luatex due to all kind
>> of ímprovements' but some nodes are larger so that takes more memory,
>> which is only noticed when one has lots of text on a page (or keeps
>> boxes stuff around)
>>
>> anyway, not that much changed since the previous upload, so maybe you
>> just stay below a threshold
>>
>> I recently generated a 180MB document with 2500 fonts + metapost
>> outlines of them and that could bump mem usage (with empty cache) to 30
>> GB (less after fonts were cached) but normally we stay around 125 MB for
>> a document. Anyway, tex mem consumption can often be neglected compared
>> to other applications.
>>
>> Hans
>>
>>
>> -----------------------------------------------------------------
>>                                            Hans Hagen | PRAGMA ADE
>>                Ridderstraat 27 | 8061 GH Hasselt | The Netherlands
>>         tel: 038 477 53 69 | www.pragma-ade.nl | www.pragma-pod.nl
>> -----------------------------------------------------------------
>>
>>
>> ___________________________________________________________________________________
>> If your question is of interest to others as well, please add an entry to
>> the Wiki!
>>
>> maillist : ntg-context@ntg.nl /
>> https://mailman.ntg.nl/mailman3/lists/ntg-context.ntg.nl
>> webpage  : https://www.pragma-ade.nl / https://context.aanhet.net
>> (mirror)
>> archive  : https://github.com/contextgarden/context
>> wiki     : https://wiki.contextgarden.net
>>
>> ___________________________________________________________________________________
>>
>
>
> --
> Respect,
> Shiv Shankar Dayal
>


-- 
Respect,
Shiv Shankar Dayal

[-- Attachment #1.2: Type: text/html, Size: 4501 bytes --]

[-- Attachment #2: Type: text/plain, Size: 511 bytes --]

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / https://mailman.ntg.nl/mailman3/lists/ntg-context.ntg.nl
webpage  : https://www.pragma-ade.nl / https://context.aanhet.net (mirror)
archive  : https://github.com/contextgarden/context
wiki     : https://wiki.contextgarden.net
___________________________________________________________________________________

[NTG-context] Re: Memory consumption in new upload

[Hans Hagen]

On 2/17/2024 10:50 PM, Shiv Shankar Dayal wrote:
> I assume you would have created typescripts for those fonts. Can you 
> please add them to
> ConTeXt distribution, at least for the popular fonts?

Many of those are covered by typescripts. Those that are not, are on my 
machine because we needed them (often long ago) for a project (these are 
commercial fonts, in most cases typeone and of such a collection 
actually a few were used then). There are also some commercial fonts 
that I got for free. Then there are fonts that I have to check because 
users had an issue (public ones, of different quality and useability). 
Of those 'trying to cover all of unicode with  different fonts of the 
same design' I tested subsets. And of course the fonts that come with 
the operating system (basically all fonts that context can access during 
a run).

We're not going to make typescripts for every combination as in practice 
for most documents one needs a single setup and therefore only a handful 
of lines of code (and likely use some typescript file for a math font). 
There's also the selectfont mechanism that uses heuristics to do the 
same. There are plenty of examples in the distribution and for a 
specific style that demands certain fonts one can also put the 
definitions in the style.

> On Sun, Feb 18, 2024 at 3:12 AM Shiv Shankar Dayal 
> <shivshankar.dayal@gmail.com <mailto:shivshankar.dayal@gmail.com>> wrote:
> 
>     The only change I made was that I started using a 9pt modern font
>     than a 10 pt modern font.
> 
>     My document decreased from 580+ pages to 500 pages after that.
> 
>     About your document, I assume you had a lot of Graphics because text
>     only 180MB is too high.
>     I have only few diagrams and my file size is only 3MB.
> 
>     On Sun, Feb 18, 2024 at 2:13 AM Hans Hagen <j.hagen@xs4all.nl
>     <mailto:j.hagen@xs4all.nl>> wrote:
> 
>         On 2/17/2024 6:17 PM, Shiv Shankar Dayal wrote:
>          > Thanks for new upload. I see that memory consumption is much
>         less than
>          > previous version. So
>          > once again, thanks a lot.
>          >
>          > I am curious about what has changed in recent upload, that
>         memory
>          > consumption is about 60% of earlier versions.
>         it's hard to tell what exact consumpiton is becaue for instance
>         when lua
>         creates tables, they grow by factors two when then have to
>         (maybe 5.5 is
>         a bit less consuming)
> 
>         on the one hand luametatex is more efficient than luatex due to
>         all kind
>         of ímprovements' but some nodes are larger so that takes more
>         memory,
>         which is only noticed when one has lots of text on a page (or keeps
>         boxes stuff around)
> 
>         anyway, not that much changed since the previous upload, so
>         maybe you
>         just stay below a threshold
> 
>         I recently generated a 180MB document with 2500 fonts + metapost
>         outlines of them and that could bump mem usage (with empty
>         cache) to 30
>         GB (less after fonts were cached) but normally we stay around
>         125 MB for
>         a document. Anyway, tex mem consumption can often be neglected
>         compared
>         to other applications.
> 
>         Hans
> 
> 
>         -----------------------------------------------------------------
>                                                     Hans Hagen | PRAGMA ADE
>                         Ridderstraat 27 | 8061 GH Hasselt | The Netherlands
>                  tel: 038 477 53 69 | www.pragma-ade.nl
>         <http://www.pragma-ade.nl> | www.pragma-pod.nl
>         <http://www.pragma-pod.nl>
>         -----------------------------------------------------------------
> 
>         ___________________________________________________________________________________
>         If your question is of interest to others as well, please add an
>         entry to the Wiki!
> 
>         maillist : ntg-context@ntg.nl <mailto:ntg-context@ntg.nl> /
>         https://mailman.ntg.nl/mailman3/lists/ntg-context.ntg.nl
>         <https://mailman.ntg.nl/mailman3/lists/ntg-context.ntg.nl>
>         webpage  : https://www.pragma-ade.nl <https://www.pragma-ade.nl>
>         / https://context.aanhet.net <https://context.aanhet.net> (mirror)
>         archive  : https://github.com/contextgarden/context
>         <https://github.com/contextgarden/context>
>         wiki     : https://wiki.contextgarden.net
>         <https://wiki.contextgarden.net>
>         ___________________________________________________________________________________
> 
> 
> 
>     -- 
>     Respect,
>     Shiv Shankar Dayal
> 
> 
> 
> -- 
> Respect,
> Shiv Shankar Dayal
> 
> ___________________________________________________________________________________
> If your question is of interest to others as well, please add an entry to the Wiki!
> 
> maillist : ntg-context@ntg.nl / https://mailman.ntg.nl/mailman3/lists/ntg-context.ntg.nl
> webpage  : https://www.pragma-ade.nl / https://context.aanhet.net (mirror)
> archive  : https://github.com/contextgarden/context
> wiki     : https://wiki.contextgarden.net
> ___________________________________________________________________________________

-- 

-----------------------------------------------------------------
                                           Hans Hagen | PRAGMA ADE
               Ridderstraat 27 | 8061 GH Hasselt | The Netherlands
        tel: 038 477 53 69 | www.pragma-ade.nl | www.pragma-pod.nl
-----------------------------------------------------------------

___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / https://mailman.ntg.nl/mailman3/lists/ntg-context.ntg.nl
webpage  : https://www.pragma-ade.nl / https://context.aanhet.net (mirror)
archive  : https://github.com/contextgarden/context
wiki     : https://wiki.contextgarden.net
___________________________________________________________________________________