* [NTG-context] Memory consumption in new upload @ 2024-02-17 17:17 Shiv Shankar Dayal 2024-02-17 20:39 ` [NTG-context] " Hans Hagen 0 siblings, 1 reply; 5+ messages in thread From: Shiv Shankar Dayal @ 2024-02-17 17:17 UTC (permalink / raw) To: mailing list for ConTeXt users [-- Attachment #1.1: Type: text/plain, Size: 264 bytes --] Thanks for new upload. I see that memory consumption is much less than previous version. So once again, thanks a lot. I am curious about what has changed in recent upload, that memory consumption is about 60% of earlier versions. -- Respect, Shiv Shankar Dayal [-- Attachment #1.2: Type: text/html, Size: 513 bytes --] [-- Attachment #2: Type: text/plain, Size: 511 bytes --] ___________________________________________________________________________________ If your question is of interest to others as well, please add an entry to the Wiki! maillist : ntg-context@ntg.nl / https://mailman.ntg.nl/mailman3/lists/ntg-context.ntg.nl webpage : https://www.pragma-ade.nl / https://context.aanhet.net (mirror) archive : https://github.com/contextgarden/context wiki : https://wiki.contextgarden.net ___________________________________________________________________________________ ^ permalink raw reply [flat|nested] 5+ messages in thread
* [NTG-context] Re: Memory consumption in new upload 2024-02-17 17:17 [NTG-context] Memory consumption in new upload Shiv Shankar Dayal @ 2024-02-17 20:39 ` Hans Hagen 2024-02-17 21:42 ` Shiv Shankar Dayal 0 siblings, 1 reply; 5+ messages in thread From: Hans Hagen @ 2024-02-17 20:39 UTC (permalink / raw) To: ntg-context On 2/17/2024 6:17 PM, Shiv Shankar Dayal wrote: > Thanks for new upload. I see that memory consumption is much less than > previous version. So > once again, thanks a lot. > > I am curious about what has changed in recent upload, that memory > consumption is about 60% of earlier versions. it's hard to tell what exact consumpiton is becaue for instance when lua creates tables, they grow by factors two when then have to (maybe 5.5 is a bit less consuming) on the one hand luametatex is more efficient than luatex due to all kind of ímprovements' but some nodes are larger so that takes more memory, which is only noticed when one has lots of text on a page (or keeps boxes stuff around) anyway, not that much changed since the previous upload, so maybe you just stay below a threshold I recently generated a 180MB document with 2500 fonts + metapost outlines of them and that could bump mem usage (with empty cache) to 30 GB (less after fonts were cached) but normally we stay around 125 MB for a document. Anyway, tex mem consumption can often be neglected compared to other applications. Hans ----------------------------------------------------------------- Hans Hagen | PRAGMA ADE Ridderstraat 27 | 8061 GH Hasselt | The Netherlands tel: 038 477 53 69 | www.pragma-ade.nl | www.pragma-pod.nl ----------------------------------------------------------------- ___________________________________________________________________________________ If your question is of interest to others as well, please add an entry to the Wiki! maillist : ntg-context@ntg.nl / https://mailman.ntg.nl/mailman3/lists/ntg-context.ntg.nl webpage : https://www.pragma-ade.nl / https://context.aanhet.net (mirror) archive : https://github.com/contextgarden/context wiki : https://wiki.contextgarden.net ___________________________________________________________________________________ ^ permalink raw reply [flat|nested] 5+ messages in thread
* [NTG-context] Re: Memory consumption in new upload 2024-02-17 20:39 ` [NTG-context] " Hans Hagen @ 2024-02-17 21:42 ` Shiv Shankar Dayal 2024-02-17 21:50 ` Shiv Shankar Dayal 0 siblings, 1 reply; 5+ messages in thread From: Shiv Shankar Dayal @ 2024-02-17 21:42 UTC (permalink / raw) To: mailing list for ConTeXt users [-- Attachment #1.1: Type: text/plain, Size: 2511 bytes --] The only change I made was that I started using a 9pt modern font than a 10 pt modern font. My document decreased from 580+ pages to 500 pages after that. About your document, I assume you had a lot of Graphics because text only 180MB is too high. I have only few diagrams and my file size is only 3MB. On Sun, Feb 18, 2024 at 2:13 AM Hans Hagen <j.hagen@xs4all.nl> wrote: > On 2/17/2024 6:17 PM, Shiv Shankar Dayal wrote: > > Thanks for new upload. I see that memory consumption is much less than > > previous version. So > > once again, thanks a lot. > > > > I am curious about what has changed in recent upload, that memory > > consumption is about 60% of earlier versions. > it's hard to tell what exact consumpiton is becaue for instance when lua > creates tables, they grow by factors two when then have to (maybe 5.5 is > a bit less consuming) > > on the one hand luametatex is more efficient than luatex due to all kind > of ímprovements' but some nodes are larger so that takes more memory, > which is only noticed when one has lots of text on a page (or keeps > boxes stuff around) > > anyway, not that much changed since the previous upload, so maybe you > just stay below a threshold > > I recently generated a 180MB document with 2500 fonts + metapost > outlines of them and that could bump mem usage (with empty cache) to 30 > GB (less after fonts were cached) but normally we stay around 125 MB for > a document. Anyway, tex mem consumption can often be neglected compared > to other applications. > > Hans > > > ----------------------------------------------------------------- > Hans Hagen | PRAGMA ADE > Ridderstraat 27 | 8061 GH Hasselt | The Netherlands > tel: 038 477 53 69 | www.pragma-ade.nl | www.pragma-pod.nl > ----------------------------------------------------------------- > > > ___________________________________________________________________________________ > If your question is of interest to others as well, please add an entry to > the Wiki! > > maillist : ntg-context@ntg.nl / > https://mailman.ntg.nl/mailman3/lists/ntg-context.ntg.nl > webpage : https://www.pragma-ade.nl / https://context.aanhet.net (mirror) > archive : https://github.com/contextgarden/context > wiki : https://wiki.contextgarden.net > > ___________________________________________________________________________________ > -- Respect, Shiv Shankar Dayal [-- Attachment #1.2: Type: text/html, Size: 3761 bytes --] [-- Attachment #2: Type: text/plain, Size: 511 bytes --] ___________________________________________________________________________________ If your question is of interest to others as well, please add an entry to the Wiki! maillist : ntg-context@ntg.nl / https://mailman.ntg.nl/mailman3/lists/ntg-context.ntg.nl webpage : https://www.pragma-ade.nl / https://context.aanhet.net (mirror) archive : https://github.com/contextgarden/context wiki : https://wiki.contextgarden.net ___________________________________________________________________________________ ^ permalink raw reply [flat|nested] 5+ messages in thread
* [NTG-context] Re: Memory consumption in new upload 2024-02-17 21:42 ` Shiv Shankar Dayal @ 2024-02-17 21:50 ` Shiv Shankar Dayal 2024-02-17 22:41 ` Hans Hagen 0 siblings, 1 reply; 5+ messages in thread From: Shiv Shankar Dayal @ 2024-02-17 21:50 UTC (permalink / raw) To: mailing list for ConTeXt users [-- Attachment #1.1: Type: text/plain, Size: 2871 bytes --] I assume you would have created typescripts for those fonts. Can you please add them to ConTeXt distribution, at least for the popular fonts? On Sun, Feb 18, 2024 at 3:12 AM Shiv Shankar Dayal < shivshankar.dayal@gmail.com> wrote: > The only change I made was that I started using a 9pt modern font than a > 10 pt modern font. > > My document decreased from 580+ pages to 500 pages after that. > > About your document, I assume you had a lot of Graphics because text only > 180MB is too high. > I have only few diagrams and my file size is only 3MB. > > On Sun, Feb 18, 2024 at 2:13 AM Hans Hagen <j.hagen@xs4all.nl> wrote: > >> On 2/17/2024 6:17 PM, Shiv Shankar Dayal wrote: >> > Thanks for new upload. I see that memory consumption is much less than >> > previous version. So >> > once again, thanks a lot. >> > >> > I am curious about what has changed in recent upload, that memory >> > consumption is about 60% of earlier versions. >> it's hard to tell what exact consumpiton is becaue for instance when lua >> creates tables, they grow by factors two when then have to (maybe 5.5 is >> a bit less consuming) >> >> on the one hand luametatex is more efficient than luatex due to all kind >> of ímprovements' but some nodes are larger so that takes more memory, >> which is only noticed when one has lots of text on a page (or keeps >> boxes stuff around) >> >> anyway, not that much changed since the previous upload, so maybe you >> just stay below a threshold >> >> I recently generated a 180MB document with 2500 fonts + metapost >> outlines of them and that could bump mem usage (with empty cache) to 30 >> GB (less after fonts were cached) but normally we stay around 125 MB for >> a document. Anyway, tex mem consumption can often be neglected compared >> to other applications. >> >> Hans >> >> >> ----------------------------------------------------------------- >> Hans Hagen | PRAGMA ADE >> Ridderstraat 27 | 8061 GH Hasselt | The Netherlands >> tel: 038 477 53 69 | www.pragma-ade.nl | www.pragma-pod.nl >> ----------------------------------------------------------------- >> >> >> ___________________________________________________________________________________ >> If your question is of interest to others as well, please add an entry to >> the Wiki! >> >> maillist : ntg-context@ntg.nl / >> https://mailman.ntg.nl/mailman3/lists/ntg-context.ntg.nl >> webpage : https://www.pragma-ade.nl / https://context.aanhet.net >> (mirror) >> archive : https://github.com/contextgarden/context >> wiki : https://wiki.contextgarden.net >> >> ___________________________________________________________________________________ >> > > > -- > Respect, > Shiv Shankar Dayal > -- Respect, Shiv Shankar Dayal [-- Attachment #1.2: Type: text/html, Size: 4501 bytes --] [-- Attachment #2: Type: text/plain, Size: 511 bytes --] ___________________________________________________________________________________ If your question is of interest to others as well, please add an entry to the Wiki! maillist : ntg-context@ntg.nl / https://mailman.ntg.nl/mailman3/lists/ntg-context.ntg.nl webpage : https://www.pragma-ade.nl / https://context.aanhet.net (mirror) archive : https://github.com/contextgarden/context wiki : https://wiki.contextgarden.net ___________________________________________________________________________________ ^ permalink raw reply [flat|nested] 5+ messages in thread
* [NTG-context] Re: Memory consumption in new upload 2024-02-17 21:50 ` Shiv Shankar Dayal @ 2024-02-17 22:41 ` Hans Hagen 0 siblings, 0 replies; 5+ messages in thread From: Hans Hagen @ 2024-02-17 22:41 UTC (permalink / raw) To: ntg-context On 2/17/2024 10:50 PM, Shiv Shankar Dayal wrote: > I assume you would have created typescripts for those fonts. Can you > please add them to > ConTeXt distribution, at least for the popular fonts? Many of those are covered by typescripts. Those that are not, are on my machine because we needed them (often long ago) for a project (these are commercial fonts, in most cases typeone and of such a collection actually a few were used then). There are also some commercial fonts that I got for free. Then there are fonts that I have to check because users had an issue (public ones, of different quality and useability). Of those 'trying to cover all of unicode with different fonts of the same design' I tested subsets. And of course the fonts that come with the operating system (basically all fonts that context can access during a run). We're not going to make typescripts for every combination as in practice for most documents one needs a single setup and therefore only a handful of lines of code (and likely use some typescript file for a math font). There's also the selectfont mechanism that uses heuristics to do the same. There are plenty of examples in the distribution and for a specific style that demands certain fonts one can also put the definitions in the style. > On Sun, Feb 18, 2024 at 3:12 AM Shiv Shankar Dayal > <shivshankar.dayal@gmail.com <mailto:shivshankar.dayal@gmail.com>> wrote: > > The only change I made was that I started using a 9pt modern font > than a 10 pt modern font. > > My document decreased from 580+ pages to 500 pages after that. > > About your document, I assume you had a lot of Graphics because text > only 180MB is too high. > I have only few diagrams and my file size is only 3MB. > > On Sun, Feb 18, 2024 at 2:13 AM Hans Hagen <j.hagen@xs4all.nl > <mailto:j.hagen@xs4all.nl>> wrote: > > On 2/17/2024 6:17 PM, Shiv Shankar Dayal wrote: > > Thanks for new upload. I see that memory consumption is much > less than > > previous version. So > > once again, thanks a lot. > > > > I am curious about what has changed in recent upload, that > memory > > consumption is about 60% of earlier versions. > it's hard to tell what exact consumpiton is becaue for instance > when lua > creates tables, they grow by factors two when then have to > (maybe 5.5 is > a bit less consuming) > > on the one hand luametatex is more efficient than luatex due to > all kind > of ímprovements' but some nodes are larger so that takes more > memory, > which is only noticed when one has lots of text on a page (or keeps > boxes stuff around) > > anyway, not that much changed since the previous upload, so > maybe you > just stay below a threshold > > I recently generated a 180MB document with 2500 fonts + metapost > outlines of them and that could bump mem usage (with empty > cache) to 30 > GB (less after fonts were cached) but normally we stay around > 125 MB for > a document. Anyway, tex mem consumption can often be neglected > compared > to other applications. > > Hans > > > ----------------------------------------------------------------- > Hans Hagen | PRAGMA ADE > Ridderstraat 27 | 8061 GH Hasselt | The Netherlands > tel: 038 477 53 69 | www.pragma-ade.nl > <http://www.pragma-ade.nl> | www.pragma-pod.nl > <http://www.pragma-pod.nl> > ----------------------------------------------------------------- > > ___________________________________________________________________________________ > If your question is of interest to others as well, please add an > entry to the Wiki! > > maillist : ntg-context@ntg.nl <mailto:ntg-context@ntg.nl> / > https://mailman.ntg.nl/mailman3/lists/ntg-context.ntg.nl > <https://mailman.ntg.nl/mailman3/lists/ntg-context.ntg.nl> > webpage : https://www.pragma-ade.nl <https://www.pragma-ade.nl> > / https://context.aanhet.net <https://context.aanhet.net> (mirror) > archive : https://github.com/contextgarden/context > <https://github.com/contextgarden/context> > wiki : https://wiki.contextgarden.net > <https://wiki.contextgarden.net> > ___________________________________________________________________________________ > > > > -- > Respect, > Shiv Shankar Dayal > > > > -- > Respect, > Shiv Shankar Dayal > > ___________________________________________________________________________________ > If your question is of interest to others as well, please add an entry to the Wiki! > > maillist : ntg-context@ntg.nl / https://mailman.ntg.nl/mailman3/lists/ntg-context.ntg.nl > webpage : https://www.pragma-ade.nl / https://context.aanhet.net (mirror) > archive : https://github.com/contextgarden/context > wiki : https://wiki.contextgarden.net > ___________________________________________________________________________________ -- ----------------------------------------------------------------- Hans Hagen | PRAGMA ADE Ridderstraat 27 | 8061 GH Hasselt | The Netherlands tel: 038 477 53 69 | www.pragma-ade.nl | www.pragma-pod.nl ----------------------------------------------------------------- ___________________________________________________________________________________ If your question is of interest to others as well, please add an entry to the Wiki! maillist : ntg-context@ntg.nl / https://mailman.ntg.nl/mailman3/lists/ntg-context.ntg.nl webpage : https://www.pragma-ade.nl / https://context.aanhet.net (mirror) archive : https://github.com/contextgarden/context wiki : https://wiki.contextgarden.net ___________________________________________________________________________________ ^ permalink raw reply [flat|nested] 5+ messages in thread
end of thread, other threads:[~2024-02-17 22:44 UTC | newest] Thread overview: 5+ messages (download: mbox.gz / follow: Atom feed) -- links below jump to the message on this page -- 2024-02-17 17:17 [NTG-context] Memory consumption in new upload Shiv Shankar Dayal 2024-02-17 20:39 ` [NTG-context] " Hans Hagen 2024-02-17 21:42 ` Shiv Shankar Dayal 2024-02-17 21:50 ` Shiv Shankar Dayal 2024-02-17 22:41 ` Hans Hagen
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox; as well as URLs for NNTP newsgroup(s).