From mboxrd@z Thu Jan 1 00:00:00 1970 X-Msuck: nntp://news.gmane.io/gmane.comp.tex.context/46361 Path: news.gmane.org!not-for-mail From: Lars Huttar Newsgroups: gmane.comp.tex.context Subject: Re: distributed / parallel TeX? Date: Tue, 16 Dec 2008 13:28:07 -0600 Message-ID: <49480147.5030109@sil.org> References: <4946E2E2.1050108@sil.org> <49476FDB.80309@wxs.nl> <4947CEE1.6040107@wxs.nl> <4947E4A7.4060602@sil.org> <4947E764.9030205@wxs.nl> Reply-To: mailing list for ConTeXt users NNTP-Posting-Host: lo.gmane.org Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Trace: ger.gmane.org 1229456126 22843 80.91.229.12 (16 Dec 2008 19:35:26 GMT) X-Complaints-To: usenet@ger.gmane.org NNTP-Posting-Date: Tue, 16 Dec 2008 19:35:26 +0000 (UTC) Cc: jelle_huisman@sil.org To: mailing list for ConTeXt users Original-X-From: ntg-context-bounces@ntg.nl Tue Dec 16 20:36:28 2008 Return-path: Envelope-to: gctc-ntg-context-518@m.gmane.org Original-Received: from ronja.vet.uu.nl ([131.211.172.88] helo=ronja.ntg.nl) by lo.gmane.org with esmtp (Exim 4.50) id 1LCfi8-0007J9-Cf for gctc-ntg-context-518@m.gmane.org; Tue, 16 Dec 2008 20:36:04 +0100 Original-Received: from localhost (localhost [127.0.0.1]) by ronja.ntg.nl (Postfix) with ESMTP id D298E1FBEB; Tue, 16 Dec 2008 20:34:49 +0100 (CET) Original-Received: from ronja.ntg.nl ([127.0.0.1]) by localhost (smtp.ntg.nl [127.0.0.1]) (amavisd-new, port 10024) with LMTP id 16659-01; Tue, 16 Dec 2008 20:33:28 +0100 (CET) Original-Received: from ronja.vet.uu.nl (localhost [127.0.0.1]) by ronja.ntg.nl (Postfix) with ESMTP id 2B9051FB4E; Tue, 16 Dec 2008 20:28:54 +0100 (CET) Original-Received: from localhost (localhost [127.0.0.1]) by ronja.ntg.nl (Postfix) with ESMTP id 1C2CB1FB30 for ; Tue, 16 Dec 2008 20:28:48 +0100 (CET) Original-Received: from ronja.ntg.nl ([127.0.0.1]) by localhost (smtp.ntg.nl [127.0.0.1]) (amavisd-new, port 10024) with LMTP id 10700-03-12 for ; Tue, 16 Dec 2008 20:28:10 +0100 (CET) Original-Received: from smtp1.wsfo.org (smtp1.wsfo.org [208.145.81.51]) by ronja.ntg.nl (Postfix) with ESMTP id C44CC1FADF for ; Tue, 16 Dec 2008 20:28:09 +0100 (CET) Original-Received: from mail.link77.net (mail.link77.net [172.22.0.125]) by smtp1.wsfo.org (8.13.1/8.13.1) with ESMTP id mBGJS9H7031872 (version=TLSv1/SSLv3 cipher=DES-CBC3-SHA bits=168 verify=NO) for ; Tue, 16 Dec 2008 14:28:09 -0500 X-CGP-ClamAV-Result: CLEAN X-VirusScanner: Niversoft's CGPClamav Helper v1.8.2 (ClamAV engine v0.94.1) X-ExtScanner: Niversoft's Find_Attachments Original-Received: from [172.20.4.229] (account lars_huttar@sil.org [172.20.4.229] verified) by mail.link77.net (CommuniGate Pro SMTP 5.2.10) with ESMTPSA id 203588713; Tue, 16 Dec 2008 14:28:09 -0500 User-Agent: Thunderbird 2.0.0.18 (Windows/20081105) In-Reply-To: <4947E764.9030205@wxs.nl> X-Enigmail-Version: 0.95.7 X-Scanned-By: MIMEDefang 2.62 on 172.22.0.51 X-Virus-Scanned: amavisd-new at ntg.nl X-BeenThere: ntg-context@ntg.nl X-Mailman-Version: 2.1.11 Precedence: list List-Id: mailing list for ConTeXt users List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Original-Sender: ntg-context-bounces@ntg.nl Errors-To: ntg-context-bounces@ntg.nl X-Virus-Scanned: amavisd-new at ntg.nl Xref: news.gmane.org gmane.comp.tex.context:46361 Archived-At: On 12/16/2008 11:37 AM, Hans Hagen wrote: > Lars Huttar wrote: > >> We have close to 7000 mpgraphics, and they add about 15 minutes to the >> run time. > > most of them are the same so reusing them made sense > >> But the run time was already quite long before we started using those. >> >>> - define fonts beforehand >> >> OK, we will look into this. I'm sure Jelle knows about this but I'm a >> noob. I'm pretty sure we are not *loading* fonts every time, but maybe >> we're scaling fonts an unnecessary number of times. >> For example, we have the following macro, which we use thousands of >> times: >> \def\LN#1{{\switchtobodyfont[SansB,\LNfontsize]{#1}}} > > indeed this will define the scaled ones again and again (whole sets of > them since you use a complete switch); internall tex reuses them but it > only know so when they're defined > >> Would it help much to instead use >> \definefont[SansBLN][... at \LNfontsize] >> and then >> \def\LN#1{{\SansBLN{#1}}} >> ? > > indeed: > > \definefont[SansBLN][... at \LNfontsize] > > but no extra { } needed: > > \def\LN#1{{\SansBLN#1}} Thanks, we will try this. (Jelle, since you have worked with this a lot longer than I have, please stop me if you have concerns about my making this sort of change.) >>> - use unique mpgraphic when possible >> >> I would be interested to know if this is possible in our situation. Most >> of our mpgraphics are due to wanting thick-and-thin or single-and-double >> borders on tables, which are not natively supported by the ConTeXt table >> model. > > i sent jelle the patched files OK, I'll look to hear from him. Are these patches to support these kinds of borders on tables, thus no longer needing to use MPgraphics? >> The advice I received said to define each mpgraphic using >> \startuseMPgraphic (we have about 18 of these), associate them with >> overlays using \defineoverlay (again, we have 18), and then use them in >> table cells using statements like >> \setupTABLE[c][first][background={LRtb}] >> Empirically, this seems to end up using one mpgraphic per table cell, >> hence our thousands of mpgraphics. I don't know why a new mpgraphic >> would be created for each cell. Can someone suggest a way to avoid this? > > metafun manual: unique mp graphics Great... I converted our useMPgraphics to uniqueMPgraphics. This reduced our number of mpgraphics from 7000 to 800! Unfortunately the result doesn't look quite right... but since we may not need to use mpgraphics anyway thanks to your patches, I'll hold off on debugging the result. >>> i changes the definitions a bit and now get 5 pages per second on my >>> laptop in luatex; xetex processes the pages a bit faster but spends way >>> more time on the mp part >> >> My last run gave about 0.25 pages per second on our fastest server, when >> taking into account multiple passes; that comes out to about 2 pps for >> --once. > > the patched files do 5-10 pps on my laptop (was > 1 sec pp) so an > improvement factor of at least 5 is possible > > there are probably other optimizations possible but i cannot spent too > much time on it Thanks for all your help thus far. Lars ___________________________________________________________________________________ If your question is of interest to others as well, please add an entry to the Wiki! maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context webpage : http://www.pragma-ade.nl / http://tex.aanhet.net archive : https://foundry.supelec.fr/projects/contextrev/ wiki : http://contextgarden.net ___________________________________________________________________________________