From mboxrd@z Thu Jan 1 00:00:00 1970 X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on inbox.vuxu.org X-Spam-Level: X-Spam-Status: No, score=-0.7 required=5.0 tests=DKIM_INVALID,DKIM_SIGNED, MAILING_LIST_MULTI,T_SCC_BODY_TEXT_LINE,URIBL_SBL_A autolearn=ham autolearn_force=no version=3.4.4 Received: (qmail 3561 invoked from network); 18 Jul 2023 20:15:01 -0000 Received: from cgl.ntg.nl (5.39.185.202) by inbox.vuxu.org with ESMTPUTF8; 18 Jul 2023 20:15:01 -0000 Received: from localhost (localhost [127.0.0.1]) by cgl.ntg.nl (Postfix) with ESMTP id 8B46748293C for ; Tue, 18 Jul 2023 22:13:41 +0200 (CEST) X-Virus-Scanned: Debian amavisd-new at cgl.ntg.nl Received: from cgl.ntg.nl ([127.0.0.1]) by localhost (cgl.ntg.nl [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id VbeDgkIav4QX for ; Tue, 18 Jul 2023 22:13:41 +0200 (CEST) Received: from cgl.ntg.nl (localhost [127.0.0.1]) by cgl.ntg.nl (Postfix) with ESMTP id 3F93A48294C for ; Tue, 18 Jul 2023 22:12:54 +0200 (CEST) Received: from localhost (localhost [127.0.0.1]) by cgl.ntg.nl (Postfix) with ESMTP id A29534816AD for ; Tue, 18 Jul 2023 22:12:28 +0200 (CEST) X-Virus-Scanned: Debian amavisd-new at cgl.ntg.nl Received: from cgl.ntg.nl ([127.0.0.1]) by localhost (cgl.ntg.nl [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Szc5QSPVrphR for ; Tue, 18 Jul 2023 22:12:24 +0200 (CEST) Received: from ewsoutbound.kpnmail.nl (ewsoutbound.kpnmail.nl [195.121.94.170]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by cgl.ntg.nl (Postfix) with ESMTPS id 893704814BF for ; Tue, 18 Jul 2023 22:12:24 +0200 (CEST) X-KPN-MessageId: 65ff3073-25a7-11ee-b13c-005056ab378f Received: from smtp.kpnmail.nl (unknown [10.31.155.37]) by ewsoutbound.so.kpn.org (Halon) with ESMTPS id 65ff3073-25a7-11ee-b13c-005056ab378f; Tue, 18 Jul 2023 22:12:19 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=xs4all.nl; s=xs4all01; h=content-type:subject:from:to:mime-version:date:message-id; bh=cqlfMUyMq+SyUwrScvZN2tnTBeqixOhrwfJYFU5suBM=; b=Z84bxPTXRFzZaqb7DSHDa/ZvkF9RnRfWBBdyqjm6ejtjRDaT07WGDkxUXUrkK4x3ZLRvKXxu8wNX6 xM0+yreMVeYYyVvcSgSCbEVjx/+fsap7OH4xFMLpUQ6vbhCLHAyzhjg6C+5iPVHlI5N3SaWXJDuQW9 rjwiQWbWHiOPQmDLcLJhI0BMa5VzM4YGRmxlrjvHT4j+O10piXJyED/iNwas43D7I51vlkpSFd9ute /Yf0Wk1GgexzhJRfr4iHFShcKC5mdQsBMlMn95XlyJRtlhsOVcfTip6kOEDJ0/y6h1WDE3MU488NF/ 4WdVnEOlm9kh/LMdF+Z71fwyetMOVAQ== X-KPN-MID: 33|2TRrkxEmq4gBW75FE4mnE83J0Ihb5AnVE7XPDsA/cRseCn0VVxm69BjCQygEN6f g52sci7b51yeHRq7BOrvykgE1EpyRrYfzh9/PYcRA4k8= X-KPN-VerifiedSender: Yes X-CMASSUN: 33|3lPBSo9+pOWLp3ypkh3u2FUTwRiQn3COcsCPZN/ih+DPqmHchCC9inc0l+KlApk dVwv70c2WlcFG2IoBndKo3Q== X-Originating-IP: 213.125.29.162 Received: from [10.100.1.105] (d57d1da2.static.ziggozakelijk.nl [213.125.29.162]) by smtp.xs4all.nl (Halon) with ESMTPSA id 689153b0-25a7-11ee-8a1c-005056ab1411; Tue, 18 Jul 2023 22:12:24 +0200 (CEST) Message-ID: Date: Tue, 18 Jul 2023 22:12:23 +0200 MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Thunderbird/102.13.0 Content-Language: en-US To: mailing list for ConTeXt users From: Hans Hagen Message-ID-Hash: SYEFUBLVCDCMXQ2NRBMFSWE7IDVV7A7W X-Message-ID-Hash: SYEFUBLVCDCMXQ2NRBMFSWE7IDVV7A7W X-MailFrom: j.hagen@xs4all.nl X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header X-Mailman-Version: 3.3.8 Precedence: list Reply-To: mailing list for ConTeXt users Subject: [NTG-context] new upload List-Id: mailing list for ConTeXt users Archived-At: List-Archive: List-Help: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: Content-Type: text/plain; charset="us-ascii"; format="flowed" Content-Transfer-Encoding: 7bit Hi, In todays upload there is a follow up on a new feature that is already present in the previous upload (but that was not yet advertised): context --parallel test1.tex test2.tex test3.tex context --parallel --pattern=test*.tex context --parallellist myfile.cmd (filters context processing lines) context --parallel test1.tex test2.tex test3.tex --terminal The --parellel feature will run in parallel, By default upto 8 jobs but you can specify less or more depending on your hardware but on my machine this is reasonable. See workflows-parrallel at the end for more info. That one also mentions the new --forceinput flag which makes that when these context foo-1.tex --mode=m-1 --forceinput=whatever.tex context foo-3.tex --mode=m-3 --forceinput=whatever.tex are run in parallel there is no clash in tuc/pdf. Of course not all scenarios might work out well. Commandline arguments given are passed on to the different jobs but it's good enough for the purpose I have in mind. fwiw: a single pass teststuite run (some 1950 files) goes down from 1350 to 700 seconds but another run with 1200 complex xml documents goes 4 times faster. In the end this is way cheaper than updating a 5 year old dev machine (a new one would run about twice as fast which would bring about the same gain). Hans ps. Because tex is a memory intense application it doesn't scale with the number of cores unless one has the latest greatest fast memory as well as generous cpu caches. There's only so much one can do in the code base about it. ----------------------------------------------------------------- Hans Hagen | PRAGMA ADE Ridderstraat 27 | 8061 GH Hasselt | The Netherlands tel: 038 477 53 69 | www.pragma-ade.nl | www.pragma-pod.nl ----------------------------------------------------------------- ___________________________________________________________________________________ If your question is of interest to others as well, please add an entry to the Wiki! maillist : ntg-context@ntg.nl / https://www.ntg.nl/mailman/listinfo/ntg-context webpage : https://www.pragma-ade.nl / http://context.aanhet.net archive : https://bitbucket.org/phg/context-mirror/commits/ wiki : https://contextgarden.net ___________________________________________________________________________________