From mboxrd@z Thu Jan 1 00:00:00 1970 X-Msuck: nntp://news.gmane.io/gmane.comp.tex.context/78752 Path: news.gmane.org!not-for-mail From: Marco Pessotto Newsgroups: gmane.comp.tex.context Subject: Re: ConTeXt unofficial test suite stub Date: Wed, 17 Oct 2012 13:27:07 +0200 Message-ID: <87a9vl49v8.fsf@universe.krase.net> References: <87bogea7gc.fsf@universe.krase.net> <87a9vld2ck.fsf@universe.krase.net> <87wqypbltn.fsf@universe.krase.net> Reply-To: mailing list for ConTeXt users NNTP-Posting-Host: plane.gmane.org Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Trace: ger.gmane.org 1350473789 26180 80.91.229.3 (17 Oct 2012 11:36:29 GMT) X-Complaints-To: usenet@ger.gmane.org NNTP-Posting-Date: Wed, 17 Oct 2012 11:36:29 +0000 (UTC) To: ntg-context@ntg.nl Original-X-From: ntg-context-bounces@ntg.nl Wed Oct 17 13:36:35 2012 Return-path: Envelope-to: gctc-ntg-context-518@m.gmane.org Original-Received: from balder.ntg.nl ([195.12.62.10]) by plane.gmane.org with esmtp (Exim 4.69) (envelope-from ) id 1TORvM-0001oA-Mg for gctc-ntg-context-518@m.gmane.org; Wed, 17 Oct 2012 13:36:32 +0200 Original-Received: from localhost (localhost [127.0.0.1]) by balder.ntg.nl (Postfix) with ESMTP id 46D0110248; Wed, 17 Oct 2012 13:36:25 +0200 (CEST) X-Virus-Scanned: Debian amavisd-new at balder.ntg.nl Original-Received: from balder.ntg.nl ([127.0.0.1]) by localhost (balder.ntg.nl [127.0.0.1]) (amavisd-new, port 10024) with LMTP id oKt3o0sOocF6; Wed, 17 Oct 2012 13:36:22 +0200 (CEST) Original-Received: from balder.ntg.nl (localhost [IPv6:::1]) by balder.ntg.nl (Postfix) with ESMTP id 0E7C5101EB; Wed, 17 Oct 2012 13:36:22 +0200 (CEST) Original-Received: from localhost (localhost [127.0.0.1]) by balder.ntg.nl (Postfix) with ESMTP id A9FA0101EB for ; Wed, 17 Oct 2012 13:36:20 +0200 (CEST) X-Virus-Scanned: Debian amavisd-new at balder.ntg.nl Original-Received: from balder.ntg.nl ([127.0.0.1]) by localhost (balder.ntg.nl [127.0.0.1]) (amavisd-new, port 10024) with LMTP id ywM59EZh1Ztb for ; Wed, 17 Oct 2012 13:36:19 +0200 (CEST) Original-Received: from filter1-utr.mf.surf.net (filter1-utr.mf.surf.net [195.169.124.152]) by balder.ntg.nl (Postfix) with ESMTP id 5D2C3101E5 for ; Wed, 17 Oct 2012 13:36:19 +0200 (CEST) Original-Received: from plane.gmane.org (plane.gmane.org [80.91.229.3]) by filter1-utr.mf.surf.net (8.14.3/8.14.3/Debian-9.4) with ESMTP id q9HBaHTr003020 for ; Wed, 17 Oct 2012 13:36:18 +0200 Original-Received: from list by plane.gmane.org with local (Exim 4.69) (envelope-from ) id 1TORvA-0001TV-NX for ntg-context@ntg.nl; Wed, 17 Oct 2012 13:36:20 +0200 Original-Received: from 78-0-7-96.adsl.net.t-com.hr ([78.0.7.96]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Wed, 17 Oct 2012 13:36:20 +0200 Original-Received: from melmothx by 78-0-7-96.adsl.net.t-com.hr with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Wed, 17 Oct 2012 13:36:20 +0200 X-Injected-Via-Gmane: http://gmane.org/ Original-Lines: 105 Original-X-Complaints-To: usenet@ger.gmane.org X-Gmane-NNTP-Posting-Host: 78-0-7-96.adsl.net.t-com.hr User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/23.2 (gnu/linux) Cancel-Lock: sha1:xzvmINNLKCMYeE5WqgicUWajdYI= X-Bayes-Prob: 0.0001 (Score 0, tokens from: @@RPTN) X-CanIt-Geo: ip=80.91.229.3; country=NO; latitude=62.0000; longitude=10.0000; http://maps.google.com/maps?q=62.0000,10.0000&z=6 X-CanItPRO-Stream: uu:ntg-context@ntg.nl (inherits from uu:default, base:default) X-Canit-Stats-ID: 07IcbAhDH - 816447c6f5b3 - 20121017 (trained as not-spam) X-Scanned-By: CanIt (www . roaringpenguin . com) X-BeenThere: ntg-context@ntg.nl X-Mailman-Version: 2.1.14 Precedence: list List-Id: mailing list for ConTeXt users List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: ntg-context-bounces@ntg.nl Original-Sender: ntg-context-bounces@ntg.nl Xref: news.gmane.org gmane.comp.tex.context:78752 Archived-At: luigi scarso writes: > It's not a huge difference, but it can integrated better with mkiv; see > http://meeting.contextgarden.net/2011/talks/day1_05_luigi_graphicmagick/ > (if you like these kind of things) I think I'll have to run some benchmark to see if it can save some resources and speed up the testing. I don't care too much for the mkiv integration. The other Marco's idea was exactly to make conTeXt run the tests. I prefer to let ConTeXt do the typesetting and do the dirty stuff with perl. So far I've included the testfiles from contexttest, parking the failing ones in a dedicated directory. There are 62 files now, and the test takes 13 minutes to run on my humble machine. These are the results for version 2012.10.16 23:38 against TeXlive2012: | File name | Success | Differs Avg | Worst value | Pages | Time | | arrows-001 | OK | 6.105634 | 6.105634 | 1 | 5 | | catcodes-001 | OK | 50.219512 | 50.219512 | 1 | 3 | | columnsets-001 | OK | 0.000000 | 0.000000 | 10 | 7 | | core-des-001 | OK | 0.324862 | 0.658451 | 23 | 9 | | core-des-002 | OK | 1.527666 | 2.651408 | 7 | 8 | | core-itm-001 | OK | 11.947183 | 13.753521 | 5 | 5 | | core-mat-001 | OK | 0.070423 | 0.070423 | 1 | 5 | | core-mat-002 | OK | 0.000000 | 0.000000 | 1 | 5 | | core-mat-003 | OK | 1.788732 | 1.788732 | 1 | 5 | | core-mat-004 | OK | 0.000000 | 0.000000 | 2 | 5 | | core-mat-005 | OK | 0.000000 | 0.000000 | 1 | 3 | | core-rul-001 | OK | 0.151408 | 0.151408 | 1 | 4 | | core-sec-001 | OK | 0.000000 | 0.000000 | 1 | 3 | | core-ver-001 | OK | 0.000000 | 0.000000 | 1 | 4 | | core-ver-002 | OK | 0.000000 | 0.000000 | 1 | 4 | | core-ver-003 | OK | 0.131162 | 0.524648 | 4 | 5 | | core-ver-004 | OK | 0.000000 | 0.000000 | 1 | 4 | | core-ver-005 | OK | 0.000000 | 0.000000 | 1 | 4 | | core-ver-007 | OK | 0.000000 | 0.000000 | 1 | 4 | | date-002 | OK | 0.000000 | 0.000000 | 1 | 3 | | dates-001 | OK | 3.880282 | 3.880282 | 1 | 4 | | dates-002 | OK | 0.359155 | 0.359155 | 1 | 4 | | enco-pfr-001 | OK | 0.095070 | 0.095070 | 1 | 4 | | floats-001 | OK | 31.651408 | 31.651408 | 1 | 4 | | floats-002 | OK | 31.651408 | 31.651408 | 1 | 5 | | hsv-001 | OK | 0.000000 | 0.000000 | 8 | 14 | | inclusion | OK | 0.000000 | 0.000000 | 1 | 4 | | math-pln-001 | OK | 0.049296 | 0.049296 | 1 | 4 | | meta-ini-001 | OK | 0.000000 | 0.000000 | 2 | 4 | | metapost-001 | OK | 0.000000 | 0.000000 | 1 | 4 | | metapost-002 | OK | 0.000000 | 0.000000 | 1 | 3 | | mixed-001 | OK | 21.327465 | 37.492958 | 2 | 4 | | narrower-bidi-001 | OK | 0.000000 | 0.000000 | 4 | 4 | | page-run-001 | OK | 0.000000 | 0.000000 | 1 | 4 | | page-txt-001 | OK | 0.445171 | 0.496479 | 7 | 5 | | ppchtex-001 | OK | 1.573944 | 1.573944 | 1 | 4 | | ppchtex-005 | OK | 1.169014 | 1.169014 | 1 | 4 | | ppchtex-006 | OK | 0.000000 | 0.000000 | 1 | 4 | | spacing-grid-001 | OK | 10.443662 | 10.531690 | 3 | 5 | | spacing-grid-005 | OK | 11.602993 | 14.975352 | 8 | 9 | | spacing-space-001 | OK | 0.000000 | 0.000000 | 1 | 3 | | spacing-space-002 | OK | 0.000000 | 0.000000 | 2 | 4 | | spacing-space-003 | OK | 0.000000 | 0.000000 | 1 | 4 | | spacing-space-004 | OK | 0.000000 | 0.000000 | 1 | 4 | | spec-mis-001 | FAILED | 0.000000 | 0.000000 | 0 | 0 | | spot-001 | OK | 0.000000 | 0.000000 | 1 | 4 | |struc-allkind-tex-001 | OK | 0.292254 | 0.292254 | 1 | 5 | |struc-allkind-xml-001 | OK | 1.471831 | 1.471831 | 1 | 6 | | struc-itemize-001 | OK | 0.176056 | 0.176056 | 1 | 4 | | struc-itemize-002 | OK | 0.000000 | 0.000000 | 1 | 3 | | struc-page-001 | OK | 6.237676 | 7.066901 | 4 | 14 | | struc-sections-002 | OK | 0.161972 | 0.161972 | 1 | 4 | |struc-sections-xml-002 | OK | 0.000000 | 0.000000 | 1 | 4 | | supp-mps-001 | OK | 0.000000 | 0.000000 | 1 | 4 | | supp-mps-002 | OK | 0.000000 | 0.000000 | 1 | 4 | | supp-mps-003 | OK | 0.000000 | 0.000000 | 1 | 3 | | supp-mps-004 | OK | 0.000000 | 0.000000 | 1 | 4 | | supp-mps-005 | OK | 0.000000 | 0.000000 | 1 | 3 | | tables-001 | OK | 0.577465 | 0.577465 | 1 | 4 | | widgets-fields-001 | OK | 0.000000 | 0.000000 | 1 | 5 | | x-res-00-001 | OK | 0.000000 | 0.000000 | 1 | 5 | | xml-chain-001 | OK | 0.000000 | 0.000000 | 1 | 4 | Looking at the diffs, many of the differences are really tiny, but differences exist nevertheless. It will take me some time to sort out which ones are just tiny space shifting, and which ones give really different output. To run the tests yourself it's extremely easy: git clone git://github.com/melmothx/context-unofficial-test-suite.git cd context-unofficial-test-suite ./run-test.pl --run 2>&1 | tee test.log Have a coffee and that's it. I always keep the repo on github synced with mine. Cheers P.S. When on-line, I'm logged into the #context channel on freenode as "melmothX". -- Marco ___________________________________________________________________________________ If your question is of interest to others as well, please add an entry to the Wiki! maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context webpage : http://www.pragma-ade.nl / http://tex.aanhet.net archive : http://foundry.supelec.fr/projects/contextrev/ wiki : http://contextgarden.net ___________________________________________________________________________________