From mboxrd@z Thu Jan 1 00:00:00 1970 X-Msuck: nntp://news.gmane.io/gmane.comp.tex.context/21626 Path: news.gmane.org!not-for-mail From: "Patrick Gundlach" Newsgroups: gmane.comp.tex.context Subject: Re: test suite in the garden Date: 26 Jul 2005 23:36:38 +0200 Organization: chaos Message-ID: References: <20050725185214.CC7871A8D6@mendoza.math.indiana.edu> <6faad9f0050725130439c079b2@mail.gmail.com> <3140B5FA-6F65-47E1-AAA0-BD8492696241@fiee.net> Reply-To: mailing list for ConTeXt users NNTP-Posting-Host: main.gmane.org Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Trace: sea.gmane.org 1122414076 20796 80.91.229.2 (26 Jul 2005 21:41:16 GMT) X-Complaints-To: usenet@sea.gmane.org NNTP-Posting-Date: Tue, 26 Jul 2005 21:41:16 +0000 (UTC) Original-X-From: ntg-context-bounces@ntg.nl Tue Jul 26 23:41:12 2005 Return-path: Original-Received: from ronja.vet.uu.nl ([131.211.172.88] helo=ronja.ntg.nl) by ciao.gmane.org with esmtp (Exim 4.43) id 1DxX9q-0008O4-4e for gctc-ntg-context-518@m.gmane.org; Tue, 26 Jul 2005 23:40:14 +0200 Original-Received: from localhost (localhost.localdomain [127.0.0.1]) by ronja.ntg.nl (Postfix) with ESMTP id CB577127D1; Tue, 26 Jul 2005 23:40:13 +0200 (CEST) Original-Received: from ronja.ntg.nl ([127.0.0.1]) by localhost (smtp.ntg.nl [127.0.0.1]) (amavisd-new, port 10024) with LMTP id 22198-04; Tue, 26 Jul 2005 23:40:13 +0200 (CEST) Original-Received: from ronja.vet.uu.nl (localhost.localdomain [127.0.0.1]) by ronja.ntg.nl (Postfix) with ESMTP id 1874F127D7; Tue, 26 Jul 2005 23:36:44 +0200 (CEST) Original-Received: from localhost (localhost.localdomain [127.0.0.1]) by ronja.ntg.nl (Postfix) with ESMTP id B7EDC127D7 for ; Tue, 26 Jul 2005 23:36:42 +0200 (CEST) Original-Received: from ronja.ntg.nl ([127.0.0.1]) by localhost (smtp.ntg.nl [127.0.0.1]) (amavisd-new, port 10024) with LMTP id 22198-02 for ; Tue, 26 Jul 2005 23:36:41 +0200 (CEST) Original-Received: from lilly.ping.de (lilly.ping.de [83.97.42.2]) by ronja.ntg.nl (Postfix) with SMTP id A1655127D1 for ; Tue, 26 Jul 2005 23:36:41 +0200 (CEST) Original-Received: (qmail 9013 invoked from network); 26 Jul 2005 21:36:40 -0000 Original-Received: (ofmipd 83.97.40.208); 26 Jul 2005 21:36:18 -0000 Original-To: ntg-context@ntg.nl X-Lieblings-Musik: the_capricorns In-Reply-To: <3140B5FA-6F65-47E1-AAA0-BD8492696241@fiee.net> (Henning Hraban Ramm's message of "Mon, 25 Jul 2005 22:42:28 +0200") User-Agent: Gnus/5.11 (Gnus v5.11) Emacs/22.0.50 (darwin) X-Virus-Scanned: amavisd-new at ntg.nl X-BeenThere: ntg-context@ntg.nl X-Mailman-Version: 2.1.5 Precedence: list List-Id: mailing list for ConTeXt users List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Original-Sender: ntg-context-bounces@ntg.nl Errors-To: ntg-context-bounces@ntg.nl X-Spam-Checker-Version: SpamAssassin 3.0.3 (2005-04-27) on smtp.ntg.nl X-Virus-Scanned: amavisd-new at ntg.nl Xref: news.gmane.org gmane.comp.tex.context:21626 X-Report-Spam: http://spam.gmane.org/gmane.comp.tex.context:21626 >> It is perhaps a lot of work included, but extending the >> contextgarden.net in such a way that users could provide test cases >> which would be typeset with different ConTeXt versions and PNGs >> compared afterwards ... could make it easier to discover any broken >> functionality. It comes down to: * different context versions needed * different test documents needed 1) user can select any combination of the above 2) result (one page/png, more pages pdf) can be viewed or downloaded 3) feedback or perhaps (as I can read between your lines) a pdf with even number of pages: left page: original, right page the selcted version. So we need test documents and after that context can mix in the pages from the known good document and the selecte version. So you think that users actually download these comparisons? > Oh, another quest for our magic Patrick! ;-) Don't call me magic. I am currently trying to understand the tftopl, pltotf, vftovp and vptovf programs in detail. And I am so miserable at that; all kinds of optimizations that makes the code unreadable. > Let me extend the suggestion, for we miss a ConTeXt test suite for a > long time now: > > - users send test cases > - test cases get typeset with the actual ConTeXt and converted to PNG > (like inline samples) > - user "votes" if it looks right, if not adds comment > - test case gets saved, including PNG, ConTeXt version and vote/comments > - at next update, all test cases get typeset again, and users can > "vote" if it looks still ok or at least the same (perhaps it would > be possible to check automatically if the bitmaps are exactly > identical) Again, I doubt that users will actually do these kind of things. I could provide some interface for documents connected to version numbers, so you could download a set of .tex files (or one big tex file) and the related pdf file, but we need to collect good examples. And I think that testing is very hard: there are so many different things in ConTeXt that can be tested, so the pdf would result in a few hundred pages. Patrick -- ConTeXt wiki and more: http://contextgarden.net