What is the status of ConTeXt's various test suites?

What is the status of ConTeXt's various test suites?

[Sietse Brouwer]

Hi, all,

There appear to be a number of test suites in existence.

(1) The suite on pragma-ade.com. I suspect this is the one Hans actually uses.
http://www.pragma-ade.com/download-1.htm (click on cont-tst.7z)

(2) The project on foundry.supelec.fr. Most recent file is 3 years
old, and most of them are 6-7 years old, AFAICT.
Summary: https://foundry.supelec.fr/projects/contexttest/
Files: https://foundry.supelec.fr/scm/viewvc.php/?root=contexttest
This is also the suite described on http://wiki.contextgarden.net/Test_suite

(3) The ConTeXt unofficial test suite
https://github.com/melmothx/context-unofficial-test-suite

I want to update the [[Test suite]] page to make it more accurate. So,
I'm asking y'all: any inaccuracies in the text at the bottom of this
e-mail?

Cheers,
Sietse


* The test suite at pragma-ade.com is Hans's test suite; he runs this
suite before uploading a new beta (most times). To contribute a test
to this suite, write it in an e-mail and send it to the mailing list.

QUESTION: when one downloads and unzips this file in a directory, how
does one run it?

* The test suite at github is managed by users, especially Marco
Patzer. To run the suite, just download it and run `run-suite.pl`.

* The test suite at foundry.supelec.fr is no longer being used.

QUESTION: are the tests in it already transferred to Hans or Marco's
test suite? If not, is that still something we want to do, or can we
just bury this suite entirely?
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: What is the status of ConTeXt's various test suites?

[Hans Hagen]

On 6/10/2013 12:59 PM, Sietse Brouwer wrote:
> Hi, all,
>
> There appear to be a number of test suites in existence.
>
> (1) The suite on pragma-ade.com. I suspect this is the one Hans actually uses.
> http://www.pragma-ade.com/download-1.htm (click on cont-tst.7z)
>
> (2) The project on foundry.supelec.fr. Most recent file is 3 years
> old, and most of them are 6-7 years old, AFAICT.
> Summary: https://foundry.supelec.fr/projects/contexttest/
> Files: https://foundry.supelec.fr/scm/viewvc.php/?root=contexttest
> This is also the suite described on http://wiki.contextgarden.net/Test_suite
>
> (3) The ConTeXt unofficial test suite
> https://github.com/melmothx/context-unofficial-test-suite
>
> I want to update the [[Test suite]] page to make it more accurate. So,
> I'm asking y'all: any inaccuracies in the text at the bottom of this
> e-mail?
>
> Cheers,
> Sietse
>
>
> * The test suite at pragma-ade.com is Hans's test suite; he runs this
> suite before uploading a new beta (most times). To contribute a test
> to this suite, write it in an e-mail and send it to the mailing list.

not true: I add examples when I add new functionality and sometimes turn 
examples from the mailing list in suite examples. I don't run the
suite before a beta (I did when the most recent current was made) but 
Lukáš runs them every now and then and send me an overview of files that 
fail at his end (some files that need special fonts are excluded). So, I 
fix (when needed) issues that show up with the suite.

> QUESTION: when one downloads and unzips this file in a directory, how
> does one run it?

Lukáš has his own scripts.

Here I can run this:

mtxrun --script testsuite --compare --oldname=cld-compare-old 
--newname=cld-compare-new   --pattern=**/*.cld
mtxrun --script testsuite --compare --oldname=mkiv-compare-old 
--newname=mkiv-compare-mkiv --pattern=**/*.mkiv
mtxrun --script testsuite --compare --oldname=mkvi-compare-old 
--newname=mkvi-compare-mkiv --pattern=**/*.mkvi
mtxrun --script testsuite --compare --oldname=tex-compare-old 
--newname=tex-compare-new   --pattern=**/*.tex

but that's probably a different method. As it takes a while I must admit 
that i only ran it for the current (as I do have more fonts on my system).

> * The test suite at github is managed by users, especially Marco
> Patzer. To run the suite, just download it and run `run-suite.pl`.

Indeed. That one compares output too I think and it can generate reports 
as well.

> * The test suite at foundry.supelec.fr is no longer being used.

I don't know.

> QUESTION: are the tests in it already transferred to Hans or Marco's
> test suite? If not, is that still something we want to do, or can we
> just bury this suite entirely?

I don't know. I happily leave that to others to sort out.

Hans

-----------------------------------------------------------------
                                           Hans Hagen | PRAGMA ADE
               Ridderstraat 27 | 8061 GH Hasselt | The Netherlands
     tel: 038 477 53 69 | voip: 087 875 68 74 | www.pragma-ade.com
                                              | www.pragma-pod.nl
-----------------------------------------------------------------
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: What is the status of ConTeXt's various test suites?

[Sietse Brouwer]

Hi Lukáš,

On 6/10/2013 12:59 PM, Sietse Brouwer wrote:
>> There appear to be a number of test suites in existence.
>> (1) The suite on pragma-ade.com. I suspect this is the one Hans actually
>> uses.
>> http://www.pragma-ade.com/download-1.htm (click on cont-tst.7z)

>> QUESTION: when one downloads and unzips this file in a directory, how
>> does one run it?

On 10 June 2013 13:11, Hans Hagen <pragma@wxs.nl> wrote:
> Lukáš has his own scripts.
>
> Here I can run this:
>
> mtxrun --script testsuite --compare --oldname=cld-compare-old --newname=cld-compare-new   --pattern=**/*.cld
> mtxrun --script testsuite --compare --oldname=mkiv-compare-old --newname=mkiv-compare-mkiv --pattern=**/*.mkiv
> mtxrun --script testsuite --compare --oldname=mkvi-compare-old --newname=mkvi-compare-mkiv --pattern=**/*.mkvi
> mtxrun --script testsuite --compare --oldname=tex-compare-old --newname=tex-compare-new   --pattern=**/*.tex

I tried running this, but mtxrun complains that the script `testsuite`
doesn't exist.
Lukáš, what script do you use to run the test suite?

Cheers,
Sietse
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________

Re: What is the status of ConTeXt's various test suites?

[Sietse Brouwer]

On 25 June 2013 11:49, Procházka Lukáš Ing. - Pontex s. r. o.
<LPr@pontex.cz> wrote:
> here are my scripts I'm using to test Ctx.

Thanks, Lukáš! Also thanks for the explanation of what files go where,
and what to run --- that's very helpful. I hope to be able to play
with this soon, and then add what I learn to the wiki.

All the best,
Sietse
___________________________________________________________________________________
If your question is of interest to others as well, please add an entry to the Wiki!

maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context
webpage  : http://www.pragma-ade.nl / http://tex.aanhet.net
archive  : http://foundry.supelec.fr/projects/contextrev/
wiki     : http://contextgarden.net
___________________________________________________________________________________