From mboxrd@z Thu Jan  1 00:00:00 1970
Return-Path: <zsh-workers-return-35763-mason-zsh=primenet.com.au@zsh.org>
Received: (qmail 15494 invoked by alias); 10 Jul 2015 16:23:12 -0000
Mailing-List: contact zsh-workers-help@zsh.org; run by ezmlm
Precedence: bulk
X-No-Archive: yes
List-Id: Zsh Workers List <zsh-workers.zsh.org>
List-Post: <mailto:zsh-workers@zsh.org>
List-Help: <mailto:zsh-workers-help@zsh.org>
X-Seq: 35763
Received: (qmail 515 invoked from network); 10 Jul 2015 16:23:11 -0000
X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on f.primenet.com.au
X-Spam-Level: 
X-Spam-Status: No, score=-6.9 required=5.0 tests=BAYES_00,RCVD_IN_DNSWL_HI,
	RCVD_IN_MSPIKE_H3,RCVD_IN_MSPIKE_WL,SPF_HELO_PASS autolearn=ham
	autolearn_force=no version=3.4.0
X-AuditID: cbfec7f4-f79c56d0000012ee-54-559ff16a1eb7
Date: Fri, 10 Jul 2015 17:23:03 +0100
From: Peter Stephenson <p.stephenson@samsung.com>
To: Zsh Hackers' List <zsh-workers@zsh.org>
Subject: Re: Skipping tests (was Re: PATCH: ztrftime: Pass everything ...)
Message-id: <20150710172303.0d1ca38a@pwslap01u.europe.root.pri>
In-reply-to: <150710091821.ZM9912@torch.brasslantern.com>
References: <20150709094122.17abacc8@pwslap01u.europe.root.pri>
 <1436435887-28736-1-git-send-email-mikachu@gmail.com>
 <20150709111756.631dac65@pwslap01u.europe.root.pri>
 <20150710143708.71ec8178@pwslap01u.europe.root.pri>
 <150710091821.ZM9912@torch.brasslantern.com>
Organization: Samsung Cambridge Solution Centre
X-Mailer: Claws Mail 3.7.9 (GTK+ 2.22.0; i386-redhat-linux-gnu)
MIME-version: 1.0
Content-type: text/plain; charset=US-ASCII
Content-transfer-encoding: 7bit
X-Brightmail-Tracker:
 H4sIAAAAAAAAA+NgFjrMLMWRmVeSWpSXmKPExsVy+t/xa7pZH+eHGrxqUbA42PyQyYHRY9XB
	D0wBjFFcNimpOZllqUX6dglcGT2bprEWHGSt+PryLHMD4y6WLkZODgkBE4mP12ezQdhiEhfu
	rQeyuTiEBJYySqz/vJcVwpnBJPFu+iF2CGcbo8ShG88ZQVpYBFQlZq15DjaKTcBQYuqm2UBx
	Dg4RAW2J9o9iIGFhAS+JH4/3MoOEeQXsJc6fKQIJcwpYSryZcJsJYuQkJokLz7eCXcEvoC9x
	9e8nJoiL7CVmXjkDtopXQFDix+R7YKuYBbQkNm9rYoWw5SU2r3nLDGILCahL3Li7m30Co9As
	JC2zkLTMQtKygJF5FaNoamlyQXFSeq6hXnFibnFpXrpecn7uJkZI0H7Zwbj4mNUhRgEORiUe
	3gC2+aFCrIllxZW5hxglOJiVRHi7VwGFeFMSK6tSi/Lji0pzUosPMUpzsCiJ887d9T5ESCA9
	sSQ1OzW1ILUIJsvEwSnVwBghzef4yePXxumJz2NLT93+ny+SFLTs04qgu4+vNzyX4X6v5rxE
	85bJ6Wtytd++PtxUtuxN/5EPQb9l/H6Z9llsYzj8rMJF12C1uOLsg1++riiqsDW/+i36/nod
	qXJ3o6Xs9ftWX/68g2FP9QruH6opbzO8P1peTZ5cYOy4459cAJtH7bV/TAeVWIozEg21mIuK
	EwEZzvbmVgIAAA==

On Fri, 10 Jul 2015 09:18:21 -0700
Bart Schaefer <schaefer@brasslantern.com> wrote:
> Given that we can now skip individual test cases as well as entire test
> scripts, should we start counting the individual test cases to report
> the number of successful/failed tests, rather than counting only the
> number of scripts that ran without any failures?

Probably, but it's not trivial since currently the bit that does the
counting is in a separate executable, which is how we protect
different scripts from one another. We need a new way of signalling e.g.
a temporary file. I think we should avoid pipes --- we have enough
trouble with those without making the test system run in one.

pws