From mboxrd@z Thu Jan  1 00:00:00 1970
Return-Path: <zsh-workers-return-35762-mason-zsh=primenet.com.au@zsh.org>
Received: (qmail 23666 invoked by alias); 10 Jul 2015 16:18:34 -0000
Mailing-List: contact zsh-workers-help@zsh.org; run by ezmlm
Precedence: bulk
X-No-Archive: yes
List-Id: Zsh Workers List <zsh-workers.zsh.org>
List-Post: <mailto:zsh-workers@zsh.org>
List-Help: <mailto:zsh-workers-help@zsh.org>
X-Seq: 35762
Received: (qmail 10116 invoked from network); 10 Jul 2015 16:18:31 -0000
X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on f.primenet.com.au
X-Spam-Level: 
X-Spam-Status: No, score=-2.6 required=5.0 tests=BAYES_00,RCVD_IN_DNSWL_LOW,
	RCVD_IN_MSPIKE_H2 autolearn=ham autolearn_force=no version=3.4.0
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=1e100.net; s=20130820;
        h=x-gm-message-state:from:message-id:date:in-reply-to:comments
         :references:to:subject:mime-version:content-type;
        bh=vS4ROzm/PgLZExW9utxzWMy5zYe+4E9LwhwP5LgKr0k=;
        b=Sqq+AqlfhoRbjOhDbM64yANSQ8DJ2L9kLy92UOeZU/WGD6Wbib9GqLyTJAbker8hTU
         mnDYk4+pBbSBtPubUhnJ+HvPN3BF2lI/7jhwa2h3fTIbVs0om7LxXkj9J2E+VgNEKS7E
         8Hcqfgv1Kw3dTUP9LVlLkjeneSXgmkVlbo3Th2/8ZjFv7dZC7UircfBtzu6Y1zrmny1U
         BIUerAv6YgisdXlCyfWefRNlA6CoVV9g2PnLfZuA+vu1t9vbpvKwO8s/CEBhaUMF5sbC
         DJCb0G5qfBPjzamft2ftTISyYV0IaNMR14y5ZejWPxqZebsnxYrVrzFL5FB6lRafNc/G
         FAPg==
X-Gm-Message-State: ALoCoQnv+3hSbZ+axUGuC+youI5uq6loMSqb7m+IJAT3NbJLeoQTRUpW3l5RGIi6kKwNrkAoOYwd
X-Received: by 10.182.135.202 with SMTP id pu10mr20642354obb.52.1436545106071;
        Fri, 10 Jul 2015 09:18:26 -0700 (PDT)
From: Bart Schaefer <schaefer@brasslantern.com>
Message-Id: <150710091821.ZM9912@torch.brasslantern.com>
Date: Fri, 10 Jul 2015 09:18:21 -0700
In-Reply-To: <20150710143708.71ec8178@pwslap01u.europe.root.pri>
Comments: In reply to Peter Stephenson <p.stephenson@samsung.com>
        "Re: PATCH: ztrftime: Pass everything unhandled to the system strftime()" (Jul 10,  2:37pm)
References: <20150709094122.17abacc8@pwslap01u.europe.root.pri> 
	<1436435887-28736-1-git-send-email-mikachu@gmail.com> 
	<20150709111756.631dac65@pwslap01u.europe.root.pri> 
	<20150710143708.71ec8178@pwslap01u.europe.root.pri>
X-Mailer: OpenZMail Classic (0.9.2 24April2005)
To: "Zsh Hackers' List" <zsh-workers@zsh.org>
Subject: Skipping tests (was Re: PATCH: ztrftime: Pass everything ...)
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii

On Jul 10,  2:37pm, Peter Stephenson wrote:
} Subject: Re: PATCH: ztrftime: Pass everything unhandled to the system strf
}
} On Thu, 9 Jul 2015 11:17:56 +0100
} Peter Stephenson <p.stephenson@samsung.com> wrote:
} > 
} > OK, the printing "skipped" trick looks like it should cover all bases.
} > Still, it ought to be possible to make it redundant within the test
} > framework...
} 
} +  # Test skipping early to ensure we run the remainder...
} +  if [[ -n $ZTST_test_skip ]]; then
} +    ZTST_skip="Test system verification for skipping"
} +  else
} +    print "This is standard output"
} +    print "This is standard error" >&2
} +    false
} +  fi
} +1:Test skipping if ZTST_test_skip is set
} +>This is standard output
} +?This is standard error

OK, so the way we actually test THIS is e.g.

    ZTST_test_skip=skip make check TESTNUM=A01

And that seems to correctly print "Test system verification for skipping"
followed by actually running all the other tests in the script.  Great!

Given that we can now skip individual test cases as well as entire test
scripts, should we start counting the individual test cases to report
the number of successful/failed tests, rather than counting only the
number of scripts that ran without any failures?