From mboxrd@z Thu Jan 1 00:00:00 1970 X-Msuck: nntp://news.gmane.org/gmane.linux.lib.musl.general/4359 Path: news.gmane.org!not-for-mail From: Szabolcs Nagy Newsgroups: gmane.linux.lib.musl.general Subject: Re: Release test framework Date: Wed, 4 Dec 2013 08:48:02 +0100 Message-ID: <20131204074802.GW1685@port70.net> References: <20131203221153.GA18502@brightrain.aerifal.cx> Reply-To: musl@lists.openwall.com NNTP-Posting-Host: plane.gmane.org Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Trace: ger.gmane.org 1386143289 17722 80.91.229.3 (4 Dec 2013 07:48:09 GMT) X-Complaints-To: usenet@ger.gmane.org NNTP-Posting-Date: Wed, 4 Dec 2013 07:48:09 +0000 (UTC) To: musl@lists.openwall.com Original-X-From: musl-return-4363-gllmg-musl=m.gmane.org@lists.openwall.com Wed Dec 04 08:48:15 2013 Return-path: Envelope-to: gllmg-musl@plane.gmane.org Original-Received: from mother.openwall.net ([195.42.179.200]) by plane.gmane.org with smtp (Exim 4.69) (envelope-from ) id 1Vo7Bu-0003AG-Gk for gllmg-musl@plane.gmane.org; Wed, 04 Dec 2013 08:48:14 +0100 Original-Received: (qmail 7675 invoked by uid 550); 4 Dec 2013 07:48:13 -0000 Mailing-List: contact musl-help@lists.openwall.com; run by ezmlm Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: Original-Received: (qmail 7665 invoked from network); 4 Dec 2013 07:48:13 -0000 Content-Disposition: inline In-Reply-To: <20131203221153.GA18502@brightrain.aerifal.cx> User-Agent: Mutt/1.5.21 (2010-09-15) Xref: news.gmane.org gmane.linux.lib.musl.general:4359 Archived-At: * Rich Felker [2013-12-03 17:11:53 -0500]: > For each arch: > Assume the existence of a musl-cross compiler for it. > Build musl and install to a prefix under the rest root. > Build libc-test configured to use the new headers/libs. > Create cpio archive containing: > Newly built musl libc.so. > Newly built libc-test tree. > Provided base system template containing: > Busybox. > Simple /etc tree. > Minimal init script to run tests. > Boot qemu using a provided kernel and the new initramfs. > Save output of tests outside the qemu environment. > Diff against expected results for comparison. > > Does this seem like a reasonable and useful test procedure? Is anyone > willing to volunteer to write the scripts for it? libc-test is not well organized for running it out of tree, it uses gnu make to run the tests and generate the reports now so the target needs make as well otherwise it looks ok btw if tests are run as root then a bit more interfaces can be tested (setuid, permission failure handling, etc) which are not yet in the scope of libc-test