From mboxrd@z Thu Jan 1 00:00:00 1970 X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on inbox.vuxu.org X-Spam-Level: X-Spam-Status: No, score=-3.3 required=5.0 tests=MAILING_LIST_MULTI, RCVD_IN_DNSWL_MED,RCVD_IN_MSPIKE_H3,RCVD_IN_MSPIKE_WL autolearn=ham autolearn_force=no version=3.4.4 Received: (qmail 2187 invoked from network); 17 Nov 2020 15:48:41 -0000 Received: from mother.openwall.net (195.42.179.200) by inbox.vuxu.org with ESMTPUTF8; 17 Nov 2020 15:48:41 -0000 Received: (qmail 27853 invoked by uid 550); 17 Nov 2020 15:48:38 -0000 Mailing-List: contact musl-help@lists.openwall.com; run by ezmlm Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-ID: Reply-To: musl@lists.openwall.com Received: (qmail 27829 invoked from network); 17 Nov 2020 15:48:37 -0000 Date: Tue, 17 Nov 2020 10:48:24 -0500 From: Rich Felker To: musl@lists.openwall.com Message-ID: <20201117154824.GY534@brightrain.aerifal.cx> References: <20201117040951.GA9668@brightrain.aerifal.cx> <87eeksqjew.fsf@vuxu.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <87eeksqjew.fsf@vuxu.org> User-Agent: Mutt/1.5.21 (2010-09-15) Subject: Re: [musl] musl CI? On Tue, Nov 17, 2020 at 01:04:07PM +0100, Leah Neukirchen wrote: > Rich Felker writes: > > > The topic of CI for testing came up on #musl today, and although it's > > not something I want to be responsible for running, it does sound very > > good to have. We noted that libc-test currently has tests that are > > failing and expected to fail, and that this is normal and not cause > > for disabling tests, but it did suggest to me a methodology that seems > > more appropriate than checking whether tests succeed: checking for > > differences in test output (as well as other things, like symbol > > table) vs suitable baselines like last release or last run. > > The tool abidiff from libabigail may be useful for that: > > https://sourceware.org/libabigail/manual/abidiff.html I seem to recall it coming up before and finding it overkill. Not objecting if anyone wants to setup something using it and can, but IIRC nsz has a simple ABI dumper too based on C++ name mangling, and just the symbol table itself (without any info on further ABI for the symbols) can be done with nm -D. Rich