From mboxrd@z Thu Jan 1 00:00:00 1970 X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on inbox.vuxu.org X-Spam-Level: X-Spam-Status: No, score=-3.3 required=5.0 tests=MAILING_LIST_MULTI, RCVD_IN_DNSWL_MED,RCVD_IN_MSPIKE_H3,RCVD_IN_MSPIKE_WL autolearn=ham autolearn_force=no version=3.4.4 Received: (qmail 10572 invoked from network); 17 Nov 2020 12:04:27 -0000 Received: from mother.openwall.net (195.42.179.200) by inbox.vuxu.org with ESMTPUTF8; 17 Nov 2020 12:04:27 -0000 Received: (qmail 5268 invoked by uid 550); 17 Nov 2020 12:04:22 -0000 Mailing-List: contact musl-help@lists.openwall.com; run by ezmlm Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-ID: Reply-To: musl@lists.openwall.com Received: (qmail 5250 invoked from network); 17 Nov 2020 12:04:21 -0000 X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:references:date:in-reply-to :message-id:user-agent:mime-version; bh=h5mMv0tUggXkA/2n3Lxkn0YZ8J7D4b6a7nIGVilaOkM=; b=rxlXT3hbjs9Q8Opr7BLwFBpYY1ycT5hSiusTgQkP5f4F0QTjJ7H6w9PQSrPn6xL/o+ wEzlTFqBD/qSlcn9X4yNJ+58dXeFxTrznov1unan3wIfOFa/zboZj20Sa7QF6vWi9Olm vNT4zlAX27ufZ+NasPhDl6mfOJHrfAZKO3/zRGL5vRKGPFboZeVzylSW1EqCAZmNQ4wL XJhQcw674TDtKtXGZVTB9PqLKYzcz358eyXLIIc0UQPIuILIgouHE9Pk20da27bNT1Mt Fqg4LWMfNzeDgTQg0sYbhXHhyhKzPyvKhV+jzs63se7OC44Lb/2F1PAiR8nmb6vwAqer SN1Q== X-Gm-Message-State: AOAM531m9Oj+P3p5pv796eijGR7NLBOFnxT42FBmW3JOxENhMoY5Ml7g bmq+vcL7Kt0UK4ZGIyefootqoiCLkCQa4BBa X-Google-Smtp-Source: ABdhPJwyYXE4vPhqEL4lgGiWJ5lZzepR+k2GCPV7kn+VVmFj6pbC13m0mk0wZe/oKF1zcq2Wg3Nycg== X-Received: by 2002:a1c:b387:: with SMTP id c129mr4211571wmf.66.1605614649812; Tue, 17 Nov 2020 04:04:09 -0800 (PST) From: Leah Neukirchen To: Rich Felker Cc: musl@lists.openwall.com References: <20201117040951.GA9668@brightrain.aerifal.cx> Date: Tue, 17 Nov 2020 13:04:07 +0100 In-Reply-To: <20201117040951.GA9668@brightrain.aerifal.cx> (Rich Felker's message of "Mon, 16 Nov 2020 23:09:52 -0500") Message-ID: <87eeksqjew.fsf@vuxu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.1 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain Subject: Re: [musl] musl CI? Rich Felker writes: > The topic of CI for testing came up on #musl today, and although it's > not something I want to be responsible for running, it does sound very > good to have. We noted that libc-test currently has tests that are > failing and expected to fail, and that this is normal and not cause > for disabling tests, but it did suggest to me a methodology that seems > more appropriate than checking whether tests succeed: checking for > differences in test output (as well as other things, like symbol > table) vs suitable baselines like last release or last run. The tool abidiff from libabigail may be useful for that: https://sourceware.org/libabigail/manual/abidiff.html -- Leah Neukirchen https://leahneukirchen.org/