From mboxrd@z Thu Jan 1 00:00:00 1970 X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on inbox.vuxu.org X-Spam-Level: X-Spam-Status: No, score=-3.3 required=5.0 tests=DKIM_SIGNED,DKIM_VALID, MAILING_LIST_MULTI,RCVD_IN_DNSWL_MED,UNPARSEABLE_RELAY autolearn=ham autolearn_force=no version=3.4.4 Received: (qmail 18607 invoked from network); 4 May 2022 01:44:53 -0000 Received: from zero.zsh.org (2a02:898:31:0:48:4558:7a:7368) by inbox.vuxu.org with ESMTPUTF8; 4 May 2022 01:44:53 -0000 ARC-Seal: i=1; cv=none; a=rsa-sha256; d=zsh.org; s=rsa-20210803; t=1651628693; b=Ij7OXA2r2ubo6woNTXJOj67F0yb86XhslevYG/h6WeffbCaFDnwfDy5mZjIOcjZehL4XwQ53Me fwI19nswiQlSzAEnxNVKixlyjmaOfku/DiXBGDT+SdhpaLgDCvh6YSnfkPhP0WtJFtbJ1pJ/A7 WfLb9JktsSsngb+x4NnFgVa/B3DF4+D04szdbLBLkUsv1gG3hxvgUuTFmeYO9U1iYKey7Bxim1 kgJYaLCGna0ny2aBqxwegL9cMbutdA7jtOtrKYBhH+QML/DIijp+TBwLGO8CYkcc85VSdStViB nn8zfY+EVLGBs+tNbssysvDYKSXpMoIQqVXhmhnIBNJVKg==; ARC-Authentication-Results: i=1; zsh.org; iprev=pass (mail-ed1-f48.google.com) smtp.remote-ip=209.85.208.48; dkim=pass header.d=brasslantern-com.20210112.gappssmtp.com header.s=20210112 header.a=rsa-sha256; dmarc=none header.from=brasslantern.com; arc=none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed; d=zsh.org; s=rsa-20210803; t=1651628693; bh=4SNADDQW8W9q6Pd5VwnikwKlvxDryVMovo5Dvu2j1Bc=; h=List-Archive:List-Owner:List-Post:List-Unsubscribe:List-Subscribe:List-Help: List-Id:Sender:Content-Type:To:Subject:Message-ID:Date:From:MIME-Version: DKIM-Signature:DKIM-Signature; b=FzO/vnu29+63C1VLjVf3OMjElwZrOtvVhowkGuw/tQXoPE1UUYU66YDjBOrVHtBUzWXZd1RlLv 709LpfJSPM1T5+dl3q+1WRI0eG/+x3o8hDW2PwlS1FuxU9SDpW5vLR8+cchqcrskuwvxmyOQ8v JtPhgyssf3431X32+CBzKm9RplKz/OZIqhTxwYR8cUz/VI61ZObAxxnfjRlUgGxkwN6W9+LeOI OJndpCBkbNuK2KqYE8Sk8DHoqhHOSWXd4IYVDL7ZXgMBsEnQkih85UcAErrVxnJBjR8dtvdGh+ R9OKrs6pfLUdiR22xYOixx/hE0CmRWCWmPa3zQoajYs4Ew==; DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=zsh.org; s=rsa-20210803; h=List-Archive:List-Owner:List-Post:List-Unsubscribe: List-Subscribe:List-Help:List-Id:Sender:Content-Type:To:Subject:Message-ID: Date:From:MIME-Version:Reply-To:Cc:Content-Transfer-Encoding:Content-ID: Content-Description:Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc :Resent-Message-ID:In-Reply-To:References; bh=4SNADDQW8W9q6Pd5VwnikwKlvxDryVMovo5Dvu2j1Bc=; b=JXN2Yuh9AeYrK11xwiIrufrI8I ixf0cAccCYfnaqkcuEYhMmvkDfYwEEw2BAHVAUUKzkb0wZo2mI5JSIJcshmx1rBqDfJhrt2lmcy0P xWjM1F+Mqsb56RoWwW0K9edVxet5uPPLsgVqNznQ1ONzdbnsMJYhtPRLS55aDGBboYxe6ZcP2sf5s SjBXQtFmk5xcjzCJqoX6Qg2/aib448rL7UHFaCdyQzpySDizamFSqHxGCH0mBT5biAF9myv/7RQKt 2Uh9s6neen0d8+Z80QZthlssS0uNPsDcM94Q3gCye40GjAnbAK3UQNQxSEv7Dx568dP0iLtkgwdJ6 emoCKW3g==; Received: from authenticated user by zero.zsh.org with local id 1nm44T-000FXR-1I; Wed, 04 May 2022 01:44:53 +0000 Authentication-Results: zsh.org; iprev=pass (mail-ed1-f48.google.com) smtp.remote-ip=209.85.208.48; dkim=pass header.d=brasslantern-com.20210112.gappssmtp.com header.s=20210112 header.a=rsa-sha256; dmarc=none header.from=brasslantern.com; arc=none Received: from mail-ed1-f48.google.com ([209.85.208.48]:40602) by zero.zsh.org with esmtps (TLS1.3:TLS_AES_128_GCM_SHA256:128) id 1nm449-000FDh-3j; Wed, 04 May 2022 01:44:33 +0000 Received: by mail-ed1-f48.google.com with SMTP id p18so152705edr.7 for ; Tue, 03 May 2022 18:44:32 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=brasslantern-com.20210112.gappssmtp.com; s=20210112; h=mime-version:from:date:message-id:subject:to; bh=4SNADDQW8W9q6Pd5VwnikwKlvxDryVMovo5Dvu2j1Bc=; b=UIU/ZyJmetavzRRlJpao7TBwh0iZkvD38sXCZrBl8funer/Up1JMMmB4KCBJTYsfK1 xDALLDEBWKsuHSBQHxTqbPvEIgFHdNyvPmKlT5SG4AnLdAtcDhvnS00sW+Fu8HHQj9Fo 15UOLenuS4meSHgU7YKZwzyEo/MN26hXZQA6jVEunJq1DRVDHQLwLFmfRyEfKyR/8VIr TmOPBuc6eugzm+Rp24Ha73mv4YvYmGDqyFLWvNE4o0kea5ZTHzuD60vBfWLgZll/DX1y HuMFkx7jOcHmZmij455lNPSCRVvuWf6eijxaG/b98beTrhq6b0OwGcEpE17em4Rjzj3t NoAQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=4SNADDQW8W9q6Pd5VwnikwKlvxDryVMovo5Dvu2j1Bc=; b=URFTmW2eizbj9W/2FjqSKZKJGe/PZKfybcPGJbNMfwfGo/MCsv+G+z9B95lqHfQFNx IOzZ4PEfCf9Pgi1PMbBJxLUTlkhpRZ9lnKHH14ouR1SzwdOA/+13r4DEl2w5ok57ouqn ei0UFUcPGTqjayXdUzmUp6buu8CEfcuJQDbuR1yqjGml7NxW5e/uOXsv7awOZ+uM+Axn n0K/TPUx/FfE/03f3SoewuMXnVo7+BK1zK7kShGbH7iHnjMaFu+GvThc4s3rUuXfgPOg RKKARLHvr0M1WR7rRkLXtvKmjZ3m8hNMsNNoyZ3dpiPrijjbzzqqmAYCmHeHOWHTjkBO BLGg== X-Gm-Message-State: AOAM530AhcQXGZaFSe/QLv0oiGS5Ej7uxe5nTfrhg+Pm074USeLivC6D IVEA6OZA3pOZknZIuegwFI65gAyGwjF/L63kAck/yN/qAEE= X-Google-Smtp-Source: ABdhPJyviLv0u1eO9jNuJAWcT1DqjCh6/r6nRORO16pQEWb+2redfvMB6Dx1WeIhq7v580vsC3riLo842mySfdymOrA= X-Received: by 2002:aa7:d407:0:b0:425:f57e:7ae5 with SMTP id z7-20020aa7d407000000b00425f57e7ae5mr20740640edq.393.1651628672563; Tue, 03 May 2022 18:44:32 -0700 (PDT) MIME-Version: 1.0 From: Bart Schaefer Date: Tue, 3 May 2022 18:44:21 -0700 Message-ID: Subject: A suggestion RE Xfail tests To: Zsh hackers list Content-Type: text/plain; charset="UTF-8" X-Seq: 50172 Archived-At: X-Loop: zsh-workers@zsh.org Errors-To: zsh-workers-owner@zsh.org Precedence: list Precedence: bulk Sender: zsh-workers-request@zsh.org X-no-archive: yes List-Id: List-Help: List-Subscribe: List-Unsubscribe: List-Post: List-Owner: List-Archive: It would be helpful if tests that are expected to fail could list both the expected "correct" result (that is, the result if the test were to succeed, which would cause the Xfail test to fail) and the expected "wrong" output ... so that if the way a test goes wrong changes, that too can be seen. Yes, this can be done now by repeating the test twice, once as an xfail and once as a regular test but with the "broken" result ... but it might be easier to keep track of if it were all in one place. (No action on this expected pre-5.9-release, just musing.)