From: paper42 <paper42@users.noreply.github.com>
To: ml@inbox.vuxu.org
Subject: Re: [RFC] Ideas for check and CI
Date: Sun, 06 Nov 2022 21:08:35 +0100 [thread overview]
Message-ID: <20221106200835.sxJlN93_LUZgU4wshzJwgXRCer8XeZB528TxIgTAieY@z> (raw)
In-Reply-To: <gh-mailinglist-notifications-41a7ca26-5023-4802-975b-f1789d68868e-void-packages-34766@inbox.vuxu.org>
[-- Attachment #1: Type: text/plain, Size: 1472 bytes --]
New comment by paper42 on void-packages repository
https://github.com/void-linux/void-packages/issues/34766#issuecomment-1304883171
Comment:
> * have an option `[check-skip]` that works as `[ci-skip]` but instead of skipping the whole CI it will run it without `-Q`.
Tests can be skipped with `make_check=ci-skip` in the template if they don't work in CI or `make_check=extended`.
> maybe have a way to indicate that some checks are expected to fail for certain archs. For instance, I'd mark bogofilter and inkscape as xfail for x86_64-musl. The check step would still run, but it wouldn't stop with an error on failure so the CI can keep going. E.g. check_xfail="x86_64-musl".
> maybe have a way to indicate that some checks should be skipped for certain archs. For instance, I'd mark gnuradio to skip checks for i686 so the CI wouldn't get stuck on a loose test. E.g. check_skip="i686".
This can already be done:
```
case "$XBPS_TARGET_MACHINE" in
# reason
i686*) make_check=no ;;
esac
```
It doesn't make much sense to run the tests, but then ignore the result, so I think not running tests is good enough for us.
> Policy could be to comment any check_xfail or check_skip with an issue number where it is well documented.
`$make_check` should always have a comment explaining why it's needed and can link to an upstream issue. `xlint` check for a comment and will throw an error when it's not there which makes the lint step in CI fail.
prev parent reply other threads:[~2022-11-06 20:08 UTC|newest]
Thread overview: 4+ messages / expand[flat|nested] mbox.gz Atom feed top
2021-12-30 15:15 [ISSUE] " tornaria
2022-06-20 2:13 ` github-actions
2022-07-04 2:15 ` [ISSUE] [CLOSED] " github-actions
2022-11-06 20:08 ` paper42 [this message]
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20221106200835.sxJlN93_LUZgU4wshzJwgXRCer8XeZB528TxIgTAieY@z \
--to=paper42@users.noreply.github.com \
--cc=ml@inbox.vuxu.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).