[ruby-core:107790] [Ruby master Bug#18613] Voluntary wanted: Some signal-related tests fail on FreeBSD 13

[ruby-core:107790] [Ruby master Bug#18613] Voluntary wanted: Some signal-related tests fail on FreeBSD 13

[mame (Yusuke Endoh)]

Issue #18613 has been reported by mame (Yusuke Endoh).

----------------------------------------
Bug #18613: Voluntary wanted: Some signal-related tests fail on FreeBSD 13
https://bugs.ruby-lang.org/issues/18613

* Author: mame (Yusuke Endoh)
* Status: Feedback
* Priority: Normal
* Assignee: knu (Akinori MUSHA)
* Backport: 2.6: UNKNOWN, 2.7: UNKNOWN, 3.0: UNKNOWN, 3.1: UNKNOWN
----------------------------------------
Some tests fail randomly on FreeBSD 13.

http://rubyci.s3.amazonaws.com/freebsd13/ruby-master/log/20220216T143001Z.fail.html.gz

```
  1) Error:
TestThread#test_signal_at_join:
Timeout::Error: execution of assert_separately expired timeout (120 sec)
pid 30743 killed by SIGABRT (signal 6) (core dumped)
| 

    /usr/home/chkbuild/chkbuild/tmp/build/20220216T143001Z/ruby/test/ruby/test_thread.rb:1390:in `test_signal_at_join'
```

http://rubyci.s3.amazonaws.com/freebsd13/ruby-master/log/20220308T023001Z.fail.html.gz

```
  1) Failure:
TestThreadQueue#test_thr_kill [/usr/home/chkbuild/chkbuild/tmp/build/20220308T023001Z/ruby/test/ruby/test_thread_queue.rb:175]:
only 169/250 done in 60 seconds.
```

http://rubyci.s3.amazonaws.com/freebsd13/ruby-master/log/20220304T163001Z.fail.html.gz

```
  1) Failure:
TestIO_Console#test_intr [/usr/home/chkbuild/chkbuild/tmp/build/20220304T163001Z/ruby/test/io/console/test_io_console.rb:387]:
<"25"> expected but was
<"-e:12:in `p': \e[1mexecution expired (\e[1;4mTimeout::Error\e[m\e[1m)\e[m">.
```

All of the tests is related to signals. I guess something around signals has changed in FreeBSD 13, but I'm unsure. The failure occurs at high frequency in CI, but rarely does on my FreeBSD shell. We need to investigate what happens.

@knu is the platform maintainer for FreeBSD but he is busy. Contribution who is familiar with FreeBSD is welcome.

To make it easy to monitor the CI results, I tentatively skipped the three tests on FreeBSD https://github.com/ruby/ruby/commit/17e09f033c4d3b786672ba16d2c5d935482a2fad . If you investigate the issue on FreeBSD, please delete test/excludes/TestThread.rb and test/excludes/TestThreadQueue.rb, and remove the guard in test/io/console/test_io_console.rb.



-- 
https://bugs.ruby-lang.org/

[ruby-core:108735] [Ruby master Bug#18613] Voluntary wanted: Some signal-related tests fail on FreeBSD 13

[mame (Yusuke Endoh)]

Issue #18613 has been updated by mame (Yusuke Endoh).


Now FreeBSD 12 fails as well. Probably because we upgraded the machine to 12.3.

http://rubyci.s3.amazonaws.com/freebsd12/ruby-master/log/20220529T183002Z.fail.html.gz

```
  1) Failure:
TestThreadQueue#test_thr_kill [/usr/home/chkbuild/chkbuild/tmp/build/20220529T183002Z/ruby/test/ruby/test_thread_queue.rb:175]:
only 156/250 done in 60 seconds.

  2) Error:
TestThread#test_signal_at_join:
Timeout::Error: execution of assert_separately expired timeout (120 sec)
pid 90353 exit 1
```

Such noisy failures make it difficult for us to monitor and manage the CI. Since no one seems to be able to fix it, I'm now keen to stop the FreeBSD CI machines.

----------------------------------------
Bug #18613: Voluntary wanted: Some signal-related tests fail on FreeBSD 13
https://bugs.ruby-lang.org/issues/18613#change-97790

* Author: mame (Yusuke Endoh)
* Status: Feedback
* Priority: Normal
* Assignee: knu (Akinori MUSHA)
* Backport: 2.6: UNKNOWN, 2.7: UNKNOWN, 3.0: UNKNOWN, 3.1: UNKNOWN
----------------------------------------
Some tests fail randomly on FreeBSD 13.

http://rubyci.s3.amazonaws.com/freebsd13/ruby-master/log/20220216T143001Z.fail.html.gz

```
  1) Error:
TestThread#test_signal_at_join:
Timeout::Error: execution of assert_separately expired timeout (120 sec)
pid 30743 killed by SIGABRT (signal 6) (core dumped)
| 

    /usr/home/chkbuild/chkbuild/tmp/build/20220216T143001Z/ruby/test/ruby/test_thread.rb:1390:in `test_signal_at_join'
```

http://rubyci.s3.amazonaws.com/freebsd13/ruby-master/log/20220308T023001Z.fail.html.gz

```
  1) Failure:
TestThreadQueue#test_thr_kill [/usr/home/chkbuild/chkbuild/tmp/build/20220308T023001Z/ruby/test/ruby/test_thread_queue.rb:175]:
only 169/250 done in 60 seconds.
```

http://rubyci.s3.amazonaws.com/freebsd13/ruby-master/log/20220304T163001Z.fail.html.gz

```
  1) Failure:
TestIO_Console#test_intr [/usr/home/chkbuild/chkbuild/tmp/build/20220304T163001Z/ruby/test/io/console/test_io_console.rb:387]:
<"25"> expected but was
<"-e:12:in `p': \e[1mexecution expired (\e[1;4mTimeout::Error\e[m\e[1m)\e[m">.
```

All of the tests is related to signals. I guess something around signals has changed in FreeBSD 13, but I'm unsure. The failure occurs at high frequency in CI, but rarely does on my FreeBSD shell. We need to investigate what happens.

@knu is the platform maintainer for FreeBSD but he is busy. Contribution who is familiar with FreeBSD is welcome.

To make it easy to monitor the CI results, I tentatively skipped the three tests on FreeBSD https://github.com/ruby/ruby/commit/17e09f033c4d3b786672ba16d2c5d935482a2fad . If you investigate the issue on FreeBSD, please delete test/excludes/TestThread.rb and test/excludes/TestThreadQueue.rb, and remove the guard in test/io/console/test_io_console.rb.



-- 
https://bugs.ruby-lang.org/

[ruby-core:120716] [Ruby master Bug#18613] Voluntary wanted: Some signal-related tests fail on FreeBSD 13

[hs (Hideki Sakamoto) via ruby-core]

Issue #18613 has been updated by hs (Hideki Sakamoto).

File patch-test_io_console_test__io__console.rb added
File patch-test_ruby_test__thread__queue.rb added
File patch-test_ruby_test__thread.rb added

I apologize if my comment on the closed ticket is inappropriate. By the way, these bugs seem to have been fixed in FreeBSD 13.4 (or 13.3).

I applied the attached patch to the Ruby 3.4.1 source and tried "make test-all" dozens of times in FreeBSD 13.4(while checking #21045), but the error no longer reappeared.

<pre>
% tar xf ruby-3.4.1.tar.xz
% cd ruby-3.4.1/
% patch < patch-test_io_console_test__io__console.rb
% patch < patch-test_ruby_test__thread.rb
% patch < patch-test_ruby_test__thread__queue.rb
% ./configure
% make
% make test-all
</pre>

While not a direct reference, a bug report similar to this bug has been reported in FreeBSD Bugzilla – [Bug 277429](https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=277429)  and appears to have been fixed in 13.3.


----------------------------------------
Bug #18613: Voluntary wanted: Some signal-related tests fail on FreeBSD 13
https://bugs.ruby-lang.org/issues/18613#change-111549

* Author: mame (Yusuke Endoh)
* Status: Feedback
* Assignee: knu (Akinori MUSHA)
* Backport: 2.6: UNKNOWN, 2.7: UNKNOWN, 3.0: UNKNOWN, 3.1: UNKNOWN
----------------------------------------
Some tests fail randomly on FreeBSD 13.

http://rubyci.s3.amazonaws.com/freebsd13/ruby-master/log/20220216T143001Z.fail.html.gz

```
  1) Error:
TestThread#test_signal_at_join:
Timeout::Error: execution of assert_separately expired timeout (120 sec)
pid 30743 killed by SIGABRT (signal 6) (core dumped)
| 

    /usr/home/chkbuild/chkbuild/tmp/build/20220216T143001Z/ruby/test/ruby/test_thread.rb:1390:in `test_signal_at_join'
```

http://rubyci.s3.amazonaws.com/freebsd13/ruby-master/log/20220308T023001Z.fail.html.gz

```
  1) Failure:
TestThreadQueue#test_thr_kill [/usr/home/chkbuild/chkbuild/tmp/build/20220308T023001Z/ruby/test/ruby/test_thread_queue.rb:175]:
only 169/250 done in 60 seconds.
```

http://rubyci.s3.amazonaws.com/freebsd13/ruby-master/log/20220304T163001Z.fail.html.gz

```
  1) Failure:
TestIO_Console#test_intr [/usr/home/chkbuild/chkbuild/tmp/build/20220304T163001Z/ruby/test/io/console/test_io_console.rb:387]:
<"25"> expected but was
<"-e:12:in `p': \e[1mexecution expired (\e[1;4mTimeout::Error\e[m\e[1m)\e[m">.
```

All of the tests is related to signals. I guess something around signals has changed in FreeBSD 13, but I'm unsure. The failure occurs at high frequency in CI, but rarely does on my FreeBSD shell. We need to investigate what happens.

@knu is the platform maintainer for FreeBSD but he is busy. Contribution who is familiar with FreeBSD is welcome.

To make it easy to monitor the CI results, I tentatively skipped the three tests on FreeBSD https://github.com/ruby/ruby/commit/17e09f033c4d3b786672ba16d2c5d935482a2fad . If you investigate the issue on FreeBSD, please delete test/excludes/TestThread.rb and test/excludes/TestThreadQueue.rb, and remove the guard in test/io/console/test_io_console.rb.

---Files--------------------------------
patch-test_io_console_test__io__console.rb (508 Bytes)
patch-test_ruby_test__thread__queue.rb (276 Bytes)
patch-test_ruby_test__thread.rb (337 Bytes)


-- 
https://bugs.ruby-lang.org/
 ______________________________________________
 ruby-core mailing list -- ruby-core@ml.ruby-lang.org
 To unsubscribe send an email to ruby-core-leave@ml.ruby-lang.org
 ruby-core info -- https://ml.ruby-lang.org/mailman3/lists/ruby-core.ml.ruby-lang.org/