* [ruby-core:118823] [Ruby master Bug#20670] fork deadlocks in child process due to timer thread
@ 2024-08-09 20:06 jhawthorn (John Hawthorn) via ruby-core
2024-08-10 1:17 ` [ruby-core:118824] " ko1 (Koichi Sasada) via ruby-core
` (2 more replies)
0 siblings, 3 replies; 4+ messages in thread
From: jhawthorn (John Hawthorn) via ruby-core @ 2024-08-09 20:06 UTC (permalink / raw)
To: ruby-core; +Cc: jhawthorn (John Hawthorn)
Issue #20670 has been reported by jhawthorn (John Hawthorn).
----------------------------------------
Bug #20670: fork deadlocks in child process due to timer thread
https://bugs.ruby-lang.org/issues/20670
* Author: jhawthorn (John Hawthorn)
* Status: Open
* ruby -v: ruby 3.3.4 (2024-07-09 revision be1089c8ec) [x86_64-linux]
* Backport: 3.1: UNKNOWN, 3.2: UNKNOWN, 3.3: UNKNOWN
----------------------------------------
We've been seeing an occasional failure in the Rails CI related to a test which forks and I managed to reduce it to the following reproduction.
``` ruby
Thread.new do
loop { sleep 0.0001 }
end
1000.times do
pid = fork{}
Process.waitpid(pid)
rescue Exception
Process.kill(:KILL, pid)
raise
end
```
This hangs on Ruby 3.3 and HEAD (_fairly_ reliably), but completes always on Ruby 3.2
In a debugger it seems like the timer thread acquires `vm->ractor.sched.lock` in the parent process just as the process is forking. The child process then ends up stuck inside of `thread_sched_atfork` when trying to acquire the same lock.
I've opened https://github.com/ruby/ruby/pull/11356 with a fix
--
https://bugs.ruby-lang.org/
______________________________________________
ruby-core mailing list -- ruby-core@ml.ruby-lang.org
To unsubscribe send an email to ruby-core-leave@ml.ruby-lang.org
ruby-core info -- https://ml.ruby-lang.org/mailman3/lists/ruby-core.ml.ruby-lang.org/
^ permalink raw reply [flat|nested] 4+ messages in thread
* [ruby-core:118824] [Ruby master Bug#20670] fork deadlocks in child process due to timer thread
2024-08-09 20:06 [ruby-core:118823] [Ruby master Bug#20670] fork deadlocks in child process due to timer thread jhawthorn (John Hawthorn) via ruby-core
@ 2024-08-10 1:17 ` ko1 (Koichi Sasada) via ruby-core
2024-08-13 20:51 ` [ruby-core:118843] " jhawthorn (John Hawthorn) via ruby-core
2024-09-02 9:34 ` [ruby-core:119001] " k0kubun (Takashi Kokubun) via ruby-core
2 siblings, 0 replies; 4+ messages in thread
From: ko1 (Koichi Sasada) via ruby-core @ 2024-08-10 1:17 UTC (permalink / raw)
To: ruby-core; +Cc: ko1 (Koichi Sasada)
Issue #20670 has been updated by ko1 (Koichi Sasada).
Thank you!
----------------------------------------
Bug #20670: fork deadlocks in child process due to timer thread
https://bugs.ruby-lang.org/issues/20670#change-109391
* Author: jhawthorn (John Hawthorn)
* Status: Open
* ruby -v: ruby 3.3.4 (2024-07-09 revision be1089c8ec) [x86_64-linux]
* Backport: 3.1: UNKNOWN, 3.2: UNKNOWN, 3.3: UNKNOWN
----------------------------------------
We've been seeing an occasional failure in the Rails CI related to a test which forks and I managed to reduce it to the following reproduction.
``` ruby
Thread.new do
loop { sleep 0.0001 }
end
1000.times do
pid = fork{}
Process.waitpid(pid)
rescue Exception
Process.kill(:KILL, pid)
raise
end
```
This hangs on Ruby 3.3 and HEAD (_fairly_ reliably), but completes always on Ruby 3.2
In a debugger it seems like the timer thread acquires `vm->ractor.sched.lock` in the parent process just as the process is forking. The child process then ends up stuck inside of `thread_sched_atfork` when trying to acquire the same lock.
I've opened https://github.com/ruby/ruby/pull/11356 with a fix
--
https://bugs.ruby-lang.org/
______________________________________________
ruby-core mailing list -- ruby-core@ml.ruby-lang.org
To unsubscribe send an email to ruby-core-leave@ml.ruby-lang.org
ruby-core info -- https://ml.ruby-lang.org/mailman3/lists/ruby-core.ml.ruby-lang.org/
^ permalink raw reply [flat|nested] 4+ messages in thread
* [ruby-core:118843] [Ruby master Bug#20670] fork deadlocks in child process due to timer thread
2024-08-09 20:06 [ruby-core:118823] [Ruby master Bug#20670] fork deadlocks in child process due to timer thread jhawthorn (John Hawthorn) via ruby-core
2024-08-10 1:17 ` [ruby-core:118824] " ko1 (Koichi Sasada) via ruby-core
@ 2024-08-13 20:51 ` jhawthorn (John Hawthorn) via ruby-core
2024-09-02 9:34 ` [ruby-core:119001] " k0kubun (Takashi Kokubun) via ruby-core
2 siblings, 0 replies; 4+ messages in thread
From: jhawthorn (John Hawthorn) via ruby-core @ 2024-08-13 20:51 UTC (permalink / raw)
To: ruby-core; +Cc: jhawthorn (John Hawthorn)
Issue #20670 has been updated by jhawthorn (John Hawthorn).
Status changed from Open to Closed
Backport changed from 3.1: UNKNOWN, 3.2: UNKNOWN, 3.3: UNKNOWN to 3.1: DONTNEED, 3.2: DONTNEED, 3.3: REQUIRED
Fixed by https://github.com/ruby/ruby/commit/87a85550edd786665e081b355c6af62c4854b1d7
----------------------------------------
Bug #20670: fork deadlocks in child process due to timer thread
https://bugs.ruby-lang.org/issues/20670#change-109410
* Author: jhawthorn (John Hawthorn)
* Status: Closed
* ruby -v: ruby 3.3.4 (2024-07-09 revision be1089c8ec) [x86_64-linux]
* Backport: 3.1: DONTNEED, 3.2: DONTNEED, 3.3: REQUIRED
----------------------------------------
We've been seeing an occasional failure in the Rails CI related to a test which forks and I managed to reduce it to the following reproduction.
``` ruby
Thread.new do
loop { sleep 0.0001 }
end
1000.times do
pid = fork{}
Process.waitpid(pid)
rescue Exception
Process.kill(:KILL, pid)
raise
end
```
This hangs on Ruby 3.3 and HEAD (_fairly_ reliably), but completes always on Ruby 3.2
In a debugger it seems like the timer thread acquires `vm->ractor.sched.lock` in the parent process just as the process is forking. The child process then ends up stuck inside of `thread_sched_atfork` when trying to acquire the same lock.
I've opened https://github.com/ruby/ruby/pull/11356 with a fix
--
https://bugs.ruby-lang.org/
______________________________________________
ruby-core mailing list -- ruby-core@ml.ruby-lang.org
To unsubscribe send an email to ruby-core-leave@ml.ruby-lang.org
ruby-core info -- https://ml.ruby-lang.org/mailman3/lists/ruby-core.ml.ruby-lang.org/
^ permalink raw reply [flat|nested] 4+ messages in thread
* [ruby-core:119001] [Ruby master Bug#20670] fork deadlocks in child process due to timer thread
2024-08-09 20:06 [ruby-core:118823] [Ruby master Bug#20670] fork deadlocks in child process due to timer thread jhawthorn (John Hawthorn) via ruby-core
2024-08-10 1:17 ` [ruby-core:118824] " ko1 (Koichi Sasada) via ruby-core
2024-08-13 20:51 ` [ruby-core:118843] " jhawthorn (John Hawthorn) via ruby-core
@ 2024-09-02 9:34 ` k0kubun (Takashi Kokubun) via ruby-core
2 siblings, 0 replies; 4+ messages in thread
From: k0kubun (Takashi Kokubun) via ruby-core @ 2024-09-02 9:34 UTC (permalink / raw)
To: ruby-core; +Cc: k0kubun (Takashi Kokubun)
Issue #20670 has been updated by k0kubun (Takashi Kokubun).
Backport changed from 3.1: DONTNEED, 3.2: DONTNEED, 3.3: REQUIRED to 3.1: DONTNEED, 3.2: DONTNEED, 3.3: DONE
ruby_3_3 commit:66312ad913d67bfd3c2c83b174eabf537f5def84.
----------------------------------------
Bug #20670: fork deadlocks in child process due to timer thread
https://bugs.ruby-lang.org/issues/20670#change-109576
* Author: jhawthorn (John Hawthorn)
* Status: Closed
* ruby -v: ruby 3.3.4 (2024-07-09 revision be1089c8ec) [x86_64-linux]
* Backport: 3.1: DONTNEED, 3.2: DONTNEED, 3.3: DONE
----------------------------------------
We've been seeing an occasional failure in the Rails CI related to a test which forks and I managed to reduce it to the following reproduction.
``` ruby
Thread.new do
loop { sleep 0.0001 }
end
1000.times do
pid = fork{}
Process.waitpid(pid)
rescue Exception
Process.kill(:KILL, pid)
raise
end
```
This hangs on Ruby 3.3 and HEAD (_fairly_ reliably), but completes always on Ruby 3.2
In a debugger it seems like the timer thread acquires `vm->ractor.sched.lock` in the parent process just as the process is forking. The child process then ends up stuck inside of `thread_sched_atfork` when trying to acquire the same lock.
I've opened https://github.com/ruby/ruby/pull/11356 with a fix
--
https://bugs.ruby-lang.org/
______________________________________________
ruby-core mailing list -- ruby-core@ml.ruby-lang.org
To unsubscribe send an email to ruby-core-leave@ml.ruby-lang.org
ruby-core info -- https://ml.ruby-lang.org/mailman3/lists/ruby-core.ml.ruby-lang.org/
^ permalink raw reply [flat|nested] 4+ messages in thread
end of thread, other threads:[~2024-09-02 9:35 UTC | newest]
Thread overview: 4+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2024-08-09 20:06 [ruby-core:118823] [Ruby master Bug#20670] fork deadlocks in child process due to timer thread jhawthorn (John Hawthorn) via ruby-core
2024-08-10 1:17 ` [ruby-core:118824] " ko1 (Koichi Sasada) via ruby-core
2024-08-13 20:51 ` [ruby-core:118843] " jhawthorn (John Hawthorn) via ruby-core
2024-09-02 9:34 ` [ruby-core:119001] " k0kubun (Takashi Kokubun) via ruby-core
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).