ruby-core@ruby-lang.org archive (unofficial mirror)
 help / color / mirror / Atom feed
* [ruby-core:120817] [Ruby master Bug#21096] Ruby hangs up when compiling for bytecode on AArch64 emulated by QEMU
@ 2025-01-29  7:28 midnight (Sarun R) via ruby-core
  2025-01-29 11:40 ` [ruby-core:120825] " byroot (Jean Boussier) via ruby-core
  2025-01-29 14:14 ` [ruby-core:120828] " midnight (Sarun R) via ruby-core
  0 siblings, 2 replies; 3+ messages in thread
From: midnight (Sarun R) via ruby-core @ 2025-01-29  7:28 UTC (permalink / raw)
  To: ruby-core; +Cc: midnight (Sarun R)

Issue #21096 has been reported by midnight (Sarun R).

----------------------------------------
Bug #21096: Ruby hangs up when compiling for bytecode on AArch64 emulated by QEMU
https://bugs.ruby-lang.org/issues/21096

* Author: midnight (Sarun R)
* Status: Open
* ruby -v: ruby 3.4.1 (2024-12-25 revision 48d4efcb85) +PRISM [x86_64-linux]
* Backport: 3.1: UNKNOWN, 3.2: UNKNOWN, 3.3: UNKNOWN, 3.4: UNKNOWN
----------------------------------------
Hello,

We are experiencing issues when using [Bootsnap](https://github.com/Shopify/bootsnap) for production container image building, specifically when running `bundle exec bootsnap precompile --gemfile` on an emulated ARM64 environment on AMD64 hosts.

Here are more details:
* Bootsnap is a Ruby gem for bytecode caching, which speeds up loading times. It achieves this by calling `RubyVM::InstructionSequence.compile_file` and `RubyVM::InstructionSequence.load_from_binary`.
* When running `bundle exec bootsnap precompile --gemfile` in the environment described (using QEMU to emulate the AArch64 instruction set), the process can compile and generate some bytecode but eventually hangs.
* The hang seems random, occurring at different points during the process.
* According to [a Rails GitHub issue](https://github.com/rails/rails/issues/54039), the issue affects both `Docker` and `containerd`, as well as native Linux and macOS environments.
* From [a Bootsnap GitHub issue](https://github.com/Shopify/bootsnap/issues/495), the problem likely doesn't occur in Ruby `3.2.6` but appears in later versions.
* So far, the common factors observed are:
  * Emulated ARM64 on AMD64 CPUs (likely using QEMU)
  * Newer Ruby versions (e.g., 3.3 and 3.4)

As a user, I don't have the expertise to debug the issue but am willing to gather more information if provided with sufficient instructions.



-- 
https://bugs.ruby-lang.org/
 ______________________________________________
 ruby-core mailing list -- ruby-core@ml.ruby-lang.org
 To unsubscribe send an email to ruby-core-leave@ml.ruby-lang.org
 ruby-core info -- https://ml.ruby-lang.org/mailman3/lists/ruby-core.ml.ruby-lang.org/

^ permalink raw reply	[flat|nested] 3+ messages in thread

* [ruby-core:120825] [Ruby master Bug#21096] Ruby hangs up when compiling for bytecode on AArch64 emulated by QEMU
  2025-01-29  7:28 [ruby-core:120817] [Ruby master Bug#21096] Ruby hangs up when compiling for bytecode on AArch64 emulated by QEMU midnight (Sarun R) via ruby-core
@ 2025-01-29 11:40 ` byroot (Jean Boussier) via ruby-core
  2025-01-29 14:14 ` [ruby-core:120828] " midnight (Sarun R) via ruby-core
  1 sibling, 0 replies; 3+ messages in thread
From: byroot (Jean Boussier) via ruby-core @ 2025-01-29 11:40 UTC (permalink / raw)
  To: ruby-core; +Cc: byroot (Jean Boussier)

Issue #21096 has been updated by byroot (Jean Boussier).


As mentioned on the Rails issue, this is unlikely to be debugged unless a reproducer is provided, which does include a Ruby script or application that cause the hang when compiled, and the precise host and container versions.


----------------------------------------
Bug #21096: Ruby hangs up when compiling for bytecode on AArch64 emulated by QEMU
https://bugs.ruby-lang.org/issues/21096#change-111692

* Author: midnight (Sarun R)
* Status: Open
* ruby -v: ruby 3.4.1 (2024-12-25 revision 48d4efcb85) +PRISM [x86_64-linux]
* Backport: 3.1: UNKNOWN, 3.2: UNKNOWN, 3.3: UNKNOWN, 3.4: UNKNOWN
----------------------------------------
Hello,

We are experiencing issues when using [Bootsnap](https://github.com/Shopify/bootsnap) for production container image building, specifically when running `bundle exec bootsnap precompile --gemfile` on an emulated ARM64 environment on AMD64 hosts.

Here are more details:
* Bootsnap is a Ruby gem for bytecode caching, which speeds up loading times. It achieves this by calling `RubyVM::InstructionSequence.compile_file` and `RubyVM::InstructionSequence.load_from_binary`.
* When running `bundle exec bootsnap precompile --gemfile` in the environment described (using QEMU to emulate the AArch64 instruction set), the process can compile and generate some bytecode but eventually hangs.
* The hang seems random, occurring at different points during the process.
* According to [a Rails GitHub issue](https://github.com/rails/rails/issues/54039), the issue affects both `Docker` and `containerd`, as well as native Linux and macOS environments.
* From [a Bootsnap GitHub issue](https://github.com/Shopify/bootsnap/issues/495), the problem likely doesn't occur in Ruby `3.2.6` but appears in later versions.
* So far, the common factors observed are:
  * Emulated ARM64 on AMD64 CPUs (likely using QEMU)
  * Newer Ruby versions (e.g., 3.3 and 3.4)

As a user, I don't have the expertise to debug the issue but am willing to gather more information if provided with sufficient instructions.



-- 
https://bugs.ruby-lang.org/
 ______________________________________________
 ruby-core mailing list -- ruby-core@ml.ruby-lang.org
 To unsubscribe send an email to ruby-core-leave@ml.ruby-lang.org
 ruby-core info -- https://ml.ruby-lang.org/mailman3/lists/ruby-core.ml.ruby-lang.org/

^ permalink raw reply	[flat|nested] 3+ messages in thread

* [ruby-core:120828] [Ruby master Bug#21096] Ruby hangs up when compiling for bytecode on AArch64 emulated by QEMU
  2025-01-29  7:28 [ruby-core:120817] [Ruby master Bug#21096] Ruby hangs up when compiling for bytecode on AArch64 emulated by QEMU midnight (Sarun R) via ruby-core
  2025-01-29 11:40 ` [ruby-core:120825] " byroot (Jean Boussier) via ruby-core
@ 2025-01-29 14:14 ` midnight (Sarun R) via ruby-core
  1 sibling, 0 replies; 3+ messages in thread
From: midnight (Sarun R) via ruby-core @ 2025-01-29 14:14 UTC (permalink / raw)
  To: ruby-core; +Cc: midnight (Sarun R)

Issue #21096 has been updated by midnight (Sarun R).


You are one of the most responsive people I have ever encountered.

To test the reproduction, iiewad provided a branch of his application where this issue occurs.
(It’s essentially a standard Rails application with something like `--verbose` added to the `Dockerfile` for visualization.)

~~~bash
git clone -b debug https://github.com/iiewad/blog.git iiewad-blog
cd iiewad-blog
~~~

In my environment, I use the following command:
~~~bash
sudo nerdctl build --platform=arm64 .
~~~

(containerd has both rootless and rootful modes; multi-architecture building requires the rootful one.)

I’ve already confirmed that the code from the repository reproduces the issue in my environment.
![Screenshot](https://i.imgur.com/uisLCi4.png)
Since he included `--verbose` in the `Dockerfile`, the screenshot shows where bootsnap is hanging.

Software versions:
iiewad-blog: commit-c8f6d15
nerdctl:
> Client:
>  Version:	2.0.2
>  OS/Arch:	linux/amd64
>  Git commit:	unknown
>  buildctl:
>   Version:	0.18.2
> 
> Server:
>  containerd:
>   Version:	v1.7.23
>   GitCommit:	57f17b0a6295a39009d861b89e3b3b87b005ca27
>  runc:
>   Version:	1.2.4
>   GitCommit:	v1.2.4-0-g6c52b3fc541f

QEMU
~~~bash
sudo systemctl start containerd
sudo nerdctl run --privileged --rm tonistiigi/binfmt:qemu-v8.1.5 --install arm64
~~~

Feel free to ask if you run into any issues with the reproduction steps or need more details about the environment I’m using.

----------------------------------------
Bug #21096: Ruby hangs up when compiling for bytecode on AArch64 emulated by QEMU
https://bugs.ruby-lang.org/issues/21096#change-111695

* Author: midnight (Sarun R)
* Status: Open
* ruby -v: ruby 3.4.1 (2024-12-25 revision 48d4efcb85) +PRISM [x86_64-linux]
* Backport: 3.1: UNKNOWN, 3.2: UNKNOWN, 3.3: UNKNOWN, 3.4: UNKNOWN
----------------------------------------
Hello,

We are experiencing issues when using [Bootsnap](https://github.com/Shopify/bootsnap) for production container image building, specifically when running `bundle exec bootsnap precompile --gemfile` on an emulated ARM64 environment on AMD64 hosts.

Here are more details:
* Bootsnap is a Ruby gem for bytecode caching, which speeds up loading times. It achieves this by calling `RubyVM::InstructionSequence.compile_file` and `RubyVM::InstructionSequence.load_from_binary`.
* When running `bundle exec bootsnap precompile --gemfile` in the environment described (using QEMU to emulate the AArch64 instruction set), the process can compile and generate some bytecode but eventually hangs.
* The hang seems random, occurring at different points during the process.
* According to [a Rails GitHub issue](https://github.com/rails/rails/issues/54039), the issue affects both `Docker` and `containerd`, as well as native Linux and macOS environments.
* From [a Bootsnap GitHub issue](https://github.com/Shopify/bootsnap/issues/495), the problem likely doesn't occur in Ruby `3.2.6` but appears in later versions.
* So far, the common factors observed are:
  * Emulated ARM64 on AMD64 CPUs (likely using QEMU)
  * Newer Ruby versions (e.g., 3.3 and 3.4)

As a user, I don't have the expertise to debug the issue but am willing to gather more information if provided with sufficient instructions.



-- 
https://bugs.ruby-lang.org/
 ______________________________________________
 ruby-core mailing list -- ruby-core@ml.ruby-lang.org
 To unsubscribe send an email to ruby-core-leave@ml.ruby-lang.org
 ruby-core info -- https://ml.ruby-lang.org/mailman3/lists/ruby-core.ml.ruby-lang.org/

^ permalink raw reply	[flat|nested] 3+ messages in thread

end of thread, other threads:[~2025-01-29 14:14 UTC | newest]

Thread overview: 3+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2025-01-29  7:28 [ruby-core:120817] [Ruby master Bug#21096] Ruby hangs up when compiling for bytecode on AArch64 emulated by QEMU midnight (Sarun R) via ruby-core
2025-01-29 11:40 ` [ruby-core:120825] " byroot (Jean Boussier) via ruby-core
2025-01-29 14:14 ` [ruby-core:120828] " midnight (Sarun R) via ruby-core

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).