* Illegal instruction in __copy_tls()
@ 2019-06-05 18:16 tenspd137 .
2019-06-05 18:37 ` Rich Felker
0 siblings, 1 reply; 13+ messages in thread
From: tenspd137 . @ 2019-06-05 18:16 UTC (permalink / raw)
To: musl
Hi all
I am using musl 1.1.22 with in a cross toolchain to create static
binaries on my machine. I am running gentoo linux and used their
crossdev tool to create the cross compiler (x86_64-pc-linux-musl). I
created a small hello world app:
#include <stdio.h>
int main(int argc, char **argv)
{printf("Hello MUSL\n");}
and compiled with:
x86_64-pc-linux-musl-gcc -v -static -Os -g hello.c
Built and runs fine on local machine, but when I put the binary on
another machine, it dumped the core with an ilegal instruction. gdb
claims illegal instruction in __copy_tls().
I have been able to compile this program after building the musl-gcc
wrapper and it works on both machines, but I need the cross toolchain
for C++ support. The -v in the commandline above prints messages that
indicate it is using musl from what I can tell.
Can anyone point me in the right direction or help me figure out what
I am missing?
Thanks!
^ permalink raw reply [flat|nested] 13+ messages in thread
* Re: Illegal instruction in __copy_tls()
2019-06-05 18:16 Illegal instruction in __copy_tls() tenspd137 .
@ 2019-06-05 18:37 ` Rich Felker
2019-06-05 19:53 ` tenspd137 .
0 siblings, 1 reply; 13+ messages in thread
From: Rich Felker @ 2019-06-05 18:37 UTC (permalink / raw)
To: tenspd137 .; +Cc: musl
On Wed, Jun 05, 2019 at 12:16:39PM -0600, tenspd137 . wrote:
> Hi all
>
> I am using musl 1.1.22 with in a cross toolchain to create static
> binaries on my machine. I am running gentoo linux and used their
> crossdev tool to create the cross compiler (x86_64-pc-linux-musl). I
> created a small hello world app:
>
> #include <stdio.h>
> int main(int argc, char **argv)
> {printf("Hello MUSL\n");}
>
> and compiled with:
>
> x86_64-pc-linux-musl-gcc -v -static -Os -g hello.c
>
> Built and runs fine on local machine, but when I put the binary on
> another machine, it dumped the core with an ilegal instruction. gdb
> claims illegal instruction in __copy_tls().
>
> I have been able to compile this program after building the musl-gcc
> wrapper and it works on both machines, but I need the cross toolchain
> for C++ support. The -v in the commandline above prints messages that
> indicate it is using musl from what I can tell.
>
> Can anyone point me in the right direction or help me figure out what
> I am missing?
Can you show the gdb backtrace, disassembly at the point of crash, and
an strace leading up to it?
My best guess is that your toolchain is producing binaries for some
non-baseline level of x86_64 ISA, and the machine you're trying to run
it on does not support some of the instructions used.
Rich
^ permalink raw reply [flat|nested] 13+ messages in thread
* Re: Illegal instruction in __copy_tls()
2019-06-05 18:37 ` Rich Felker
@ 2019-06-05 19:53 ` tenspd137 .
2019-06-05 20:07 ` Rich Felker
0 siblings, 1 reply; 13+ messages in thread
From: tenspd137 . @ 2019-06-05 19:53 UTC (permalink / raw)
To: Rich Felker; +Cc: musl
Sure -
strace -d -v ./a.out:
strace: ptrace_setoptions = 0x51
strace: new tcb for pid 26302, active tcbs:1
strace: [wait(0x80137f) = 26302] WIFSTOPPED,sig=SIGSTOP,EVENT_STOP (128)
strace: pid 26302 has TCB_STARTUP, initializing it
strace: [wait(0x80057f) = 26302] WIFSTOPPED,sig=SIGTRAP,EVENT_STOP (128)
strace: [wait(0x00127f) = 26302] WIFSTOPPED,sig=SIGCONT
strace: [wait(0x00857f) = 26302] WIFSTOPPED,sig=133
execve("./a.out", ["./a.out"], ["SSH_CONNECTION=15.86.136.27 5196"...,
"LANG=en_US.UTF-8", "XDG_SESSION_ID=41", "USER=dayd",
"PWD=/home/dayd/projects/musl-tes"..., "HOME=/home/dayd",
"SSH_CLIENT=xx.xxx.xxx.xx 51960 22", "CCACHE_DIR=/ssd/dayd/.ccache",
"VMWARE_USE_SHIPPED_GTK=yes", "XDG_DATA_DIRS=/usr/local/share:/"...,
"USECCACHE=ON", "SSH_TTY=/dev/pts/2", "MAIL=/var/mail/dayd",
"TERM=rxvt-unicode-256color", "SHELL=/bin/bash", "SHLVL=1",
"PYTHONPATH=:/home/dayd/projects/"..., "LOGNAME=dayd",
"DBUS_SESSION_BUS_ADDRESS=unix:pa"...,
"XDG_RUNTIME_DIR=/run/user/6686",
"PATH=/usr/lib/ccache/bin/:/usr/l"..., "USEDISTCC=OFF",
"_=/usr/bin/strace", "OLDPWD=/home/dayd/projects"]strace:
[wait(0x04057f) = 26302] WIFSTOPPED,sig=SIGTRAP,EVENT_EXEC (4)
strace: [wait(0x00857f) = 26302] WIFSTOPPED,sig=133
) = 0
strace: [wait(0x00047f) = 26302] WIFSTOPPED,sig=SIGILL
--- SIGILL {si_signo=SIGILL, si_code=ILL_ILLOPN, si_addr=0x40169e} ---
strace: [wait(0x06057f) = 26302] WIFSTOPPED,sig=SIGTRAP,EVENT_EXIT (6)
strace: [wait(0x000084) = 26302] WIFSIGNALED,core,sig=SIGILL
+++ killed by SIGILL (core dumped) +++
strace: dropped tcb for pid 26302, 0 remain
Illegal instruction (core dumped)
******************************************************************************************
(gdb) bt
#0 0x00000000004016ae in __copy_tls ()
#1 0x0000000000000000 in ?? ()
*****************************************************************************************
(gdb) disassemble
Dump of assembler code for function __copy_tls:
0x0000000000401680 <+0>: push %r13
0x0000000000401682 <+2>: mov %rdi,%r13
0x0000000000401685 <+5>: push %r12
0x0000000000401687 <+7>: push %rbp
0x0000000000401688 <+8>: push %rbx
0x0000000000401689 <+9>: sub $0x8,%rsp
0x000000000040168d <+13>: mov 0x410c(%rip),%rax #
0x4057a0 <__libc+32>
0x0000000000401694 <+20>: mov 0x410d(%rip),%rcx #
0x4057a8 <__libc+40>
0x000000000040169b <+27>: mov 0x40f6(%rip),%rbx #
0x405798 <__libc+24>
0x00000000004016a2 <+34>: lea -0xe0(%rdi,%rax,1),%rax
0x00000000004016aa <+42>: lea -0x1(%rcx),%r12
=> 0x00000000004016ae <+46>: andn %rax,%r12,%r12
0x00000000004016b3 <+51>: test %rbx,%rbx
0x00000000004016b6 <+54>: je 0x4016eb <__copy_tls+107>
0x00000000004016b8 <+56>: lea 0x8(%rdi),%rbp
0x00000000004016bc <+60>: nopl 0x0(%rax)
0x00000000004016c0 <+64>: mov %r12,%rax
0x00000000004016c3 <+67>: sub 0x28(%rbx),%rax
0x00000000004016c7 <+71>: mov %rax,0x0(%rbp)
0x00000000004016cb <+75>: mov 0x8(%rbx),%rsi
0x00000000004016cf <+79>: mov %r12,%rdi
0x00000000004016d2 <+82>: mov 0x10(%rbx),%rdx
0x00000000004016d6 <+86>: sub 0x28(%rbx),%rdi
0x00000000004016da <+90>: callq 0x401e3c <memcpy>
0x00000000004016df <+95>: mov (%rbx),%rbx
0x00000000004016e2 <+98>: add $0x8,%rbp
0x00000000004016e6 <+102>: test %rbx,%rbx
0x00000000004016e9 <+105>: jne 0x4016c0 <__copy_tls+64>
0x00000000004016eb <+107>: mov 0x40be(%rip),%rax #
0x4057b0 <__libc+48>
0x00000000004016f2 <+114>: mov %rax,0x0(%r13)
0x00000000004016f6 <+118>: mov %r13,0xd8(%r12)
0x00000000004016fe <+126>: mov %r13,0x8(%r12)
0x0000000000401703 <+131>: add $0x8,%rsp
0x0000000000401707 <+135>: mov %r12,%rax
0x000000000040170a <+138>: pop %rbx
0x000000000040170b <+139>: pop %rbp
0x000000000040170c <+140>: pop %r12
0x000000000040170e <+142>: pop %r13
0x0000000000401710 <+144>: retq
End of assembler dump.
***********************************************************************************
as a bonus (I thought this might also help):
(%:~/projects/musl-test)┌- x86_64-pc-linux-musl-gcc -v -static -O0 -g
hello.c
Using built-in specs.
COLLECT_GCC=x86_64-pc-linux-musl-gcc
COLLECT_LTO_WRAPPER=/usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/lto-wrapper
Target: x86_64-pc-linux-musl
Configured with:
/var/tmp/portage/cross-x86_64-pc-linux-musl/gcc-9.1.0/work/gcc-9.1.0/configure
--host=x86_64-pc-linux-gnu --target=x86_64-pc-linux-musl
--build=x86_64-pc-linux-gnu --prefix=/usr
--bindir=/usr/x86_64-pc-linux-gnu/x86_64-pc-linux-musl/gcc-bin/9.1.0
--includedir=/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/include
--datadir=/usr/share/gcc-data/x86_64-pc-linux-musl/9.1.0
--mandir=/usr/share/gcc-data/x86_64-pc-linux-musl/9.1.0/man
--infodir=/usr/share/gcc-data/x86_64-pc-linux-musl/9.1.0/info
--with-gxx-include-dir=/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/include/g++-v9
--with-python-dir=/share/gcc-data/x86_64-pc-linux-musl/9.1.0/python
--enable-languages=c,c++,fortran --enable-obsolete --enable-secureplt
--disable-werror --with-system-zlib --enable-nls
--without-included-gettext --enable-checking=release
--with-bugurl=https://bugs.gentoo.org/ --with-pkgversion='Gentoo 9.1.0
p1.0' --disable-esp --enable-libstdcxx-time
--enable-poison-system-directories
--with-sysroot=/usr/x86_64-pc-linux-musl --disable-bootstrap
--enable-__cxa_atexit --disable-multilib --with-multilib-list=m64
--disable-altivec --disable-fixed-point --enable-targets=all
--enable-libgomp --disable-libmudflap --disable-libssp
--disable-systemtap --disable-vtable-verify --disable-libvtv
--enable-lto --without-isl --disable-libsanitizer --enable-default-pie
--enable-default-ssp
Thread model: posix
gcc version 9.1.0 (Gentoo 9.1.0 p1.0)
COLLECT_GCC_OPTIONS='-v' '-static' '-O0' '-g' '-mtune=generic' '-march=x86-64'
/usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/cc1 -quiet -v hello.c
-quiet -dumpbase hello.c -mtune=generic -march=x86-64 -auxbase hello
-g -O0 -version -o /tmp/ccoTkh38.s
GNU C17 (Gentoo 9.1.0 p1.0) version 9.1.0 (x86_64-pc-linux-musl)
compiled by GNU C version 8.3.0, GMP version 6.1.2, MPFR version
4.0.2, MPC version 1.1.0, isl version none
GGC heuristics: --param ggc-min-expand=100 --param ggc-min-heapsize=131072
ignoring nonexistent directory "/usr/x86_64-pc-linux-musl/usr/local/include"
ignoring nonexistent directory
"/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/../../../../x86_64-pc-linux-musl/include"
#include "..." search starts here:
#include <...> search starts here:
/usr/x86_64-pc-linux-musl/usr/include
/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/include
End of search list.
GNU C17 (Gentoo 9.1.0 p1.0) version 9.1.0 (x86_64-pc-linux-musl)
compiled by GNU C version 8.3.0, GMP version 6.1.2, MPFR version
4.0.2, MPC version 1.1.0, isl version none
GGC heuristics: --param ggc-min-expand=100 --param ggc-min-heapsize=131072
Compiler executable checksum: a3183e5f435d1938198d432af6db159b
COLLECT_GCC_OPTIONS='-v' '-static' '-O0' '-g' '-mtune=generic' '-march=x86-64'
/usr/libexec/gcc/x86_64-pc-linux-musl/as -v --64 -o /tmp/ccHq7CL6.o
/tmp/ccoTkh38.s
GNU assembler version 2.32.0 (x86_64-pc-linux-musl) using BFD version
(Gentoo 2.32 p2) 2.32.0
COMPILER_PATH=/usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/:/usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/:/usr/libexec/gcc/x86_64-pc-linux-musl/:/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/:/usr/lib/gcc/x86_64-pc-linux-musl/
LIBRARY_PATH=/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/:/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/../../../../x86_64-pc-linux-musl/lib/:/usr/x86_64-pc-linux-musl/lib/:/usr/x86_64-pc-linux-musl/usr/lib/
COLLECT_GCC_OPTIONS='-v' '-static' '-O0' '-g' '-mtune=generic' '-march=x86-64'
/usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/collect2 -plugin
/usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/liblto_plugin.so
-plugin-opt=/usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/lto-wrapper
-plugin-opt=-fresolution=/tmp/ccWcifv4.res
-plugin-opt=-pass-through=-lgcc -plugin-opt=-pass-through=-lgcc_eh
-plugin-opt=-pass-through=-lc --sysroot=/usr/x86_64-pc-linux-musl -m
elf_x86_64 -static /usr/x86_64-pc-linux-musl/usr/lib/crt1.o
/usr/x86_64-pc-linux-musl/usr/lib/crti.o
/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/crtbeginT.o
-L/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0
-L/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/../../../../x86_64-pc-linux-musl/lib
-L/usr/x86_64-pc-linux-musl/lib -L/usr/x86_64-pc-linux-musl/usr/lib
/tmp/ccHq7CL6.o --start-group -lgcc -lgcc_eh -lc --end-group
/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/crtend.o
/usr/x86_64-pc-linux-musl/usr/lib/crtn.o
COLLECT_GCC_OPTIONS='-v' '-static' '-O0' '-g' '-mtune=generic' '-march=x86-64'
mtune=generic and march=x86-64 suggests it isn't trying to do
something weird on the compile computer.
Also, if I messed up and am not giving you what you are asking for,
please let me know and I will grab it.
Thanks!
On Wed, Jun 5, 2019 at 12:37 PM Rich Felker <dalias@libc.org> wrote:
>
> On Wed, Jun 05, 2019 at 12:16:39PM -0600, tenspd137 . wrote:
> > Hi all
> >
> > I am using musl 1.1.22 with in a cross toolchain to create static
> > binaries on my machine. I am running gentoo linux and used their
> > crossdev tool to create the cross compiler (x86_64-pc-linux-musl). I
> > created a small hello world app:
> >
> > #include <stdio.h>
> > int main(int argc, char **argv)
> > {printf("Hello MUSL\n");}
> >
> > and compiled with:
> >
> > x86_64-pc-linux-musl-gcc -v -static -Os -g hello.c
> >
> > Built and runs fine on local machine, but when I put the binary on
> > another machine, it dumped the core with an ilegal instruction. gdb
> > claims illegal instruction in __copy_tls().
> >
> > I have been able to compile this program after building the musl-gcc
> > wrapper and it works on both machines, but I need the cross toolchain
> > for C++ support. The -v in the commandline above prints messages that
> > indicate it is using musl from what I can tell.
> >
> > Can anyone point me in the right direction or help me figure out what
> > I am missing?
>
> Can you show the gdb backtrace, disassembly at the point of crash, and
> an strace leading up to it?
>
> My best guess is that your toolchain is producing binaries for some
> non-baseline level of x86_64 ISA, and the machine you're trying to run
> it on does not support some of the instructions used.
>
> Rich
^ permalink raw reply [flat|nested] 13+ messages in thread
* Re: Illegal instruction in __copy_tls()
2019-06-05 19:53 ` tenspd137 .
@ 2019-06-05 20:07 ` Rich Felker
2019-06-05 21:27 ` tenspd137 .
0 siblings, 1 reply; 13+ messages in thread
From: Rich Felker @ 2019-06-05 20:07 UTC (permalink / raw)
To: tenspd137 .; +Cc: musl
On Wed, Jun 05, 2019 at 01:53:58PM -0600, tenspd137 . wrote:
> Sure -
>
> strace -d -v ./a.out:
> strace: ptrace_setoptions = 0x51
> strace: new tcb for pid 26302, active tcbs:1
> strace: [wait(0x80137f) = 26302] WIFSTOPPED,sig=SIGSTOP,EVENT_STOP (128)
> strace: pid 26302 has TCB_STARTUP, initializing it
> strace: [wait(0x80057f) = 26302] WIFSTOPPED,sig=SIGTRAP,EVENT_STOP (128)
> strace: [wait(0x00127f) = 26302] WIFSTOPPED,sig=SIGCONT
> strace: [wait(0x00857f) = 26302] WIFSTOPPED,sig=133
> execve("./a.out", ["./a.out"], ["SSH_CONNECTION=15.86.136.27 5196"...,
> "LANG=en_US.UTF-8", "XDG_SESSION_ID=41", "USER=dayd",
> "PWD=/home/dayd/projects/musl-tes"..., "HOME=/home/dayd",
> "SSH_CLIENT=xx.xxx.xxx.xx 51960 22", "CCACHE_DIR=/ssd/dayd/.ccache",
> "VMWARE_USE_SHIPPED_GTK=yes", "XDG_DATA_DIRS=/usr/local/share:/"...,
> "USECCACHE=ON", "SSH_TTY=/dev/pts/2", "MAIL=/var/mail/dayd",
> "TERM=rxvt-unicode-256color", "SHELL=/bin/bash", "SHLVL=1",
> "PYTHONPATH=:/home/dayd/projects/"..., "LOGNAME=dayd",
> "DBUS_SESSION_BUS_ADDRESS=unix:pa"...,
> "XDG_RUNTIME_DIR=/run/user/6686",
> "PATH=/usr/lib/ccache/bin/:/usr/l"..., "USEDISTCC=OFF",
> "_=/usr/bin/strace", "OLDPWD=/home/dayd/projects"]strace:
> [wait(0x04057f) = 26302] WIFSTOPPED,sig=SIGTRAP,EVENT_EXEC (4)
> strace: [wait(0x00857f) = 26302] WIFSTOPPED,sig=133
> ) = 0
> strace: [wait(0x00047f) = 26302] WIFSTOPPED,sig=SIGILL
> --- SIGILL {si_signo=SIGILL, si_code=ILL_ILLOPN, si_addr=0x40169e} ---
> strace: [wait(0x06057f) = 26302] WIFSTOPPED,sig=SIGTRAP,EVENT_EXIT (6)
> strace: [wait(0x000084) = 26302] WIFSIGNALED,core,sig=SIGILL
> +++ killed by SIGILL (core dumped) +++
> strace: dropped tcb for pid 26302, 0 remain
> Illegal instruction (core dumped)
> ******************************************************************************************
> (gdb) bt
> #0 0x00000000004016ae in __copy_tls ()
> #1 0x0000000000000000 in ?? ()
> *****************************************************************************************
>
> (gdb) disassemble
> Dump of assembler code for function __copy_tls:
> 0x0000000000401680 <+0>: push %r13
> 0x0000000000401682 <+2>: mov %rdi,%r13
> 0x0000000000401685 <+5>: push %r12
> 0x0000000000401687 <+7>: push %rbp
> 0x0000000000401688 <+8>: push %rbx
> 0x0000000000401689 <+9>: sub $0x8,%rsp
> 0x000000000040168d <+13>: mov 0x410c(%rip),%rax #
> 0x4057a0 <__libc+32>
> 0x0000000000401694 <+20>: mov 0x410d(%rip),%rcx #
> 0x4057a8 <__libc+40>
> 0x000000000040169b <+27>: mov 0x40f6(%rip),%rbx #
> 0x405798 <__libc+24>
> 0x00000000004016a2 <+34>: lea -0xe0(%rdi,%rax,1),%rax
> 0x00000000004016aa <+42>: lea -0x1(%rcx),%r12
> => 0x00000000004016ae <+46>: andn %rax,%r12,%r12
This instruction, andn, is not in the base x86_64 ISA. It's part of
the BMI1 extension:
https://en.wikipedia.org/wiki/Bit_Manipulation_Instruction_Sets#BMI1_(Bit_Manipulation_Instruction_Set_1)
Apparently Gentoo is providing cross compilers that default to
producing "native ISA level" code for the host, rather than baseline
ISA for the target. But:
> as a bonus (I thought this might also help):
> (%:~/projects/musl-test)┌- x86_64-pc-linux-musl-gcc -v -static -O0 -g
> hello.c
> Using built-in specs.
> COLLECT_GCC=x86_64-pc-linux-musl-gcc
> COLLECT_LTO_WRAPPER=/usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/lto-wrapper
> Target: x86_64-pc-linux-musl
> Configured with:
> /var/tmp/portage/cross-x86_64-pc-linux-musl/gcc-9.1.0/work/gcc-9.1.0/configure
> --host=x86_64-pc-linux-gnu --target=x86_64-pc-linux-musl
> --build=x86_64-pc-linux-gnu --prefix=/usr
> --bindir=/usr/x86_64-pc-linux-gnu/x86_64-pc-linux-musl/gcc-bin/9.1.0
> --includedir=/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/include
> --datadir=/usr/share/gcc-data/x86_64-pc-linux-musl/9.1.0
> --mandir=/usr/share/gcc-data/x86_64-pc-linux-musl/9.1.0/man
> --infodir=/usr/share/gcc-data/x86_64-pc-linux-musl/9.1.0/info
> --with-gxx-include-dir=/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/include/g++-v9
> --with-python-dir=/share/gcc-data/x86_64-pc-linux-musl/9.1.0/python
> --enable-languages=c,c++,fortran --enable-obsolete --enable-secureplt
> --disable-werror --with-system-zlib --enable-nls
> --without-included-gettext --enable-checking=release
> --with-bugurl=https://bugs.gentoo.org/ --with-pkgversion='Gentoo 9.1.0
> p1.0' --disable-esp --enable-libstdcxx-time
> --enable-poison-system-directories
> --with-sysroot=/usr/x86_64-pc-linux-musl --disable-bootstrap
> --enable-__cxa_atexit --disable-multilib --with-multilib-list=m64
> --disable-altivec --disable-fixed-point --enable-targets=all
> --enable-libgomp --disable-libmudflap --disable-libssp
> --disable-systemtap --disable-vtable-verify --disable-libvtv
> --enable-lto --without-isl --disable-libsanitizer --enable-default-pie
> --enable-default-ssp
> Thread model: posix
> gcc version 9.1.0 (Gentoo 9.1.0 p1.0)
> COLLECT_GCC_OPTIONS='-v' '-static' '-O0' '-g' '-mtune=generic' '-march=x86-64'
> /usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/cc1 -quiet -v hello.c
> -quiet -dumpbase hello.c -mtune=generic -march=x86-64 -auxbase hello
> -g -O0 -version -o /tmp/ccoTkh38.s
> GNU C17 (Gentoo 9.1.0 p1.0) version 9.1.0 (x86_64-pc-linux-musl)
> compiled by GNU C version 8.3.0, GMP version 6.1.2, MPFR version
> 4.0.2, MPC version 1.1.0, isl version none
> GGC heuristics: --param ggc-min-expand=100 --param ggc-min-heapsize=131072
> ignoring nonexistent directory "/usr/x86_64-pc-linux-musl/usr/local/include"
> ignoring nonexistent directory
> "/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/../../../../x86_64-pc-linux-musl/include"
> #include "..." search starts here:
> #include <...> search starts here:
> /usr/x86_64-pc-linux-musl/usr/include
> /usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/include
> End of search list.
> GNU C17 (Gentoo 9.1.0 p1.0) version 9.1.0 (x86_64-pc-linux-musl)
> compiled by GNU C version 8.3.0, GMP version 6.1.2, MPFR version
> 4.0.2, MPC version 1.1.0, isl version none
> GGC heuristics: --param ggc-min-expand=100 --param ggc-min-heapsize=131072
> Compiler executable checksum: a3183e5f435d1938198d432af6db159b
> COLLECT_GCC_OPTIONS='-v' '-static' '-O0' '-g' '-mtune=generic' '-march=x86-64'
> /usr/libexec/gcc/x86_64-pc-linux-musl/as -v --64 -o /tmp/ccHq7CL6.o
> /tmp/ccoTkh38.s
> GNU assembler version 2.32.0 (x86_64-pc-linux-musl) using BFD version
> (Gentoo 2.32 p2) 2.32.0
> COMPILER_PATH=/usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/:/usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/:/usr/libexec/gcc/x86_64-pc-linux-musl/:/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/:/usr/lib/gcc/x86_64-pc-linux-musl/
> LIBRARY_PATH=/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/:/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/../../../../x86_64-pc-linux-musl/lib/:/usr/x86_64-pc-linux-musl/lib/:/usr/x86_64-pc-linux-musl/usr/lib/
> COLLECT_GCC_OPTIONS='-v' '-static' '-O0' '-g' '-mtune=generic' '-march=x86-64'
> /usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/collect2 -plugin
> /usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/liblto_plugin.so
> -plugin-opt=/usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/lto-wrapper
> -plugin-opt=-fresolution=/tmp/ccWcifv4.res
> -plugin-opt=-pass-through=-lgcc -plugin-opt=-pass-through=-lgcc_eh
> -plugin-opt=-pass-through=-lc --sysroot=/usr/x86_64-pc-linux-musl -m
> elf_x86_64 -static /usr/x86_64-pc-linux-musl/usr/lib/crt1.o
> /usr/x86_64-pc-linux-musl/usr/lib/crti.o
> /usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/crtbeginT.o
> -L/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0
> -L/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/../../../../x86_64-pc-linux-musl/lib
> -L/usr/x86_64-pc-linux-musl/lib -L/usr/x86_64-pc-linux-musl/usr/lib
> /tmp/ccHq7CL6.o --start-group -lgcc -lgcc_eh -lc --end-group
> /usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/crtend.o
> /usr/x86_64-pc-linux-musl/usr/lib/crtn.o
> COLLECT_GCC_OPTIONS='-v' '-static' '-O0' '-g' '-mtune=generic' '-march=x86-64'
>
> mtune=generic and march=x86-64 suggests it isn't trying to do
> something weird on the compile computer.
Indeed, it looks like the default is right. So you probably need to
check how musl was built. Is it also a package provided by Gentoo, and
did they perhaps use -march=native even though it's being cross
compiled?
Rich
^ permalink raw reply [flat|nested] 13+ messages in thread
* Re: Illegal instruction in __copy_tls()
2019-06-05 20:07 ` Rich Felker
@ 2019-06-05 21:27 ` tenspd137 .
2019-06-05 21:56 ` Michael Everitt
0 siblings, 1 reply; 13+ messages in thread
From: tenspd137 . @ 2019-06-05 21:27 UTC (permalink / raw)
To: Rich Felker; +Cc: musl
Thanks! That was indeed the problem. I had march=native for all
portage related stuff set, and my guess is that crossdev read that to
start. I removed that, reran the crossdev tool to buiild the cross
toolchain, and can now build static binaries that run on different
systems.
Much appreciated!
-C
On Wed, Jun 5, 2019 at 2:07 PM Rich Felker <dalias@libc.org> wrote:
>
> On Wed, Jun 05, 2019 at 01:53:58PM -0600, tenspd137 . wrote:
> > Sure -
> >
> > strace -d -v ./a.out:
> > strace: ptrace_setoptions = 0x51
> > strace: new tcb for pid 26302, active tcbs:1
> > strace: [wait(0x80137f) = 26302] WIFSTOPPED,sig=SIGSTOP,EVENT_STOP (128)
> > strace: pid 26302 has TCB_STARTUP, initializing it
> > strace: [wait(0x80057f) = 26302] WIFSTOPPED,sig=SIGTRAP,EVENT_STOP (128)
> > strace: [wait(0x00127f) = 26302] WIFSTOPPED,sig=SIGCONT
> > strace: [wait(0x00857f) = 26302] WIFSTOPPED,sig=133
> > execve("./a.out", ["./a.out"], ["SSH_CONNECTION=15.86.136.27 5196"...,
> > "LANG=en_US.UTF-8", "XDG_SESSION_ID=41", "USER=dayd",
> > "PWD=/home/dayd/projects/musl-tes"..., "HOME=/home/dayd",
> > "SSH_CLIENT=xx.xxx.xxx.xx 51960 22", "CCACHE_DIR=/ssd/dayd/.ccache",
> > "VMWARE_USE_SHIPPED_GTK=yes", "XDG_DATA_DIRS=/usr/local/share:/"...,
> > "USECCACHE=ON", "SSH_TTY=/dev/pts/2", "MAIL=/var/mail/dayd",
> > "TERM=rxvt-unicode-256color", "SHELL=/bin/bash", "SHLVL=1",
> > "PYTHONPATH=:/home/dayd/projects/"..., "LOGNAME=dayd",
> > "DBUS_SESSION_BUS_ADDRESS=unix:pa"...,
> > "XDG_RUNTIME_DIR=/run/user/6686",
> > "PATH=/usr/lib/ccache/bin/:/usr/l"..., "USEDISTCC=OFF",
> > "_=/usr/bin/strace", "OLDPWD=/home/dayd/projects"]strace:
> > [wait(0x04057f) = 26302] WIFSTOPPED,sig=SIGTRAP,EVENT_EXEC (4)
> > strace: [wait(0x00857f) = 26302] WIFSTOPPED,sig=133
> > ) = 0
> > strace: [wait(0x00047f) = 26302] WIFSTOPPED,sig=SIGILL
> > --- SIGILL {si_signo=SIGILL, si_code=ILL_ILLOPN, si_addr=0x40169e} ---
> > strace: [wait(0x06057f) = 26302] WIFSTOPPED,sig=SIGTRAP,EVENT_EXIT (6)
> > strace: [wait(0x000084) = 26302] WIFSIGNALED,core,sig=SIGILL
> > +++ killed by SIGILL (core dumped) +++
> > strace: dropped tcb for pid 26302, 0 remain
> > Illegal instruction (core dumped)
> > ******************************************************************************************
> > (gdb) bt
> > #0 0x00000000004016ae in __copy_tls ()
> > #1 0x0000000000000000 in ?? ()
> > *****************************************************************************************
> >
> > (gdb) disassemble
> > Dump of assembler code for function __copy_tls:
> > 0x0000000000401680 <+0>: push %r13
> > 0x0000000000401682 <+2>: mov %rdi,%r13
> > 0x0000000000401685 <+5>: push %r12
> > 0x0000000000401687 <+7>: push %rbp
> > 0x0000000000401688 <+8>: push %rbx
> > 0x0000000000401689 <+9>: sub $0x8,%rsp
> > 0x000000000040168d <+13>: mov 0x410c(%rip),%rax #
> > 0x4057a0 <__libc+32>
> > 0x0000000000401694 <+20>: mov 0x410d(%rip),%rcx #
> > 0x4057a8 <__libc+40>
> > 0x000000000040169b <+27>: mov 0x40f6(%rip),%rbx #
> > 0x405798 <__libc+24>
> > 0x00000000004016a2 <+34>: lea -0xe0(%rdi,%rax,1),%rax
> > 0x00000000004016aa <+42>: lea -0x1(%rcx),%r12
> > => 0x00000000004016ae <+46>: andn %rax,%r12,%r12
>
> This instruction, andn, is not in the base x86_64 ISA. It's part of
> the BMI1 extension:
>
> https://en.wikipedia.org/wiki/Bit_Manipulation_Instruction_Sets#BMI1_(Bit_Manipulation_Instruction_Set_1)
>
> Apparently Gentoo is providing cross compilers that default to
> producing "native ISA level" code for the host, rather than baseline
> ISA for the target. But:
>
> > as a bonus (I thought this might also help):
> > (%:~/projects/musl-test)┌- x86_64-pc-linux-musl-gcc -v -static -O0 -g
> > hello.c
> > Using built-in specs.
> > COLLECT_GCC=x86_64-pc-linux-musl-gcc
> > COLLECT_LTO_WRAPPER=/usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/lto-wrapper
> > Target: x86_64-pc-linux-musl
> > Configured with:
> > /var/tmp/portage/cross-x86_64-pc-linux-musl/gcc-9.1.0/work/gcc-9.1.0/configure
> > --host=x86_64-pc-linux-gnu --target=x86_64-pc-linux-musl
> > --build=x86_64-pc-linux-gnu --prefix=/usr
> > --bindir=/usr/x86_64-pc-linux-gnu/x86_64-pc-linux-musl/gcc-bin/9.1.0
> > --includedir=/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/include
> > --datadir=/usr/share/gcc-data/x86_64-pc-linux-musl/9.1.0
> > --mandir=/usr/share/gcc-data/x86_64-pc-linux-musl/9.1.0/man
> > --infodir=/usr/share/gcc-data/x86_64-pc-linux-musl/9.1.0/info
> > --with-gxx-include-dir=/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/include/g++-v9
> > --with-python-dir=/share/gcc-data/x86_64-pc-linux-musl/9.1.0/python
> > --enable-languages=c,c++,fortran --enable-obsolete --enable-secureplt
> > --disable-werror --with-system-zlib --enable-nls
> > --without-included-gettext --enable-checking=release
> > --with-bugurl=https://bugs.gentoo.org/ --with-pkgversion='Gentoo 9.1.0
> > p1.0' --disable-esp --enable-libstdcxx-time
> > --enable-poison-system-directories
> > --with-sysroot=/usr/x86_64-pc-linux-musl --disable-bootstrap
> > --enable-__cxa_atexit --disable-multilib --with-multilib-list=m64
> > --disable-altivec --disable-fixed-point --enable-targets=all
> > --enable-libgomp --disable-libmudflap --disable-libssp
> > --disable-systemtap --disable-vtable-verify --disable-libvtv
> > --enable-lto --without-isl --disable-libsanitizer --enable-default-pie
> > --enable-default-ssp
> > Thread model: posix
> > gcc version 9.1.0 (Gentoo 9.1.0 p1.0)
> > COLLECT_GCC_OPTIONS='-v' '-static' '-O0' '-g' '-mtune=generic' '-march=x86-64'
> > /usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/cc1 -quiet -v hello.c
> > -quiet -dumpbase hello.c -mtune=generic -march=x86-64 -auxbase hello
> > -g -O0 -version -o /tmp/ccoTkh38.s
> > GNU C17 (Gentoo 9.1.0 p1.0) version 9.1.0 (x86_64-pc-linux-musl)
> > compiled by GNU C version 8.3.0, GMP version 6.1.2, MPFR version
> > 4.0.2, MPC version 1.1.0, isl version none
> > GGC heuristics: --param ggc-min-expand=100 --param ggc-min-heapsize=131072
> > ignoring nonexistent directory "/usr/x86_64-pc-linux-musl/usr/local/include"
> > ignoring nonexistent directory
> > "/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/../../../../x86_64-pc-linux-musl/include"
> > #include "..." search starts here:
> > #include <...> search starts here:
> > /usr/x86_64-pc-linux-musl/usr/include
> > /usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/include
> > End of search list.
> > GNU C17 (Gentoo 9.1.0 p1.0) version 9.1.0 (x86_64-pc-linux-musl)
> > compiled by GNU C version 8.3.0, GMP version 6.1.2, MPFR version
> > 4.0.2, MPC version 1.1.0, isl version none
> > GGC heuristics: --param ggc-min-expand=100 --param ggc-min-heapsize=131072
> > Compiler executable checksum: a3183e5f435d1938198d432af6db159b
> > COLLECT_GCC_OPTIONS='-v' '-static' '-O0' '-g' '-mtune=generic' '-march=x86-64'
> > /usr/libexec/gcc/x86_64-pc-linux-musl/as -v --64 -o /tmp/ccHq7CL6.o
> > /tmp/ccoTkh38.s
> > GNU assembler version 2.32.0 (x86_64-pc-linux-musl) using BFD version
> > (Gentoo 2.32 p2) 2.32.0
> > COMPILER_PATH=/usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/:/usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/:/usr/libexec/gcc/x86_64-pc-linux-musl/:/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/:/usr/lib/gcc/x86_64-pc-linux-musl/
> > LIBRARY_PATH=/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/:/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/../../../../x86_64-pc-linux-musl/lib/:/usr/x86_64-pc-linux-musl/lib/:/usr/x86_64-pc-linux-musl/usr/lib/
> > COLLECT_GCC_OPTIONS='-v' '-static' '-O0' '-g' '-mtune=generic' '-march=x86-64'
> > /usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/collect2 -plugin
> > /usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/liblto_plugin.so
> > -plugin-opt=/usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/lto-wrapper
> > -plugin-opt=-fresolution=/tmp/ccWcifv4.res
> > -plugin-opt=-pass-through=-lgcc -plugin-opt=-pass-through=-lgcc_eh
> > -plugin-opt=-pass-through=-lc --sysroot=/usr/x86_64-pc-linux-musl -m
> > elf_x86_64 -static /usr/x86_64-pc-linux-musl/usr/lib/crt1.o
> > /usr/x86_64-pc-linux-musl/usr/lib/crti.o
> > /usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/crtbeginT.o
> > -L/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0
> > -L/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/../../../../x86_64-pc-linux-musl/lib
> > -L/usr/x86_64-pc-linux-musl/lib -L/usr/x86_64-pc-linux-musl/usr/lib
> > /tmp/ccHq7CL6.o --start-group -lgcc -lgcc_eh -lc --end-group
> > /usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/crtend.o
> > /usr/x86_64-pc-linux-musl/usr/lib/crtn.o
> > COLLECT_GCC_OPTIONS='-v' '-static' '-O0' '-g' '-mtune=generic' '-march=x86-64'
> >
> > mtune=generic and march=x86-64 suggests it isn't trying to do
> > something weird on the compile computer.
>
> Indeed, it looks like the default is right. So you probably need to
> check how musl was built. Is it also a package provided by Gentoo, and
> did they perhaps use -march=native even though it's being cross
> compiled?
>
> Rich
^ permalink raw reply [flat|nested] 13+ messages in thread
* Re: Illegal instruction in __copy_tls()
2019-06-05 21:27 ` tenspd137 .
@ 2019-06-05 21:56 ` Michael Everitt
2019-06-05 23:09 ` tenspd137 .
0 siblings, 1 reply; 13+ messages in thread
From: Michael Everitt @ 2019-06-05 21:56 UTC (permalink / raw)
To: musl
[-- Attachment #1.1: Type: text/plain, Size: 9470 bytes --]
In your /usr/${CTARGET}/etc/portage/make.conf you can set appropriate
target flags there. But using 'march=native' is going to catch you out a
lot cross-compiling anything ... :) At least if you've got it set to
something, you're going to see errors that point immediately to your CFLAGS
when/if it goes wrong!
Michael.
On 05/06/19 22:27, tenspd137 . wrote:
> Thanks! That was indeed the problem. I had march=native for all
> portage related stuff set, and my guess is that crossdev read that to
> start. I removed that, reran the crossdev tool to buiild the cross
> toolchain, and can now build static binaries that run on different
> systems.
>
> Much appreciated!
>
> -C
>
> On Wed, Jun 5, 2019 at 2:07 PM Rich Felker <dalias@libc.org> wrote:
>> On Wed, Jun 05, 2019 at 01:53:58PM -0600, tenspd137 . wrote:
>>> Sure -
>>>
>>> strace -d -v ./a.out:
>>> strace: ptrace_setoptions = 0x51
>>> strace: new tcb for pid 26302, active tcbs:1
>>> strace: [wait(0x80137f) = 26302] WIFSTOPPED,sig=SIGSTOP,EVENT_STOP (128)
>>> strace: pid 26302 has TCB_STARTUP, initializing it
>>> strace: [wait(0x80057f) = 26302] WIFSTOPPED,sig=SIGTRAP,EVENT_STOP (128)
>>> strace: [wait(0x00127f) = 26302] WIFSTOPPED,sig=SIGCONT
>>> strace: [wait(0x00857f) = 26302] WIFSTOPPED,sig=133
>>> execve("./a.out", ["./a.out"], ["SSH_CONNECTION=15.86.136.27 5196"...,
>>> "LANG=en_US.UTF-8", "XDG_SESSION_ID=41", "USER=dayd",
>>> "PWD=/home/dayd/projects/musl-tes"..., "HOME=/home/dayd",
>>> "SSH_CLIENT=xx.xxx.xxx.xx 51960 22", "CCACHE_DIR=/ssd/dayd/.ccache",
>>> "VMWARE_USE_SHIPPED_GTK=yes", "XDG_DATA_DIRS=/usr/local/share:/"...,
>>> "USECCACHE=ON", "SSH_TTY=/dev/pts/2", "MAIL=/var/mail/dayd",
>>> "TERM=rxvt-unicode-256color", "SHELL=/bin/bash", "SHLVL=1",
>>> "PYTHONPATH=:/home/dayd/projects/"..., "LOGNAME=dayd",
>>> "DBUS_SESSION_BUS_ADDRESS=unix:pa"...,
>>> "XDG_RUNTIME_DIR=/run/user/6686",
>>> "PATH=/usr/lib/ccache/bin/:/usr/l"..., "USEDISTCC=OFF",
>>> "_=/usr/bin/strace", "OLDPWD=/home/dayd/projects"]strace:
>>> [wait(0x04057f) = 26302] WIFSTOPPED,sig=SIGTRAP,EVENT_EXEC (4)
>>> strace: [wait(0x00857f) = 26302] WIFSTOPPED,sig=133
>>> ) = 0
>>> strace: [wait(0x00047f) = 26302] WIFSTOPPED,sig=SIGILL
>>> --- SIGILL {si_signo=SIGILL, si_code=ILL_ILLOPN, si_addr=0x40169e} ---
>>> strace: [wait(0x06057f) = 26302] WIFSTOPPED,sig=SIGTRAP,EVENT_EXIT (6)
>>> strace: [wait(0x000084) = 26302] WIFSIGNALED,core,sig=SIGILL
>>> +++ killed by SIGILL (core dumped) +++
>>> strace: dropped tcb for pid 26302, 0 remain
>>> Illegal instruction (core dumped)
>>> ******************************************************************************************
>>> (gdb) bt
>>> #0 0x00000000004016ae in __copy_tls ()
>>> #1 0x0000000000000000 in ?? ()
>>> *****************************************************************************************
>>>
>>> (gdb) disassemble
>>> Dump of assembler code for function __copy_tls:
>>> 0x0000000000401680 <+0>: push %r13
>>> 0x0000000000401682 <+2>: mov %rdi,%r13
>>> 0x0000000000401685 <+5>: push %r12
>>> 0x0000000000401687 <+7>: push %rbp
>>> 0x0000000000401688 <+8>: push %rbx
>>> 0x0000000000401689 <+9>: sub $0x8,%rsp
>>> 0x000000000040168d <+13>: mov 0x410c(%rip),%rax #
>>> 0x4057a0 <__libc+32>
>>> 0x0000000000401694 <+20>: mov 0x410d(%rip),%rcx #
>>> 0x4057a8 <__libc+40>
>>> 0x000000000040169b <+27>: mov 0x40f6(%rip),%rbx #
>>> 0x405798 <__libc+24>
>>> 0x00000000004016a2 <+34>: lea -0xe0(%rdi,%rax,1),%rax
>>> 0x00000000004016aa <+42>: lea -0x1(%rcx),%r12
>>> => 0x00000000004016ae <+46>: andn %rax,%r12,%r12
>> This instruction, andn, is not in the base x86_64 ISA. It's part of
>> the BMI1 extension:
>>
>> https://en.wikipedia.org/wiki/Bit_Manipulation_Instruction_Sets#BMI1_(Bit_Manipulation_Instruction_Set_1)
>>
>> Apparently Gentoo is providing cross compilers that default to
>> producing "native ISA level" code for the host, rather than baseline
>> ISA for the target. But:
>>
>>> as a bonus (I thought this might also help):
>>> (%:~/projects/musl-test)┌- x86_64-pc-linux-musl-gcc -v -static -O0 -g
>>> hello.c
>>> Using built-in specs.
>>> COLLECT_GCC=x86_64-pc-linux-musl-gcc
>>> COLLECT_LTO_WRAPPER=/usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/lto-wrapper
>>> Target: x86_64-pc-linux-musl
>>> Configured with:
>>> /var/tmp/portage/cross-x86_64-pc-linux-musl/gcc-9.1.0/work/gcc-9.1.0/configure
>>> --host=x86_64-pc-linux-gnu --target=x86_64-pc-linux-musl
>>> --build=x86_64-pc-linux-gnu --prefix=/usr
>>> --bindir=/usr/x86_64-pc-linux-gnu/x86_64-pc-linux-musl/gcc-bin/9.1.0
>>> --includedir=/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/include
>>> --datadir=/usr/share/gcc-data/x86_64-pc-linux-musl/9.1.0
>>> --mandir=/usr/share/gcc-data/x86_64-pc-linux-musl/9.1.0/man
>>> --infodir=/usr/share/gcc-data/x86_64-pc-linux-musl/9.1.0/info
>>> --with-gxx-include-dir=/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/include/g++-v9
>>> --with-python-dir=/share/gcc-data/x86_64-pc-linux-musl/9.1.0/python
>>> --enable-languages=c,c++,fortran --enable-obsolete --enable-secureplt
>>> --disable-werror --with-system-zlib --enable-nls
>>> --without-included-gettext --enable-checking=release
>>> --with-bugurl=https://bugs.gentoo.org/ --with-pkgversion='Gentoo 9.1.0
>>> p1.0' --disable-esp --enable-libstdcxx-time
>>> --enable-poison-system-directories
>>> --with-sysroot=/usr/x86_64-pc-linux-musl --disable-bootstrap
>>> --enable-__cxa_atexit --disable-multilib --with-multilib-list=m64
>>> --disable-altivec --disable-fixed-point --enable-targets=all
>>> --enable-libgomp --disable-libmudflap --disable-libssp
>>> --disable-systemtap --disable-vtable-verify --disable-libvtv
>>> --enable-lto --without-isl --disable-libsanitizer --enable-default-pie
>>> --enable-default-ssp
>>> Thread model: posix
>>> gcc version 9.1.0 (Gentoo 9.1.0 p1.0)
>>> COLLECT_GCC_OPTIONS='-v' '-static' '-O0' '-g' '-mtune=generic' '-march=x86-64'
>>> /usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/cc1 -quiet -v hello.c
>>> -quiet -dumpbase hello.c -mtune=generic -march=x86-64 -auxbase hello
>>> -g -O0 -version -o /tmp/ccoTkh38.s
>>> GNU C17 (Gentoo 9.1.0 p1.0) version 9.1.0 (x86_64-pc-linux-musl)
>>> compiled by GNU C version 8.3.0, GMP version 6.1.2, MPFR version
>>> 4.0.2, MPC version 1.1.0, isl version none
>>> GGC heuristics: --param ggc-min-expand=100 --param ggc-min-heapsize=131072
>>> ignoring nonexistent directory "/usr/x86_64-pc-linux-musl/usr/local/include"
>>> ignoring nonexistent directory
>>> "/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/../../../../x86_64-pc-linux-musl/include"
>>> #include "..." search starts here:
>>> #include <...> search starts here:
>>> /usr/x86_64-pc-linux-musl/usr/include
>>> /usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/include
>>> End of search list.
>>> GNU C17 (Gentoo 9.1.0 p1.0) version 9.1.0 (x86_64-pc-linux-musl)
>>> compiled by GNU C version 8.3.0, GMP version 6.1.2, MPFR version
>>> 4.0.2, MPC version 1.1.0, isl version none
>>> GGC heuristics: --param ggc-min-expand=100 --param ggc-min-heapsize=131072
>>> Compiler executable checksum: a3183e5f435d1938198d432af6db159b
>>> COLLECT_GCC_OPTIONS='-v' '-static' '-O0' '-g' '-mtune=generic' '-march=x86-64'
>>> /usr/libexec/gcc/x86_64-pc-linux-musl/as -v --64 -o /tmp/ccHq7CL6.o
>>> /tmp/ccoTkh38.s
>>> GNU assembler version 2.32.0 (x86_64-pc-linux-musl) using BFD version
>>> (Gentoo 2.32 p2) 2.32.0
>>> COMPILER_PATH=/usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/:/usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/:/usr/libexec/gcc/x86_64-pc-linux-musl/:/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/:/usr/lib/gcc/x86_64-pc-linux-musl/
>>> LIBRARY_PATH=/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/:/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/../../../../x86_64-pc-linux-musl/lib/:/usr/x86_64-pc-linux-musl/lib/:/usr/x86_64-pc-linux-musl/usr/lib/
>>> COLLECT_GCC_OPTIONS='-v' '-static' '-O0' '-g' '-mtune=generic' '-march=x86-64'
>>> /usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/collect2 -plugin
>>> /usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/liblto_plugin.so
>>> -plugin-opt=/usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/lto-wrapper
>>> -plugin-opt=-fresolution=/tmp/ccWcifv4.res
>>> -plugin-opt=-pass-through=-lgcc -plugin-opt=-pass-through=-lgcc_eh
>>> -plugin-opt=-pass-through=-lc --sysroot=/usr/x86_64-pc-linux-musl -m
>>> elf_x86_64 -static /usr/x86_64-pc-linux-musl/usr/lib/crt1.o
>>> /usr/x86_64-pc-linux-musl/usr/lib/crti.o
>>> /usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/crtbeginT.o
>>> -L/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0
>>> -L/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/../../../../x86_64-pc-linux-musl/lib
>>> -L/usr/x86_64-pc-linux-musl/lib -L/usr/x86_64-pc-linux-musl/usr/lib
>>> /tmp/ccHq7CL6.o --start-group -lgcc -lgcc_eh -lc --end-group
>>> /usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/crtend.o
>>> /usr/x86_64-pc-linux-musl/usr/lib/crtn.o
>>> COLLECT_GCC_OPTIONS='-v' '-static' '-O0' '-g' '-mtune=generic' '-march=x86-64'
>>>
>>> mtune=generic and march=x86-64 suggests it isn't trying to do
>>> something weird on the compile computer.
>> Indeed, it looks like the default is right. So you probably need to
>> check how musl was built. Is it also a package provided by Gentoo, and
>> did they perhaps use -march=native even though it's being cross
>> compiled?
>>
>> Rich
[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 801 bytes --]
^ permalink raw reply [flat|nested] 13+ messages in thread
* Re: Illegal instruction in __copy_tls()
2019-06-05 21:56 ` Michael Everitt
@ 2019-06-05 23:09 ` tenspd137 .
2019-06-05 23:32 ` tenspd137 .
0 siblings, 1 reply; 13+ messages in thread
From: tenspd137 . @ 2019-06-05 23:09 UTC (permalink / raw)
To: musl
I probably don't fully understand how it works. In
/etc/x86_64-pc-linux-musl/etc.portage/make.conf, march is not
specified. It is specified in /etc/portage/make.conf. When I removed
it from there, things worked. Then I just put it back after using
crossdev to make x86_64-pc-linux-musl-*.
Either way, loads of fun :)
Thanks!
-C
On Wed, Jun 5, 2019 at 3:56 PM Michael Everitt <m.j.everitt@iee.org> wrote:
>
> In your /usr/${CTARGET}/etc/portage/make.conf you can set appropriate
> target flags there. But using 'march=native' is going to catch you out a
> lot cross-compiling anything ... :) At least if you've got it set to
> something, you're going to see errors that point immediately to your CFLAGS
> when/if it goes wrong!
>
> Michael.
>
> On 05/06/19 22:27, tenspd137 . wrote:
> > Thanks! That was indeed the problem. I had march=native for all
> > portage related stuff set, and my guess is that crossdev read that to
> > start. I removed that, reran the crossdev tool to buiild the cross
> > toolchain, and can now build static binaries that run on different
> > systems.
> >
> > Much appreciated!
> >
> > -C
> >
> > On Wed, Jun 5, 2019 at 2:07 PM Rich Felker <dalias@libc.org> wrote:
> >> On Wed, Jun 05, 2019 at 01:53:58PM -0600, tenspd137 . wrote:
> >>> Sure -
> >>>
> >>> strace -d -v ./a.out:
> >>> strace: ptrace_setoptions = 0x51
> >>> strace: new tcb for pid 26302, active tcbs:1
> >>> strace: [wait(0x80137f) = 26302] WIFSTOPPED,sig=SIGSTOP,EVENT_STOP (128)
> >>> strace: pid 26302 has TCB_STARTUP, initializing it
> >>> strace: [wait(0x80057f) = 26302] WIFSTOPPED,sig=SIGTRAP,EVENT_STOP (128)
> >>> strace: [wait(0x00127f) = 26302] WIFSTOPPED,sig=SIGCONT
> >>> strace: [wait(0x00857f) = 26302] WIFSTOPPED,sig=133
> >>> execve("./a.out", ["./a.out"], ["SSH_CONNECTION=15.86.136.27 5196"...,
> >>> "LANG=en_US.UTF-8", "XDG_SESSION_ID=41", "USER=dayd",
> >>> "PWD=/home/dayd/projects/musl-tes"..., "HOME=/home/dayd",
> >>> "SSH_CLIENT=xx.xxx.xxx.xx 51960 22", "CCACHE_DIR=/ssd/dayd/.ccache",
> >>> "VMWARE_USE_SHIPPED_GTK=yes", "XDG_DATA_DIRS=/usr/local/share:/"...,
> >>> "USECCACHE=ON", "SSH_TTY=/dev/pts/2", "MAIL=/var/mail/dayd",
> >>> "TERM=rxvt-unicode-256color", "SHELL=/bin/bash", "SHLVL=1",
> >>> "PYTHONPATH=:/home/dayd/projects/"..., "LOGNAME=dayd",
> >>> "DBUS_SESSION_BUS_ADDRESS=unix:pa"...,
> >>> "XDG_RUNTIME_DIR=/run/user/6686",
> >>> "PATH=/usr/lib/ccache/bin/:/usr/l"..., "USEDISTCC=OFF",
> >>> "_=/usr/bin/strace", "OLDPWD=/home/dayd/projects"]strace:
> >>> [wait(0x04057f) = 26302] WIFSTOPPED,sig=SIGTRAP,EVENT_EXEC (4)
> >>> strace: [wait(0x00857f) = 26302] WIFSTOPPED,sig=133
> >>> ) = 0
> >>> strace: [wait(0x00047f) = 26302] WIFSTOPPED,sig=SIGILL
> >>> --- SIGILL {si_signo=SIGILL, si_code=ILL_ILLOPN, si_addr=0x40169e} ---
> >>> strace: [wait(0x06057f) = 26302] WIFSTOPPED,sig=SIGTRAP,EVENT_EXIT (6)
> >>> strace: [wait(0x000084) = 26302] WIFSIGNALED,core,sig=SIGILL
> >>> +++ killed by SIGILL (core dumped) +++
> >>> strace: dropped tcb for pid 26302, 0 remain
> >>> Illegal instruction (core dumped)
> >>> ******************************************************************************************
> >>> (gdb) bt
> >>> #0 0x00000000004016ae in __copy_tls ()
> >>> #1 0x0000000000000000 in ?? ()
> >>> *****************************************************************************************
> >>>
> >>> (gdb) disassemble
> >>> Dump of assembler code for function __copy_tls:
> >>> 0x0000000000401680 <+0>: push %r13
> >>> 0x0000000000401682 <+2>: mov %rdi,%r13
> >>> 0x0000000000401685 <+5>: push %r12
> >>> 0x0000000000401687 <+7>: push %rbp
> >>> 0x0000000000401688 <+8>: push %rbx
> >>> 0x0000000000401689 <+9>: sub $0x8,%rsp
> >>> 0x000000000040168d <+13>: mov 0x410c(%rip),%rax #
> >>> 0x4057a0 <__libc+32>
> >>> 0x0000000000401694 <+20>: mov 0x410d(%rip),%rcx #
> >>> 0x4057a8 <__libc+40>
> >>> 0x000000000040169b <+27>: mov 0x40f6(%rip),%rbx #
> >>> 0x405798 <__libc+24>
> >>> 0x00000000004016a2 <+34>: lea -0xe0(%rdi,%rax,1),%rax
> >>> 0x00000000004016aa <+42>: lea -0x1(%rcx),%r12
> >>> => 0x00000000004016ae <+46>: andn %rax,%r12,%r12
> >> This instruction, andn, is not in the base x86_64 ISA. It's part of
> >> the BMI1 extension:
> >>
> >> https://en.wikipedia.org/wiki/Bit_Manipulation_Instruction_Sets#BMI1_(Bit_Manipulation_Instruction_Set_1)
> >>
> >> Apparently Gentoo is providing cross compilers that default to
> >> producing "native ISA level" code for the host, rather than baseline
> >> ISA for the target. But:
> >>
> >>> as a bonus (I thought this might also help):
> >>> (%:~/projects/musl-test)┌- x86_64-pc-linux-musl-gcc -v -static -O0 -g
> >>> hello.c
> >>> Using built-in specs.
> >>> COLLECT_GCC=x86_64-pc-linux-musl-gcc
> >>> COLLECT_LTO_WRAPPER=/usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/lto-wrapper
> >>> Target: x86_64-pc-linux-musl
> >>> Configured with:
> >>> /var/tmp/portage/cross-x86_64-pc-linux-musl/gcc-9.1.0/work/gcc-9.1.0/configure
> >>> --host=x86_64-pc-linux-gnu --target=x86_64-pc-linux-musl
> >>> --build=x86_64-pc-linux-gnu --prefix=/usr
> >>> --bindir=/usr/x86_64-pc-linux-gnu/x86_64-pc-linux-musl/gcc-bin/9.1.0
> >>> --includedir=/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/include
> >>> --datadir=/usr/share/gcc-data/x86_64-pc-linux-musl/9.1.0
> >>> --mandir=/usr/share/gcc-data/x86_64-pc-linux-musl/9.1.0/man
> >>> --infodir=/usr/share/gcc-data/x86_64-pc-linux-musl/9.1.0/info
> >>> --with-gxx-include-dir=/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/include/g++-v9
> >>> --with-python-dir=/share/gcc-data/x86_64-pc-linux-musl/9.1.0/python
> >>> --enable-languages=c,c++,fortran --enable-obsolete --enable-secureplt
> >>> --disable-werror --with-system-zlib --enable-nls
> >>> --without-included-gettext --enable-checking=release
> >>> --with-bugurl=https://bugs.gentoo.org/ --with-pkgversion='Gentoo 9.1.0
> >>> p1.0' --disable-esp --enable-libstdcxx-time
> >>> --enable-poison-system-directories
> >>> --with-sysroot=/usr/x86_64-pc-linux-musl --disable-bootstrap
> >>> --enable-__cxa_atexit --disable-multilib --with-multilib-list=m64
> >>> --disable-altivec --disable-fixed-point --enable-targets=all
> >>> --enable-libgomp --disable-libmudflap --disable-libssp
> >>> --disable-systemtap --disable-vtable-verify --disable-libvtv
> >>> --enable-lto --without-isl --disable-libsanitizer --enable-default-pie
> >>> --enable-default-ssp
> >>> Thread model: posix
> >>> gcc version 9.1.0 (Gentoo 9.1.0 p1.0)
> >>> COLLECT_GCC_OPTIONS='-v' '-static' '-O0' '-g' '-mtune=generic' '-march=x86-64'
> >>> /usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/cc1 -quiet -v hello.c
> >>> -quiet -dumpbase hello.c -mtune=generic -march=x86-64 -auxbase hello
> >>> -g -O0 -version -o /tmp/ccoTkh38.s
> >>> GNU C17 (Gentoo 9.1.0 p1.0) version 9.1.0 (x86_64-pc-linux-musl)
> >>> compiled by GNU C version 8.3.0, GMP version 6.1.2, MPFR version
> >>> 4.0.2, MPC version 1.1.0, isl version none
> >>> GGC heuristics: --param ggc-min-expand=100 --param ggc-min-heapsize=131072
> >>> ignoring nonexistent directory "/usr/x86_64-pc-linux-musl/usr/local/include"
> >>> ignoring nonexistent directory
> >>> "/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/../../../../x86_64-pc-linux-musl/include"
> >>> #include "..." search starts here:
> >>> #include <...> search starts here:
> >>> /usr/x86_64-pc-linux-musl/usr/include
> >>> /usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/include
> >>> End of search list.
> >>> GNU C17 (Gentoo 9.1.0 p1.0) version 9.1.0 (x86_64-pc-linux-musl)
> >>> compiled by GNU C version 8.3.0, GMP version 6.1.2, MPFR version
> >>> 4.0.2, MPC version 1.1.0, isl version none
> >>> GGC heuristics: --param ggc-min-expand=100 --param ggc-min-heapsize=131072
> >>> Compiler executable checksum: a3183e5f435d1938198d432af6db159b
> >>> COLLECT_GCC_OPTIONS='-v' '-static' '-O0' '-g' '-mtune=generic' '-march=x86-64'
> >>> /usr/libexec/gcc/x86_64-pc-linux-musl/as -v --64 -o /tmp/ccHq7CL6.o
> >>> /tmp/ccoTkh38.s
> >>> GNU assembler version 2.32.0 (x86_64-pc-linux-musl) using BFD version
> >>> (Gentoo 2.32 p2) 2.32.0
> >>> COMPILER_PATH=/usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/:/usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/:/usr/libexec/gcc/x86_64-pc-linux-musl/:/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/:/usr/lib/gcc/x86_64-pc-linux-musl/
> >>> LIBRARY_PATH=/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/:/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/../../../../x86_64-pc-linux-musl/lib/:/usr/x86_64-pc-linux-musl/lib/:/usr/x86_64-pc-linux-musl/usr/lib/
> >>> COLLECT_GCC_OPTIONS='-v' '-static' '-O0' '-g' '-mtune=generic' '-march=x86-64'
> >>> /usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/collect2 -plugin
> >>> /usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/liblto_plugin.so
> >>> -plugin-opt=/usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/lto-wrapper
> >>> -plugin-opt=-fresolution=/tmp/ccWcifv4.res
> >>> -plugin-opt=-pass-through=-lgcc -plugin-opt=-pass-through=-lgcc_eh
> >>> -plugin-opt=-pass-through=-lc --sysroot=/usr/x86_64-pc-linux-musl -m
> >>> elf_x86_64 -static /usr/x86_64-pc-linux-musl/usr/lib/crt1.o
> >>> /usr/x86_64-pc-linux-musl/usr/lib/crti.o
> >>> /usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/crtbeginT.o
> >>> -L/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0
> >>> -L/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/../../../../x86_64-pc-linux-musl/lib
> >>> -L/usr/x86_64-pc-linux-musl/lib -L/usr/x86_64-pc-linux-musl/usr/lib
> >>> /tmp/ccHq7CL6.o --start-group -lgcc -lgcc_eh -lc --end-group
> >>> /usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/crtend.o
> >>> /usr/x86_64-pc-linux-musl/usr/lib/crtn.o
> >>> COLLECT_GCC_OPTIONS='-v' '-static' '-O0' '-g' '-mtune=generic' '-march=x86-64'
> >>>
> >>> mtune=generic and march=x86-64 suggests it isn't trying to do
> >>> something weird on the compile computer.
> >> Indeed, it looks like the default is right. So you probably need to
> >> check how musl was built. Is it also a package provided by Gentoo, and
> >> did they perhaps use -march=native even though it's being cross
> >> compiled?
> >>
> >> Rich
>
>
^ permalink raw reply [flat|nested] 13+ messages in thread
* Re: Illegal instruction in __copy_tls()
2019-06-05 23:09 ` tenspd137 .
@ 2019-06-05 23:32 ` tenspd137 .
2019-06-05 23:34 ` Michael Everitt
0 siblings, 1 reply; 13+ messages in thread
From: tenspd137 . @ 2019-06-05 23:32 UTC (permalink / raw)
To: musl
Quick question - anyone know how to make a crossdev crosscompiler
multilib so I can use -m32 when I compile?
Thanks!
On Wed, Jun 5, 2019 at 5:09 PM tenspd137 . <dcday137@gmail.com> wrote:
>
> I probably don't fully understand how it works. In
> /etc/x86_64-pc-linux-musl/etc.portage/make.conf, march is not
> specified. It is specified in /etc/portage/make.conf. When I removed
> it from there, things worked. Then I just put it back after using
> crossdev to make x86_64-pc-linux-musl-*.
>
> Either way, loads of fun :)
>
> Thanks!
>
> -C
>
> On Wed, Jun 5, 2019 at 3:56 PM Michael Everitt <m.j.everitt@iee.org> wrote:
> >
> > In your /usr/${CTARGET}/etc/portage/make.conf you can set appropriate
> > target flags there. But using 'march=native' is going to catch you out a
> > lot cross-compiling anything ... :) At least if you've got it set to
> > something, you're going to see errors that point immediately to your CFLAGS
> > when/if it goes wrong!
> >
> > Michael.
> >
> > On 05/06/19 22:27, tenspd137 . wrote:
> > > Thanks! That was indeed the problem. I had march=native for all
> > > portage related stuff set, and my guess is that crossdev read that to
> > > start. I removed that, reran the crossdev tool to buiild the cross
> > > toolchain, and can now build static binaries that run on different
> > > systems.
> > >
> > > Much appreciated!
> > >
> > > -C
> > >
> > > On Wed, Jun 5, 2019 at 2:07 PM Rich Felker <dalias@libc.org> wrote:
> > >> On Wed, Jun 05, 2019 at 01:53:58PM -0600, tenspd137 . wrote:
> > >>> Sure -
> > >>>
> > >>> strace -d -v ./a.out:
> > >>> strace: ptrace_setoptions = 0x51
> > >>> strace: new tcb for pid 26302, active tcbs:1
> > >>> strace: [wait(0x80137f) = 26302] WIFSTOPPED,sig=SIGSTOP,EVENT_STOP (128)
> > >>> strace: pid 26302 has TCB_STARTUP, initializing it
> > >>> strace: [wait(0x80057f) = 26302] WIFSTOPPED,sig=SIGTRAP,EVENT_STOP (128)
> > >>> strace: [wait(0x00127f) = 26302] WIFSTOPPED,sig=SIGCONT
> > >>> strace: [wait(0x00857f) = 26302] WIFSTOPPED,sig=133
> > >>> execve("./a.out", ["./a.out"], ["SSH_CONNECTION=15.86.136.27 5196"...,
> > >>> "LANG=en_US.UTF-8", "XDG_SESSION_ID=41", "USER=dayd",
> > >>> "PWD=/home/dayd/projects/musl-tes"..., "HOME=/home/dayd",
> > >>> "SSH_CLIENT=xx.xxx.xxx.xx 51960 22", "CCACHE_DIR=/ssd/dayd/.ccache",
> > >>> "VMWARE_USE_SHIPPED_GTK=yes", "XDG_DATA_DIRS=/usr/local/share:/"...,
> > >>> "USECCACHE=ON", "SSH_TTY=/dev/pts/2", "MAIL=/var/mail/dayd",
> > >>> "TERM=rxvt-unicode-256color", "SHELL=/bin/bash", "SHLVL=1",
> > >>> "PYTHONPATH=:/home/dayd/projects/"..., "LOGNAME=dayd",
> > >>> "DBUS_SESSION_BUS_ADDRESS=unix:pa"...,
> > >>> "XDG_RUNTIME_DIR=/run/user/6686",
> > >>> "PATH=/usr/lib/ccache/bin/:/usr/l"..., "USEDISTCC=OFF",
> > >>> "_=/usr/bin/strace", "OLDPWD=/home/dayd/projects"]strace:
> > >>> [wait(0x04057f) = 26302] WIFSTOPPED,sig=SIGTRAP,EVENT_EXEC (4)
> > >>> strace: [wait(0x00857f) = 26302] WIFSTOPPED,sig=133
> > >>> ) = 0
> > >>> strace: [wait(0x00047f) = 26302] WIFSTOPPED,sig=SIGILL
> > >>> --- SIGILL {si_signo=SIGILL, si_code=ILL_ILLOPN, si_addr=0x40169e} ---
> > >>> strace: [wait(0x06057f) = 26302] WIFSTOPPED,sig=SIGTRAP,EVENT_EXIT (6)
> > >>> strace: [wait(0x000084) = 26302] WIFSIGNALED,core,sig=SIGILL
> > >>> +++ killed by SIGILL (core dumped) +++
> > >>> strace: dropped tcb for pid 26302, 0 remain
> > >>> Illegal instruction (core dumped)
> > >>> ******************************************************************************************
> > >>> (gdb) bt
> > >>> #0 0x00000000004016ae in __copy_tls ()
> > >>> #1 0x0000000000000000 in ?? ()
> > >>> *****************************************************************************************
> > >>>
> > >>> (gdb) disassemble
> > >>> Dump of assembler code for function __copy_tls:
> > >>> 0x0000000000401680 <+0>: push %r13
> > >>> 0x0000000000401682 <+2>: mov %rdi,%r13
> > >>> 0x0000000000401685 <+5>: push %r12
> > >>> 0x0000000000401687 <+7>: push %rbp
> > >>> 0x0000000000401688 <+8>: push %rbx
> > >>> 0x0000000000401689 <+9>: sub $0x8,%rsp
> > >>> 0x000000000040168d <+13>: mov 0x410c(%rip),%rax #
> > >>> 0x4057a0 <__libc+32>
> > >>> 0x0000000000401694 <+20>: mov 0x410d(%rip),%rcx #
> > >>> 0x4057a8 <__libc+40>
> > >>> 0x000000000040169b <+27>: mov 0x40f6(%rip),%rbx #
> > >>> 0x405798 <__libc+24>
> > >>> 0x00000000004016a2 <+34>: lea -0xe0(%rdi,%rax,1),%rax
> > >>> 0x00000000004016aa <+42>: lea -0x1(%rcx),%r12
> > >>> => 0x00000000004016ae <+46>: andn %rax,%r12,%r12
> > >> This instruction, andn, is not in the base x86_64 ISA. It's part of
> > >> the BMI1 extension:
> > >>
> > >> https://en.wikipedia.org/wiki/Bit_Manipulation_Instruction_Sets#BMI1_(Bit_Manipulation_Instruction_Set_1)
> > >>
> > >> Apparently Gentoo is providing cross compilers that default to
> > >> producing "native ISA level" code for the host, rather than baseline
> > >> ISA for the target. But:
> > >>
> > >>> as a bonus (I thought this might also help):
> > >>> (%:~/projects/musl-test)┌- x86_64-pc-linux-musl-gcc -v -static -O0 -g
> > >>> hello.c
> > >>> Using built-in specs.
> > >>> COLLECT_GCC=x86_64-pc-linux-musl-gcc
> > >>> COLLECT_LTO_WRAPPER=/usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/lto-wrapper
> > >>> Target: x86_64-pc-linux-musl
> > >>> Configured with:
> > >>> /var/tmp/portage/cross-x86_64-pc-linux-musl/gcc-9.1.0/work/gcc-9.1.0/configure
> > >>> --host=x86_64-pc-linux-gnu --target=x86_64-pc-linux-musl
> > >>> --build=x86_64-pc-linux-gnu --prefix=/usr
> > >>> --bindir=/usr/x86_64-pc-linux-gnu/x86_64-pc-linux-musl/gcc-bin/9.1.0
> > >>> --includedir=/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/include
> > >>> --datadir=/usr/share/gcc-data/x86_64-pc-linux-musl/9.1.0
> > >>> --mandir=/usr/share/gcc-data/x86_64-pc-linux-musl/9.1.0/man
> > >>> --infodir=/usr/share/gcc-data/x86_64-pc-linux-musl/9.1.0/info
> > >>> --with-gxx-include-dir=/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/include/g++-v9
> > >>> --with-python-dir=/share/gcc-data/x86_64-pc-linux-musl/9.1.0/python
> > >>> --enable-languages=c,c++,fortran --enable-obsolete --enable-secureplt
> > >>> --disable-werror --with-system-zlib --enable-nls
> > >>> --without-included-gettext --enable-checking=release
> > >>> --with-bugurl=https://bugs.gentoo.org/ --with-pkgversion='Gentoo 9.1.0
> > >>> p1.0' --disable-esp --enable-libstdcxx-time
> > >>> --enable-poison-system-directories
> > >>> --with-sysroot=/usr/x86_64-pc-linux-musl --disable-bootstrap
> > >>> --enable-__cxa_atexit --disable-multilib --with-multilib-list=m64
> > >>> --disable-altivec --disable-fixed-point --enable-targets=all
> > >>> --enable-libgomp --disable-libmudflap --disable-libssp
> > >>> --disable-systemtap --disable-vtable-verify --disable-libvtv
> > >>> --enable-lto --without-isl --disable-libsanitizer --enable-default-pie
> > >>> --enable-default-ssp
> > >>> Thread model: posix
> > >>> gcc version 9.1.0 (Gentoo 9.1.0 p1.0)
> > >>> COLLECT_GCC_OPTIONS='-v' '-static' '-O0' '-g' '-mtune=generic' '-march=x86-64'
> > >>> /usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/cc1 -quiet -v hello.c
> > >>> -quiet -dumpbase hello.c -mtune=generic -march=x86-64 -auxbase hello
> > >>> -g -O0 -version -o /tmp/ccoTkh38.s
> > >>> GNU C17 (Gentoo 9.1.0 p1.0) version 9.1.0 (x86_64-pc-linux-musl)
> > >>> compiled by GNU C version 8.3.0, GMP version 6.1.2, MPFR version
> > >>> 4.0.2, MPC version 1.1.0, isl version none
> > >>> GGC heuristics: --param ggc-min-expand=100 --param ggc-min-heapsize=131072
> > >>> ignoring nonexistent directory "/usr/x86_64-pc-linux-musl/usr/local/include"
> > >>> ignoring nonexistent directory
> > >>> "/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/../../../../x86_64-pc-linux-musl/include"
> > >>> #include "..." search starts here:
> > >>> #include <...> search starts here:
> > >>> /usr/x86_64-pc-linux-musl/usr/include
> > >>> /usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/include
> > >>> End of search list.
> > >>> GNU C17 (Gentoo 9.1.0 p1.0) version 9.1.0 (x86_64-pc-linux-musl)
> > >>> compiled by GNU C version 8.3.0, GMP version 6.1.2, MPFR version
> > >>> 4.0.2, MPC version 1.1.0, isl version none
> > >>> GGC heuristics: --param ggc-min-expand=100 --param ggc-min-heapsize=131072
> > >>> Compiler executable checksum: a3183e5f435d1938198d432af6db159b
> > >>> COLLECT_GCC_OPTIONS='-v' '-static' '-O0' '-g' '-mtune=generic' '-march=x86-64'
> > >>> /usr/libexec/gcc/x86_64-pc-linux-musl/as -v --64 -o /tmp/ccHq7CL6.o
> > >>> /tmp/ccoTkh38.s
> > >>> GNU assembler version 2.32.0 (x86_64-pc-linux-musl) using BFD version
> > >>> (Gentoo 2.32 p2) 2.32.0
> > >>> COMPILER_PATH=/usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/:/usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/:/usr/libexec/gcc/x86_64-pc-linux-musl/:/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/:/usr/lib/gcc/x86_64-pc-linux-musl/
> > >>> LIBRARY_PATH=/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/:/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/../../../../x86_64-pc-linux-musl/lib/:/usr/x86_64-pc-linux-musl/lib/:/usr/x86_64-pc-linux-musl/usr/lib/
> > >>> COLLECT_GCC_OPTIONS='-v' '-static' '-O0' '-g' '-mtune=generic' '-march=x86-64'
> > >>> /usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/collect2 -plugin
> > >>> /usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/liblto_plugin.so
> > >>> -plugin-opt=/usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/lto-wrapper
> > >>> -plugin-opt=-fresolution=/tmp/ccWcifv4.res
> > >>> -plugin-opt=-pass-through=-lgcc -plugin-opt=-pass-through=-lgcc_eh
> > >>> -plugin-opt=-pass-through=-lc --sysroot=/usr/x86_64-pc-linux-musl -m
> > >>> elf_x86_64 -static /usr/x86_64-pc-linux-musl/usr/lib/crt1.o
> > >>> /usr/x86_64-pc-linux-musl/usr/lib/crti.o
> > >>> /usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/crtbeginT.o
> > >>> -L/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0
> > >>> -L/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/../../../../x86_64-pc-linux-musl/lib
> > >>> -L/usr/x86_64-pc-linux-musl/lib -L/usr/x86_64-pc-linux-musl/usr/lib
> > >>> /tmp/ccHq7CL6.o --start-group -lgcc -lgcc_eh -lc --end-group
> > >>> /usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/crtend.o
> > >>> /usr/x86_64-pc-linux-musl/usr/lib/crtn.o
> > >>> COLLECT_GCC_OPTIONS='-v' '-static' '-O0' '-g' '-mtune=generic' '-march=x86-64'
> > >>>
> > >>> mtune=generic and march=x86-64 suggests it isn't trying to do
> > >>> something weird on the compile computer.
> > >> Indeed, it looks like the default is right. So you probably need to
> > >> check how musl was built. Is it also a package provided by Gentoo, and
> > >> did they perhaps use -march=native even though it's being cross
> > >> compiled?
> > >>
> > >> Rich
> >
> >
^ permalink raw reply [flat|nested] 13+ messages in thread
* Re: Illegal instruction in __copy_tls()
2019-06-05 23:32 ` tenspd137 .
@ 2019-06-05 23:34 ` Michael Everitt
2019-06-05 23:37 ` tenspd137 .
0 siblings, 1 reply; 13+ messages in thread
From: Michael Everitt @ 2019-06-05 23:34 UTC (permalink / raw)
To: musl
[-- Attachment #1.1: Type: text/plain, Size: 10747 bytes --]
Musl doesn't support multilib ... :] fyi
On 06/06/19 00:32, tenspd137 . wrote:
> Quick question - anyone know how to make a crossdev crosscompiler
> multilib so I can use -m32 when I compile?
>
> Thanks!
>
> On Wed, Jun 5, 2019 at 5:09 PM tenspd137 . <dcday137@gmail.com> wrote:
>> I probably don't fully understand how it works. In
>> /etc/x86_64-pc-linux-musl/etc.portage/make.conf, march is not
>> specified. It is specified in /etc/portage/make.conf. When I removed
>> it from there, things worked. Then I just put it back after using
>> crossdev to make x86_64-pc-linux-musl-*.
>>
>> Either way, loads of fun :)
>>
>> Thanks!
>>
>> -C
>>
>> On Wed, Jun 5, 2019 at 3:56 PM Michael Everitt <m.j.everitt@iee.org> wrote:
>>> In your /usr/${CTARGET}/etc/portage/make.conf you can set appropriate
>>> target flags there. But using 'march=native' is going to catch you out a
>>> lot cross-compiling anything ... :) At least if you've got it set to
>>> something, you're going to see errors that point immediately to your CFLAGS
>>> when/if it goes wrong!
>>>
>>> Michael.
>>>
>>> On 05/06/19 22:27, tenspd137 . wrote:
>>>> Thanks! That was indeed the problem. I had march=native for all
>>>> portage related stuff set, and my guess is that crossdev read that to
>>>> start. I removed that, reran the crossdev tool to buiild the cross
>>>> toolchain, and can now build static binaries that run on different
>>>> systems.
>>>>
>>>> Much appreciated!
>>>>
>>>> -C
>>>>
>>>> On Wed, Jun 5, 2019 at 2:07 PM Rich Felker <dalias@libc.org> wrote:
>>>>> On Wed, Jun 05, 2019 at 01:53:58PM -0600, tenspd137 . wrote:
>>>>>> Sure -
>>>>>>
>>>>>> strace -d -v ./a.out:
>>>>>> strace: ptrace_setoptions = 0x51
>>>>>> strace: new tcb for pid 26302, active tcbs:1
>>>>>> strace: [wait(0x80137f) = 26302] WIFSTOPPED,sig=SIGSTOP,EVENT_STOP (128)
>>>>>> strace: pid 26302 has TCB_STARTUP, initializing it
>>>>>> strace: [wait(0x80057f) = 26302] WIFSTOPPED,sig=SIGTRAP,EVENT_STOP (128)
>>>>>> strace: [wait(0x00127f) = 26302] WIFSTOPPED,sig=SIGCONT
>>>>>> strace: [wait(0x00857f) = 26302] WIFSTOPPED,sig=133
>>>>>> execve("./a.out", ["./a.out"], ["SSH_CONNECTION=15.86.136.27 5196"...,
>>>>>> "LANG=en_US.UTF-8", "XDG_SESSION_ID=41", "USER=dayd",
>>>>>> "PWD=/home/dayd/projects/musl-tes"..., "HOME=/home/dayd",
>>>>>> "SSH_CLIENT=xx.xxx.xxx.xx 51960 22", "CCACHE_DIR=/ssd/dayd/.ccache",
>>>>>> "VMWARE_USE_SHIPPED_GTK=yes", "XDG_DATA_DIRS=/usr/local/share:/"...,
>>>>>> "USECCACHE=ON", "SSH_TTY=/dev/pts/2", "MAIL=/var/mail/dayd",
>>>>>> "TERM=rxvt-unicode-256color", "SHELL=/bin/bash", "SHLVL=1",
>>>>>> "PYTHONPATH=:/home/dayd/projects/"..., "LOGNAME=dayd",
>>>>>> "DBUS_SESSION_BUS_ADDRESS=unix:pa"...,
>>>>>> "XDG_RUNTIME_DIR=/run/user/6686",
>>>>>> "PATH=/usr/lib/ccache/bin/:/usr/l"..., "USEDISTCC=OFF",
>>>>>> "_=/usr/bin/strace", "OLDPWD=/home/dayd/projects"]strace:
>>>>>> [wait(0x04057f) = 26302] WIFSTOPPED,sig=SIGTRAP,EVENT_EXEC (4)
>>>>>> strace: [wait(0x00857f) = 26302] WIFSTOPPED,sig=133
>>>>>> ) = 0
>>>>>> strace: [wait(0x00047f) = 26302] WIFSTOPPED,sig=SIGILL
>>>>>> --- SIGILL {si_signo=SIGILL, si_code=ILL_ILLOPN, si_addr=0x40169e} ---
>>>>>> strace: [wait(0x06057f) = 26302] WIFSTOPPED,sig=SIGTRAP,EVENT_EXIT (6)
>>>>>> strace: [wait(0x000084) = 26302] WIFSIGNALED,core,sig=SIGILL
>>>>>> +++ killed by SIGILL (core dumped) +++
>>>>>> strace: dropped tcb for pid 26302, 0 remain
>>>>>> Illegal instruction (core dumped)
>>>>>> ******************************************************************************************
>>>>>> (gdb) bt
>>>>>> #0 0x00000000004016ae in __copy_tls ()
>>>>>> #1 0x0000000000000000 in ?? ()
>>>>>> *****************************************************************************************
>>>>>>
>>>>>> (gdb) disassemble
>>>>>> Dump of assembler code for function __copy_tls:
>>>>>> 0x0000000000401680 <+0>: push %r13
>>>>>> 0x0000000000401682 <+2>: mov %rdi,%r13
>>>>>> 0x0000000000401685 <+5>: push %r12
>>>>>> 0x0000000000401687 <+7>: push %rbp
>>>>>> 0x0000000000401688 <+8>: push %rbx
>>>>>> 0x0000000000401689 <+9>: sub $0x8,%rsp
>>>>>> 0x000000000040168d <+13>: mov 0x410c(%rip),%rax #
>>>>>> 0x4057a0 <__libc+32>
>>>>>> 0x0000000000401694 <+20>: mov 0x410d(%rip),%rcx #
>>>>>> 0x4057a8 <__libc+40>
>>>>>> 0x000000000040169b <+27>: mov 0x40f6(%rip),%rbx #
>>>>>> 0x405798 <__libc+24>
>>>>>> 0x00000000004016a2 <+34>: lea -0xe0(%rdi,%rax,1),%rax
>>>>>> 0x00000000004016aa <+42>: lea -0x1(%rcx),%r12
>>>>>> => 0x00000000004016ae <+46>: andn %rax,%r12,%r12
>>>>> This instruction, andn, is not in the base x86_64 ISA. It's part of
>>>>> the BMI1 extension:
>>>>>
>>>>> https://en.wikipedia.org/wiki/Bit_Manipulation_Instruction_Sets#BMI1_(Bit_Manipulation_Instruction_Set_1)
>>>>>
>>>>> Apparently Gentoo is providing cross compilers that default to
>>>>> producing "native ISA level" code for the host, rather than baseline
>>>>> ISA for the target. But:
>>>>>
>>>>>> as a bonus (I thought this might also help):
>>>>>> (%:~/projects/musl-test)┌- x86_64-pc-linux-musl-gcc -v -static -O0 -g
>>>>>> hello.c
>>>>>> Using built-in specs.
>>>>>> COLLECT_GCC=x86_64-pc-linux-musl-gcc
>>>>>> COLLECT_LTO_WRAPPER=/usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/lto-wrapper
>>>>>> Target: x86_64-pc-linux-musl
>>>>>> Configured with:
>>>>>> /var/tmp/portage/cross-x86_64-pc-linux-musl/gcc-9.1.0/work/gcc-9.1.0/configure
>>>>>> --host=x86_64-pc-linux-gnu --target=x86_64-pc-linux-musl
>>>>>> --build=x86_64-pc-linux-gnu --prefix=/usr
>>>>>> --bindir=/usr/x86_64-pc-linux-gnu/x86_64-pc-linux-musl/gcc-bin/9.1.0
>>>>>> --includedir=/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/include
>>>>>> --datadir=/usr/share/gcc-data/x86_64-pc-linux-musl/9.1.0
>>>>>> --mandir=/usr/share/gcc-data/x86_64-pc-linux-musl/9.1.0/man
>>>>>> --infodir=/usr/share/gcc-data/x86_64-pc-linux-musl/9.1.0/info
>>>>>> --with-gxx-include-dir=/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/include/g++-v9
>>>>>> --with-python-dir=/share/gcc-data/x86_64-pc-linux-musl/9.1.0/python
>>>>>> --enable-languages=c,c++,fortran --enable-obsolete --enable-secureplt
>>>>>> --disable-werror --with-system-zlib --enable-nls
>>>>>> --without-included-gettext --enable-checking=release
>>>>>> --with-bugurl=https://bugs.gentoo.org/ --with-pkgversion='Gentoo 9.1.0
>>>>>> p1.0' --disable-esp --enable-libstdcxx-time
>>>>>> --enable-poison-system-directories
>>>>>> --with-sysroot=/usr/x86_64-pc-linux-musl --disable-bootstrap
>>>>>> --enable-__cxa_atexit --disable-multilib --with-multilib-list=m64
>>>>>> --disable-altivec --disable-fixed-point --enable-targets=all
>>>>>> --enable-libgomp --disable-libmudflap --disable-libssp
>>>>>> --disable-systemtap --disable-vtable-verify --disable-libvtv
>>>>>> --enable-lto --without-isl --disable-libsanitizer --enable-default-pie
>>>>>> --enable-default-ssp
>>>>>> Thread model: posix
>>>>>> gcc version 9.1.0 (Gentoo 9.1.0 p1.0)
>>>>>> COLLECT_GCC_OPTIONS='-v' '-static' '-O0' '-g' '-mtune=generic' '-march=x86-64'
>>>>>> /usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/cc1 -quiet -v hello.c
>>>>>> -quiet -dumpbase hello.c -mtune=generic -march=x86-64 -auxbase hello
>>>>>> -g -O0 -version -o /tmp/ccoTkh38.s
>>>>>> GNU C17 (Gentoo 9.1.0 p1.0) version 9.1.0 (x86_64-pc-linux-musl)
>>>>>> compiled by GNU C version 8.3.0, GMP version 6.1.2, MPFR version
>>>>>> 4.0.2, MPC version 1.1.0, isl version none
>>>>>> GGC heuristics: --param ggc-min-expand=100 --param ggc-min-heapsize=131072
>>>>>> ignoring nonexistent directory "/usr/x86_64-pc-linux-musl/usr/local/include"
>>>>>> ignoring nonexistent directory
>>>>>> "/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/../../../../x86_64-pc-linux-musl/include"
>>>>>> #include "..." search starts here:
>>>>>> #include <...> search starts here:
>>>>>> /usr/x86_64-pc-linux-musl/usr/include
>>>>>> /usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/include
>>>>>> End of search list.
>>>>>> GNU C17 (Gentoo 9.1.0 p1.0) version 9.1.0 (x86_64-pc-linux-musl)
>>>>>> compiled by GNU C version 8.3.0, GMP version 6.1.2, MPFR version
>>>>>> 4.0.2, MPC version 1.1.0, isl version none
>>>>>> GGC heuristics: --param ggc-min-expand=100 --param ggc-min-heapsize=131072
>>>>>> Compiler executable checksum: a3183e5f435d1938198d432af6db159b
>>>>>> COLLECT_GCC_OPTIONS='-v' '-static' '-O0' '-g' '-mtune=generic' '-march=x86-64'
>>>>>> /usr/libexec/gcc/x86_64-pc-linux-musl/as -v --64 -o /tmp/ccHq7CL6.o
>>>>>> /tmp/ccoTkh38.s
>>>>>> GNU assembler version 2.32.0 (x86_64-pc-linux-musl) using BFD version
>>>>>> (Gentoo 2.32 p2) 2.32.0
>>>>>> COMPILER_PATH=/usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/:/usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/:/usr/libexec/gcc/x86_64-pc-linux-musl/:/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/:/usr/lib/gcc/x86_64-pc-linux-musl/
>>>>>> LIBRARY_PATH=/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/:/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/../../../../x86_64-pc-linux-musl/lib/:/usr/x86_64-pc-linux-musl/lib/:/usr/x86_64-pc-linux-musl/usr/lib/
>>>>>> COLLECT_GCC_OPTIONS='-v' '-static' '-O0' '-g' '-mtune=generic' '-march=x86-64'
>>>>>> /usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/collect2 -plugin
>>>>>> /usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/liblto_plugin.so
>>>>>> -plugin-opt=/usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/lto-wrapper
>>>>>> -plugin-opt=-fresolution=/tmp/ccWcifv4.res
>>>>>> -plugin-opt=-pass-through=-lgcc -plugin-opt=-pass-through=-lgcc_eh
>>>>>> -plugin-opt=-pass-through=-lc --sysroot=/usr/x86_64-pc-linux-musl -m
>>>>>> elf_x86_64 -static /usr/x86_64-pc-linux-musl/usr/lib/crt1.o
>>>>>> /usr/x86_64-pc-linux-musl/usr/lib/crti.o
>>>>>> /usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/crtbeginT.o
>>>>>> -L/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0
>>>>>> -L/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/../../../../x86_64-pc-linux-musl/lib
>>>>>> -L/usr/x86_64-pc-linux-musl/lib -L/usr/x86_64-pc-linux-musl/usr/lib
>>>>>> /tmp/ccHq7CL6.o --start-group -lgcc -lgcc_eh -lc --end-group
>>>>>> /usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/crtend.o
>>>>>> /usr/x86_64-pc-linux-musl/usr/lib/crtn.o
>>>>>> COLLECT_GCC_OPTIONS='-v' '-static' '-O0' '-g' '-mtune=generic' '-march=x86-64'
>>>>>>
>>>>>> mtune=generic and march=x86-64 suggests it isn't trying to do
>>>>>> something weird on the compile computer.
>>>>> Indeed, it looks like the default is right. So you probably need to
>>>>> check how musl was built. Is it also a package provided by Gentoo, and
>>>>> did they perhaps use -march=native even though it's being cross
>>>>> compiled?
>>>>>
>>>>> Rich
>>>
[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 801 bytes --]
^ permalink raw reply [flat|nested] 13+ messages in thread
* Re: Illegal instruction in __copy_tls()
2019-06-05 23:34 ` Michael Everitt
@ 2019-06-05 23:37 ` tenspd137 .
2019-06-05 23:41 ` tenspd137 .
2019-06-06 0:24 ` Rich Felker
0 siblings, 2 replies; 13+ messages in thread
From: tenspd137 . @ 2019-06-05 23:37 UTC (permalink / raw)
To: musl
bummer.... Hmm - I wonder if an i686 cross compiler would work?
On Wed, Jun 5, 2019 at 5:34 PM Michael Everitt <m.j.everitt@iee.org> wrote:
>
> Musl doesn't support multilib ... :] fyi
>
> On 06/06/19 00:32, tenspd137 . wrote:
> > Quick question - anyone know how to make a crossdev crosscompiler
> > multilib so I can use -m32 when I compile?
> >
> > Thanks!
> >
> > On Wed, Jun 5, 2019 at 5:09 PM tenspd137 . <dcday137@gmail.com> wrote:
> >> I probably don't fully understand how it works. In
> >> /etc/x86_64-pc-linux-musl/etc.portage/make.conf, march is not
> >> specified. It is specified in /etc/portage/make.conf. When I removed
> >> it from there, things worked. Then I just put it back after using
> >> crossdev to make x86_64-pc-linux-musl-*.
> >>
> >> Either way, loads of fun :)
> >>
> >> Thanks!
> >>
> >> -C
> >>
> >> On Wed, Jun 5, 2019 at 3:56 PM Michael Everitt <m.j.everitt@iee.org> wrote:
> >>> In your /usr/${CTARGET}/etc/portage/make.conf you can set appropriate
> >>> target flags there. But using 'march=native' is going to catch you out a
> >>> lot cross-compiling anything ... :) At least if you've got it set to
> >>> something, you're going to see errors that point immediately to your CFLAGS
> >>> when/if it goes wrong!
> >>>
> >>> Michael.
> >>>
> >>> On 05/06/19 22:27, tenspd137 . wrote:
> >>>> Thanks! That was indeed the problem. I had march=native for all
> >>>> portage related stuff set, and my guess is that crossdev read that to
> >>>> start. I removed that, reran the crossdev tool to buiild the cross
> >>>> toolchain, and can now build static binaries that run on different
> >>>> systems.
> >>>>
> >>>> Much appreciated!
> >>>>
> >>>> -C
> >>>>
> >>>> On Wed, Jun 5, 2019 at 2:07 PM Rich Felker <dalias@libc.org> wrote:
> >>>>> On Wed, Jun 05, 2019 at 01:53:58PM -0600, tenspd137 . wrote:
> >>>>>> Sure -
> >>>>>>
> >>>>>> strace -d -v ./a.out:
> >>>>>> strace: ptrace_setoptions = 0x51
> >>>>>> strace: new tcb for pid 26302, active tcbs:1
> >>>>>> strace: [wait(0x80137f) = 26302] WIFSTOPPED,sig=SIGSTOP,EVENT_STOP (128)
> >>>>>> strace: pid 26302 has TCB_STARTUP, initializing it
> >>>>>> strace: [wait(0x80057f) = 26302] WIFSTOPPED,sig=SIGTRAP,EVENT_STOP (128)
> >>>>>> strace: [wait(0x00127f) = 26302] WIFSTOPPED,sig=SIGCONT
> >>>>>> strace: [wait(0x00857f) = 26302] WIFSTOPPED,sig=133
> >>>>>> execve("./a.out", ["./a.out"], ["SSH_CONNECTION=15.86.136.27 5196"...,
> >>>>>> "LANG=en_US.UTF-8", "XDG_SESSION_ID=41", "USER=dayd",
> >>>>>> "PWD=/home/dayd/projects/musl-tes"..., "HOME=/home/dayd",
> >>>>>> "SSH_CLIENT=xx.xxx.xxx.xx 51960 22", "CCACHE_DIR=/ssd/dayd/.ccache",
> >>>>>> "VMWARE_USE_SHIPPED_GTK=yes", "XDG_DATA_DIRS=/usr/local/share:/"...,
> >>>>>> "USECCACHE=ON", "SSH_TTY=/dev/pts/2", "MAIL=/var/mail/dayd",
> >>>>>> "TERM=rxvt-unicode-256color", "SHELL=/bin/bash", "SHLVL=1",
> >>>>>> "PYTHONPATH=:/home/dayd/projects/"..., "LOGNAME=dayd",
> >>>>>> "DBUS_SESSION_BUS_ADDRESS=unix:pa"...,
> >>>>>> "XDG_RUNTIME_DIR=/run/user/6686",
> >>>>>> "PATH=/usr/lib/ccache/bin/:/usr/l"..., "USEDISTCC=OFF",
> >>>>>> "_=/usr/bin/strace", "OLDPWD=/home/dayd/projects"]strace:
> >>>>>> [wait(0x04057f) = 26302] WIFSTOPPED,sig=SIGTRAP,EVENT_EXEC (4)
> >>>>>> strace: [wait(0x00857f) = 26302] WIFSTOPPED,sig=133
> >>>>>> ) = 0
> >>>>>> strace: [wait(0x00047f) = 26302] WIFSTOPPED,sig=SIGILL
> >>>>>> --- SIGILL {si_signo=SIGILL, si_code=ILL_ILLOPN, si_addr=0x40169e} ---
> >>>>>> strace: [wait(0x06057f) = 26302] WIFSTOPPED,sig=SIGTRAP,EVENT_EXIT (6)
> >>>>>> strace: [wait(0x000084) = 26302] WIFSIGNALED,core,sig=SIGILL
> >>>>>> +++ killed by SIGILL (core dumped) +++
> >>>>>> strace: dropped tcb for pid 26302, 0 remain
> >>>>>> Illegal instruction (core dumped)
> >>>>>> ******************************************************************************************
> >>>>>> (gdb) bt
> >>>>>> #0 0x00000000004016ae in __copy_tls ()
> >>>>>> #1 0x0000000000000000 in ?? ()
> >>>>>> *****************************************************************************************
> >>>>>>
> >>>>>> (gdb) disassemble
> >>>>>> Dump of assembler code for function __copy_tls:
> >>>>>> 0x0000000000401680 <+0>: push %r13
> >>>>>> 0x0000000000401682 <+2>: mov %rdi,%r13
> >>>>>> 0x0000000000401685 <+5>: push %r12
> >>>>>> 0x0000000000401687 <+7>: push %rbp
> >>>>>> 0x0000000000401688 <+8>: push %rbx
> >>>>>> 0x0000000000401689 <+9>: sub $0x8,%rsp
> >>>>>> 0x000000000040168d <+13>: mov 0x410c(%rip),%rax #
> >>>>>> 0x4057a0 <__libc+32>
> >>>>>> 0x0000000000401694 <+20>: mov 0x410d(%rip),%rcx #
> >>>>>> 0x4057a8 <__libc+40>
> >>>>>> 0x000000000040169b <+27>: mov 0x40f6(%rip),%rbx #
> >>>>>> 0x405798 <__libc+24>
> >>>>>> 0x00000000004016a2 <+34>: lea -0xe0(%rdi,%rax,1),%rax
> >>>>>> 0x00000000004016aa <+42>: lea -0x1(%rcx),%r12
> >>>>>> => 0x00000000004016ae <+46>: andn %rax,%r12,%r12
> >>>>> This instruction, andn, is not in the base x86_64 ISA. It's part of
> >>>>> the BMI1 extension:
> >>>>>
> >>>>> https://en.wikipedia.org/wiki/Bit_Manipulation_Instruction_Sets#BMI1_(Bit_Manipulation_Instruction_Set_1)
> >>>>>
> >>>>> Apparently Gentoo is providing cross compilers that default to
> >>>>> producing "native ISA level" code for the host, rather than baseline
> >>>>> ISA for the target. But:
> >>>>>
> >>>>>> as a bonus (I thought this might also help):
> >>>>>> (%:~/projects/musl-test)┌- x86_64-pc-linux-musl-gcc -v -static -O0 -g
> >>>>>> hello.c
> >>>>>> Using built-in specs.
> >>>>>> COLLECT_GCC=x86_64-pc-linux-musl-gcc
> >>>>>> COLLECT_LTO_WRAPPER=/usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/lto-wrapper
> >>>>>> Target: x86_64-pc-linux-musl
> >>>>>> Configured with:
> >>>>>> /var/tmp/portage/cross-x86_64-pc-linux-musl/gcc-9.1.0/work/gcc-9.1.0/configure
> >>>>>> --host=x86_64-pc-linux-gnu --target=x86_64-pc-linux-musl
> >>>>>> --build=x86_64-pc-linux-gnu --prefix=/usr
> >>>>>> --bindir=/usr/x86_64-pc-linux-gnu/x86_64-pc-linux-musl/gcc-bin/9.1.0
> >>>>>> --includedir=/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/include
> >>>>>> --datadir=/usr/share/gcc-data/x86_64-pc-linux-musl/9.1.0
> >>>>>> --mandir=/usr/share/gcc-data/x86_64-pc-linux-musl/9.1.0/man
> >>>>>> --infodir=/usr/share/gcc-data/x86_64-pc-linux-musl/9.1.0/info
> >>>>>> --with-gxx-include-dir=/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/include/g++-v9
> >>>>>> --with-python-dir=/share/gcc-data/x86_64-pc-linux-musl/9.1.0/python
> >>>>>> --enable-languages=c,c++,fortran --enable-obsolete --enable-secureplt
> >>>>>> --disable-werror --with-system-zlib --enable-nls
> >>>>>> --without-included-gettext --enable-checking=release
> >>>>>> --with-bugurl=https://bugs.gentoo.org/ --with-pkgversion='Gentoo 9.1.0
> >>>>>> p1.0' --disable-esp --enable-libstdcxx-time
> >>>>>> --enable-poison-system-directories
> >>>>>> --with-sysroot=/usr/x86_64-pc-linux-musl --disable-bootstrap
> >>>>>> --enable-__cxa_atexit --disable-multilib --with-multilib-list=m64
> >>>>>> --disable-altivec --disable-fixed-point --enable-targets=all
> >>>>>> --enable-libgomp --disable-libmudflap --disable-libssp
> >>>>>> --disable-systemtap --disable-vtable-verify --disable-libvtv
> >>>>>> --enable-lto --without-isl --disable-libsanitizer --enable-default-pie
> >>>>>> --enable-default-ssp
> >>>>>> Thread model: posix
> >>>>>> gcc version 9.1.0 (Gentoo 9.1.0 p1.0)
> >>>>>> COLLECT_GCC_OPTIONS='-v' '-static' '-O0' '-g' '-mtune=generic' '-march=x86-64'
> >>>>>> /usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/cc1 -quiet -v hello.c
> >>>>>> -quiet -dumpbase hello.c -mtune=generic -march=x86-64 -auxbase hello
> >>>>>> -g -O0 -version -o /tmp/ccoTkh38.s
> >>>>>> GNU C17 (Gentoo 9.1.0 p1.0) version 9.1.0 (x86_64-pc-linux-musl)
> >>>>>> compiled by GNU C version 8.3.0, GMP version 6.1.2, MPFR version
> >>>>>> 4.0.2, MPC version 1.1.0, isl version none
> >>>>>> GGC heuristics: --param ggc-min-expand=100 --param ggc-min-heapsize=131072
> >>>>>> ignoring nonexistent directory "/usr/x86_64-pc-linux-musl/usr/local/include"
> >>>>>> ignoring nonexistent directory
> >>>>>> "/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/../../../../x86_64-pc-linux-musl/include"
> >>>>>> #include "..." search starts here:
> >>>>>> #include <...> search starts here:
> >>>>>> /usr/x86_64-pc-linux-musl/usr/include
> >>>>>> /usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/include
> >>>>>> End of search list.
> >>>>>> GNU C17 (Gentoo 9.1.0 p1.0) version 9.1.0 (x86_64-pc-linux-musl)
> >>>>>> compiled by GNU C version 8.3.0, GMP version 6.1.2, MPFR version
> >>>>>> 4.0.2, MPC version 1.1.0, isl version none
> >>>>>> GGC heuristics: --param ggc-min-expand=100 --param ggc-min-heapsize=131072
> >>>>>> Compiler executable checksum: a3183e5f435d1938198d432af6db159b
> >>>>>> COLLECT_GCC_OPTIONS='-v' '-static' '-O0' '-g' '-mtune=generic' '-march=x86-64'
> >>>>>> /usr/libexec/gcc/x86_64-pc-linux-musl/as -v --64 -o /tmp/ccHq7CL6.o
> >>>>>> /tmp/ccoTkh38.s
> >>>>>> GNU assembler version 2.32.0 (x86_64-pc-linux-musl) using BFD version
> >>>>>> (Gentoo 2.32 p2) 2.32.0
> >>>>>> COMPILER_PATH=/usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/:/usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/:/usr/libexec/gcc/x86_64-pc-linux-musl/:/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/:/usr/lib/gcc/x86_64-pc-linux-musl/
> >>>>>> LIBRARY_PATH=/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/:/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/../../../../x86_64-pc-linux-musl/lib/:/usr/x86_64-pc-linux-musl/lib/:/usr/x86_64-pc-linux-musl/usr/lib/
> >>>>>> COLLECT_GCC_OPTIONS='-v' '-static' '-O0' '-g' '-mtune=generic' '-march=x86-64'
> >>>>>> /usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/collect2 -plugin
> >>>>>> /usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/liblto_plugin.so
> >>>>>> -plugin-opt=/usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/lto-wrapper
> >>>>>> -plugin-opt=-fresolution=/tmp/ccWcifv4.res
> >>>>>> -plugin-opt=-pass-through=-lgcc -plugin-opt=-pass-through=-lgcc_eh
> >>>>>> -plugin-opt=-pass-through=-lc --sysroot=/usr/x86_64-pc-linux-musl -m
> >>>>>> elf_x86_64 -static /usr/x86_64-pc-linux-musl/usr/lib/crt1.o
> >>>>>> /usr/x86_64-pc-linux-musl/usr/lib/crti.o
> >>>>>> /usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/crtbeginT.o
> >>>>>> -L/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0
> >>>>>> -L/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/../../../../x86_64-pc-linux-musl/lib
> >>>>>> -L/usr/x86_64-pc-linux-musl/lib -L/usr/x86_64-pc-linux-musl/usr/lib
> >>>>>> /tmp/ccHq7CL6.o --start-group -lgcc -lgcc_eh -lc --end-group
> >>>>>> /usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/crtend.o
> >>>>>> /usr/x86_64-pc-linux-musl/usr/lib/crtn.o
> >>>>>> COLLECT_GCC_OPTIONS='-v' '-static' '-O0' '-g' '-mtune=generic' '-march=x86-64'
> >>>>>>
> >>>>>> mtune=generic and march=x86-64 suggests it isn't trying to do
> >>>>>> something weird on the compile computer.
> >>>>> Indeed, it looks like the default is right. So you probably need to
> >>>>> check how musl was built. Is it also a package provided by Gentoo, and
> >>>>> did they perhaps use -march=native even though it's being cross
> >>>>> compiled?
> >>>>>
> >>>>> Rich
> >>>
>
>
^ permalink raw reply [flat|nested] 13+ messages in thread
* Re: Illegal instruction in __copy_tls()
2019-06-05 23:37 ` tenspd137 .
@ 2019-06-05 23:41 ` tenspd137 .
2019-06-06 0:24 ` Rich Felker
1 sibling, 0 replies; 13+ messages in thread
From: tenspd137 . @ 2019-06-05 23:41 UTC (permalink / raw)
To: musl
Unfortunatley, I have the task of compiling something that needs to be
32 bit and run it on an x86_64, and I need to be able to make it
static. *sigh*
On Wed, Jun 5, 2019 at 5:37 PM tenspd137 . <dcday137@gmail.com> wrote:
>
> bummer.... Hmm - I wonder if an i686 cross compiler would work?
>
> On Wed, Jun 5, 2019 at 5:34 PM Michael Everitt <m.j.everitt@iee.org> wrote:
> >
> > Musl doesn't support multilib ... :] fyi
> >
> > On 06/06/19 00:32, tenspd137 . wrote:
> > > Quick question - anyone know how to make a crossdev crosscompiler
> > > multilib so I can use -m32 when I compile?
> > >
> > > Thanks!
> > >
> > > On Wed, Jun 5, 2019 at 5:09 PM tenspd137 . <dcday137@gmail.com> wrote:
> > >> I probably don't fully understand how it works. In
> > >> /etc/x86_64-pc-linux-musl/etc.portage/make.conf, march is not
> > >> specified. It is specified in /etc/portage/make.conf. When I removed
> > >> it from there, things worked. Then I just put it back after using
> > >> crossdev to make x86_64-pc-linux-musl-*.
> > >>
> > >> Either way, loads of fun :)
> > >>
> > >> Thanks!
> > >>
> > >> -C
> > >>
> > >> On Wed, Jun 5, 2019 at 3:56 PM Michael Everitt <m.j.everitt@iee.org> wrote:
> > >>> In your /usr/${CTARGET}/etc/portage/make.conf you can set appropriate
> > >>> target flags there. But using 'march=native' is going to catch you out a
> > >>> lot cross-compiling anything ... :) At least if you've got it set to
> > >>> something, you're going to see errors that point immediately to your CFLAGS
> > >>> when/if it goes wrong!
> > >>>
> > >>> Michael.
> > >>>
> > >>> On 05/06/19 22:27, tenspd137 . wrote:
> > >>>> Thanks! That was indeed the problem. I had march=native for all
> > >>>> portage related stuff set, and my guess is that crossdev read that to
> > >>>> start. I removed that, reran the crossdev tool to buiild the cross
> > >>>> toolchain, and can now build static binaries that run on different
> > >>>> systems.
> > >>>>
> > >>>> Much appreciated!
> > >>>>
> > >>>> -C
> > >>>>
> > >>>> On Wed, Jun 5, 2019 at 2:07 PM Rich Felker <dalias@libc.org> wrote:
> > >>>>> On Wed, Jun 05, 2019 at 01:53:58PM -0600, tenspd137 . wrote:
> > >>>>>> Sure -
> > >>>>>>
> > >>>>>> strace -d -v ./a.out:
> > >>>>>> strace: ptrace_setoptions = 0x51
> > >>>>>> strace: new tcb for pid 26302, active tcbs:1
> > >>>>>> strace: [wait(0x80137f) = 26302] WIFSTOPPED,sig=SIGSTOP,EVENT_STOP (128)
> > >>>>>> strace: pid 26302 has TCB_STARTUP, initializing it
> > >>>>>> strace: [wait(0x80057f) = 26302] WIFSTOPPED,sig=SIGTRAP,EVENT_STOP (128)
> > >>>>>> strace: [wait(0x00127f) = 26302] WIFSTOPPED,sig=SIGCONT
> > >>>>>> strace: [wait(0x00857f) = 26302] WIFSTOPPED,sig=133
> > >>>>>> execve("./a.out", ["./a.out"], ["SSH_CONNECTION=15.86.136.27 5196"...,
> > >>>>>> "LANG=en_US.UTF-8", "XDG_SESSION_ID=41", "USER=dayd",
> > >>>>>> "PWD=/home/dayd/projects/musl-tes"..., "HOME=/home/dayd",
> > >>>>>> "SSH_CLIENT=xx.xxx.xxx.xx 51960 22", "CCACHE_DIR=/ssd/dayd/.ccache",
> > >>>>>> "VMWARE_USE_SHIPPED_GTK=yes", "XDG_DATA_DIRS=/usr/local/share:/"...,
> > >>>>>> "USECCACHE=ON", "SSH_TTY=/dev/pts/2", "MAIL=/var/mail/dayd",
> > >>>>>> "TERM=rxvt-unicode-256color", "SHELL=/bin/bash", "SHLVL=1",
> > >>>>>> "PYTHONPATH=:/home/dayd/projects/"..., "LOGNAME=dayd",
> > >>>>>> "DBUS_SESSION_BUS_ADDRESS=unix:pa"...,
> > >>>>>> "XDG_RUNTIME_DIR=/run/user/6686",
> > >>>>>> "PATH=/usr/lib/ccache/bin/:/usr/l"..., "USEDISTCC=OFF",
> > >>>>>> "_=/usr/bin/strace", "OLDPWD=/home/dayd/projects"]strace:
> > >>>>>> [wait(0x04057f) = 26302] WIFSTOPPED,sig=SIGTRAP,EVENT_EXEC (4)
> > >>>>>> strace: [wait(0x00857f) = 26302] WIFSTOPPED,sig=133
> > >>>>>> ) = 0
> > >>>>>> strace: [wait(0x00047f) = 26302] WIFSTOPPED,sig=SIGILL
> > >>>>>> --- SIGILL {si_signo=SIGILL, si_code=ILL_ILLOPN, si_addr=0x40169e} ---
> > >>>>>> strace: [wait(0x06057f) = 26302] WIFSTOPPED,sig=SIGTRAP,EVENT_EXIT (6)
> > >>>>>> strace: [wait(0x000084) = 26302] WIFSIGNALED,core,sig=SIGILL
> > >>>>>> +++ killed by SIGILL (core dumped) +++
> > >>>>>> strace: dropped tcb for pid 26302, 0 remain
> > >>>>>> Illegal instruction (core dumped)
> > >>>>>> ******************************************************************************************
> > >>>>>> (gdb) bt
> > >>>>>> #0 0x00000000004016ae in __copy_tls ()
> > >>>>>> #1 0x0000000000000000 in ?? ()
> > >>>>>> *****************************************************************************************
> > >>>>>>
> > >>>>>> (gdb) disassemble
> > >>>>>> Dump of assembler code for function __copy_tls:
> > >>>>>> 0x0000000000401680 <+0>: push %r13
> > >>>>>> 0x0000000000401682 <+2>: mov %rdi,%r13
> > >>>>>> 0x0000000000401685 <+5>: push %r12
> > >>>>>> 0x0000000000401687 <+7>: push %rbp
> > >>>>>> 0x0000000000401688 <+8>: push %rbx
> > >>>>>> 0x0000000000401689 <+9>: sub $0x8,%rsp
> > >>>>>> 0x000000000040168d <+13>: mov 0x410c(%rip),%rax #
> > >>>>>> 0x4057a0 <__libc+32>
> > >>>>>> 0x0000000000401694 <+20>: mov 0x410d(%rip),%rcx #
> > >>>>>> 0x4057a8 <__libc+40>
> > >>>>>> 0x000000000040169b <+27>: mov 0x40f6(%rip),%rbx #
> > >>>>>> 0x405798 <__libc+24>
> > >>>>>> 0x00000000004016a2 <+34>: lea -0xe0(%rdi,%rax,1),%rax
> > >>>>>> 0x00000000004016aa <+42>: lea -0x1(%rcx),%r12
> > >>>>>> => 0x00000000004016ae <+46>: andn %rax,%r12,%r12
> > >>>>> This instruction, andn, is not in the base x86_64 ISA. It's part of
> > >>>>> the BMI1 extension:
> > >>>>>
> > >>>>> https://en.wikipedia.org/wiki/Bit_Manipulation_Instruction_Sets#BMI1_(Bit_Manipulation_Instruction_Set_1)
> > >>>>>
> > >>>>> Apparently Gentoo is providing cross compilers that default to
> > >>>>> producing "native ISA level" code for the host, rather than baseline
> > >>>>> ISA for the target. But:
> > >>>>>
> > >>>>>> as a bonus (I thought this might also help):
> > >>>>>> (%:~/projects/musl-test)┌- x86_64-pc-linux-musl-gcc -v -static -O0 -g
> > >>>>>> hello.c
> > >>>>>> Using built-in specs.
> > >>>>>> COLLECT_GCC=x86_64-pc-linux-musl-gcc
> > >>>>>> COLLECT_LTO_WRAPPER=/usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/lto-wrapper
> > >>>>>> Target: x86_64-pc-linux-musl
> > >>>>>> Configured with:
> > >>>>>> /var/tmp/portage/cross-x86_64-pc-linux-musl/gcc-9.1.0/work/gcc-9.1.0/configure
> > >>>>>> --host=x86_64-pc-linux-gnu --target=x86_64-pc-linux-musl
> > >>>>>> --build=x86_64-pc-linux-gnu --prefix=/usr
> > >>>>>> --bindir=/usr/x86_64-pc-linux-gnu/x86_64-pc-linux-musl/gcc-bin/9.1.0
> > >>>>>> --includedir=/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/include
> > >>>>>> --datadir=/usr/share/gcc-data/x86_64-pc-linux-musl/9.1.0
> > >>>>>> --mandir=/usr/share/gcc-data/x86_64-pc-linux-musl/9.1.0/man
> > >>>>>> --infodir=/usr/share/gcc-data/x86_64-pc-linux-musl/9.1.0/info
> > >>>>>> --with-gxx-include-dir=/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/include/g++-v9
> > >>>>>> --with-python-dir=/share/gcc-data/x86_64-pc-linux-musl/9.1.0/python
> > >>>>>> --enable-languages=c,c++,fortran --enable-obsolete --enable-secureplt
> > >>>>>> --disable-werror --with-system-zlib --enable-nls
> > >>>>>> --without-included-gettext --enable-checking=release
> > >>>>>> --with-bugurl=https://bugs.gentoo.org/ --with-pkgversion='Gentoo 9.1.0
> > >>>>>> p1.0' --disable-esp --enable-libstdcxx-time
> > >>>>>> --enable-poison-system-directories
> > >>>>>> --with-sysroot=/usr/x86_64-pc-linux-musl --disable-bootstrap
> > >>>>>> --enable-__cxa_atexit --disable-multilib --with-multilib-list=m64
> > >>>>>> --disable-altivec --disable-fixed-point --enable-targets=all
> > >>>>>> --enable-libgomp --disable-libmudflap --disable-libssp
> > >>>>>> --disable-systemtap --disable-vtable-verify --disable-libvtv
> > >>>>>> --enable-lto --without-isl --disable-libsanitizer --enable-default-pie
> > >>>>>> --enable-default-ssp
> > >>>>>> Thread model: posix
> > >>>>>> gcc version 9.1.0 (Gentoo 9.1.0 p1.0)
> > >>>>>> COLLECT_GCC_OPTIONS='-v' '-static' '-O0' '-g' '-mtune=generic' '-march=x86-64'
> > >>>>>> /usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/cc1 -quiet -v hello.c
> > >>>>>> -quiet -dumpbase hello.c -mtune=generic -march=x86-64 -auxbase hello
> > >>>>>> -g -O0 -version -o /tmp/ccoTkh38.s
> > >>>>>> GNU C17 (Gentoo 9.1.0 p1.0) version 9.1.0 (x86_64-pc-linux-musl)
> > >>>>>> compiled by GNU C version 8.3.0, GMP version 6.1.2, MPFR version
> > >>>>>> 4.0.2, MPC version 1.1.0, isl version none
> > >>>>>> GGC heuristics: --param ggc-min-expand=100 --param ggc-min-heapsize=131072
> > >>>>>> ignoring nonexistent directory "/usr/x86_64-pc-linux-musl/usr/local/include"
> > >>>>>> ignoring nonexistent directory
> > >>>>>> "/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/../../../../x86_64-pc-linux-musl/include"
> > >>>>>> #include "..." search starts here:
> > >>>>>> #include <...> search starts here:
> > >>>>>> /usr/x86_64-pc-linux-musl/usr/include
> > >>>>>> /usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/include
> > >>>>>> End of search list.
> > >>>>>> GNU C17 (Gentoo 9.1.0 p1.0) version 9.1.0 (x86_64-pc-linux-musl)
> > >>>>>> compiled by GNU C version 8.3.0, GMP version 6.1.2, MPFR version
> > >>>>>> 4.0.2, MPC version 1.1.0, isl version none
> > >>>>>> GGC heuristics: --param ggc-min-expand=100 --param ggc-min-heapsize=131072
> > >>>>>> Compiler executable checksum: a3183e5f435d1938198d432af6db159b
> > >>>>>> COLLECT_GCC_OPTIONS='-v' '-static' '-O0' '-g' '-mtune=generic' '-march=x86-64'
> > >>>>>> /usr/libexec/gcc/x86_64-pc-linux-musl/as -v --64 -o /tmp/ccHq7CL6.o
> > >>>>>> /tmp/ccoTkh38.s
> > >>>>>> GNU assembler version 2.32.0 (x86_64-pc-linux-musl) using BFD version
> > >>>>>> (Gentoo 2.32 p2) 2.32.0
> > >>>>>> COMPILER_PATH=/usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/:/usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/:/usr/libexec/gcc/x86_64-pc-linux-musl/:/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/:/usr/lib/gcc/x86_64-pc-linux-musl/
> > >>>>>> LIBRARY_PATH=/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/:/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/../../../../x86_64-pc-linux-musl/lib/:/usr/x86_64-pc-linux-musl/lib/:/usr/x86_64-pc-linux-musl/usr/lib/
> > >>>>>> COLLECT_GCC_OPTIONS='-v' '-static' '-O0' '-g' '-mtune=generic' '-march=x86-64'
> > >>>>>> /usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/collect2 -plugin
> > >>>>>> /usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/liblto_plugin.so
> > >>>>>> -plugin-opt=/usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/lto-wrapper
> > >>>>>> -plugin-opt=-fresolution=/tmp/ccWcifv4.res
> > >>>>>> -plugin-opt=-pass-through=-lgcc -plugin-opt=-pass-through=-lgcc_eh
> > >>>>>> -plugin-opt=-pass-through=-lc --sysroot=/usr/x86_64-pc-linux-musl -m
> > >>>>>> elf_x86_64 -static /usr/x86_64-pc-linux-musl/usr/lib/crt1.o
> > >>>>>> /usr/x86_64-pc-linux-musl/usr/lib/crti.o
> > >>>>>> /usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/crtbeginT.o
> > >>>>>> -L/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0
> > >>>>>> -L/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/../../../../x86_64-pc-linux-musl/lib
> > >>>>>> -L/usr/x86_64-pc-linux-musl/lib -L/usr/x86_64-pc-linux-musl/usr/lib
> > >>>>>> /tmp/ccHq7CL6.o --start-group -lgcc -lgcc_eh -lc --end-group
> > >>>>>> /usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/crtend.o
> > >>>>>> /usr/x86_64-pc-linux-musl/usr/lib/crtn.o
> > >>>>>> COLLECT_GCC_OPTIONS='-v' '-static' '-O0' '-g' '-mtune=generic' '-march=x86-64'
> > >>>>>>
> > >>>>>> mtune=generic and march=x86-64 suggests it isn't trying to do
> > >>>>>> something weird on the compile computer.
> > >>>>> Indeed, it looks like the default is right. So you probably need to
> > >>>>> check how musl was built. Is it also a package provided by Gentoo, and
> > >>>>> did they perhaps use -march=native even though it's being cross
> > >>>>> compiled?
> > >>>>>
> > >>>>> Rich
> > >>>
> >
> >
^ permalink raw reply [flat|nested] 13+ messages in thread
* Re: Illegal instruction in __copy_tls()
2019-06-05 23:37 ` tenspd137 .
2019-06-05 23:41 ` tenspd137 .
@ 2019-06-06 0:24 ` Rich Felker
2019-06-06 0:34 ` tenspd137 .
1 sibling, 1 reply; 13+ messages in thread
From: Rich Felker @ 2019-06-06 0:24 UTC (permalink / raw)
To: tenspd137 .; +Cc: musl
On Wed, Jun 05, 2019 at 05:37:49PM -0600, tenspd137 . wrote:
> bummer.... Hmm - I wonder if an i686 cross compiler would work?
Yes, you can do that. It's just that gcc's multilib dir layout is not
compatible with musl -- it assumes library headers can be shared
between 32- and 64-bit versions of "the same" arch rather than
treating them as completely separate things.
Rich
> On Wed, Jun 5, 2019 at 5:34 PM Michael Everitt <m.j.everitt@iee.org> wrote:
> >
> > Musl doesn't support multilib ... :] fyi
> >
> > On 06/06/19 00:32, tenspd137 . wrote:
> > > Quick question - anyone know how to make a crossdev crosscompiler
> > > multilib so I can use -m32 when I compile?
> > >
> > > Thanks!
> > >
> > > On Wed, Jun 5, 2019 at 5:09 PM tenspd137 . <dcday137@gmail.com> wrote:
> > >> I probably don't fully understand how it works. In
> > >> /etc/x86_64-pc-linux-musl/etc.portage/make.conf, march is not
> > >> specified. It is specified in /etc/portage/make.conf. When I removed
> > >> it from there, things worked. Then I just put it back after using
> > >> crossdev to make x86_64-pc-linux-musl-*.
> > >>
> > >> Either way, loads of fun :)
> > >>
> > >> Thanks!
> > >>
> > >> -C
> > >>
> > >> On Wed, Jun 5, 2019 at 3:56 PM Michael Everitt <m.j.everitt@iee.org> wrote:
> > >>> In your /usr/${CTARGET}/etc/portage/make.conf you can set appropriate
> > >>> target flags there. But using 'march=native' is going to catch you out a
> > >>> lot cross-compiling anything ... :) At least if you've got it set to
> > >>> something, you're going to see errors that point immediately to your CFLAGS
> > >>> when/if it goes wrong!
> > >>>
> > >>> Michael.
> > >>>
> > >>> On 05/06/19 22:27, tenspd137 . wrote:
> > >>>> Thanks! That was indeed the problem. I had march=native for all
> > >>>> portage related stuff set, and my guess is that crossdev read that to
> > >>>> start. I removed that, reran the crossdev tool to buiild the cross
> > >>>> toolchain, and can now build static binaries that run on different
> > >>>> systems.
> > >>>>
> > >>>> Much appreciated!
> > >>>>
> > >>>> -C
> > >>>>
> > >>>> On Wed, Jun 5, 2019 at 2:07 PM Rich Felker <dalias@libc.org> wrote:
> > >>>>> On Wed, Jun 05, 2019 at 01:53:58PM -0600, tenspd137 . wrote:
> > >>>>>> Sure -
> > >>>>>>
> > >>>>>> strace -d -v ./a.out:
> > >>>>>> strace: ptrace_setoptions = 0x51
> > >>>>>> strace: new tcb for pid 26302, active tcbs:1
> > >>>>>> strace: [wait(0x80137f) = 26302] WIFSTOPPED,sig=SIGSTOP,EVENT_STOP (128)
> > >>>>>> strace: pid 26302 has TCB_STARTUP, initializing it
> > >>>>>> strace: [wait(0x80057f) = 26302] WIFSTOPPED,sig=SIGTRAP,EVENT_STOP (128)
> > >>>>>> strace: [wait(0x00127f) = 26302] WIFSTOPPED,sig=SIGCONT
> > >>>>>> strace: [wait(0x00857f) = 26302] WIFSTOPPED,sig=133
> > >>>>>> execve("./a.out", ["./a.out"], ["SSH_CONNECTION=15.86.136.27 5196"...,
> > >>>>>> "LANG=en_US.UTF-8", "XDG_SESSION_ID=41", "USER=dayd",
> > >>>>>> "PWD=/home/dayd/projects/musl-tes"..., "HOME=/home/dayd",
> > >>>>>> "SSH_CLIENT=xx.xxx.xxx.xx 51960 22", "CCACHE_DIR=/ssd/dayd/.ccache",
> > >>>>>> "VMWARE_USE_SHIPPED_GTK=yes", "XDG_DATA_DIRS=/usr/local/share:/"...,
> > >>>>>> "USECCACHE=ON", "SSH_TTY=/dev/pts/2", "MAIL=/var/mail/dayd",
> > >>>>>> "TERM=rxvt-unicode-256color", "SHELL=/bin/bash", "SHLVL=1",
> > >>>>>> "PYTHONPATH=:/home/dayd/projects/"..., "LOGNAME=dayd",
> > >>>>>> "DBUS_SESSION_BUS_ADDRESS=unix:pa"...,
> > >>>>>> "XDG_RUNTIME_DIR=/run/user/6686",
> > >>>>>> "PATH=/usr/lib/ccache/bin/:/usr/l"..., "USEDISTCC=OFF",
> > >>>>>> "_=/usr/bin/strace", "OLDPWD=/home/dayd/projects"]strace:
> > >>>>>> [wait(0x04057f) = 26302] WIFSTOPPED,sig=SIGTRAP,EVENT_EXEC (4)
> > >>>>>> strace: [wait(0x00857f) = 26302] WIFSTOPPED,sig=133
> > >>>>>> ) = 0
> > >>>>>> strace: [wait(0x00047f) = 26302] WIFSTOPPED,sig=SIGILL
> > >>>>>> --- SIGILL {si_signo=SIGILL, si_code=ILL_ILLOPN, si_addr=0x40169e} ---
> > >>>>>> strace: [wait(0x06057f) = 26302] WIFSTOPPED,sig=SIGTRAP,EVENT_EXIT (6)
> > >>>>>> strace: [wait(0x000084) = 26302] WIFSIGNALED,core,sig=SIGILL
> > >>>>>> +++ killed by SIGILL (core dumped) +++
> > >>>>>> strace: dropped tcb for pid 26302, 0 remain
> > >>>>>> Illegal instruction (core dumped)
> > >>>>>> ******************************************************************************************
> > >>>>>> (gdb) bt
> > >>>>>> #0 0x00000000004016ae in __copy_tls ()
> > >>>>>> #1 0x0000000000000000 in ?? ()
> > >>>>>> *****************************************************************************************
> > >>>>>>
> > >>>>>> (gdb) disassemble
> > >>>>>> Dump of assembler code for function __copy_tls:
> > >>>>>> 0x0000000000401680 <+0>: push %r13
> > >>>>>> 0x0000000000401682 <+2>: mov %rdi,%r13
> > >>>>>> 0x0000000000401685 <+5>: push %r12
> > >>>>>> 0x0000000000401687 <+7>: push %rbp
> > >>>>>> 0x0000000000401688 <+8>: push %rbx
> > >>>>>> 0x0000000000401689 <+9>: sub $0x8,%rsp
> > >>>>>> 0x000000000040168d <+13>: mov 0x410c(%rip),%rax #
> > >>>>>> 0x4057a0 <__libc+32>
> > >>>>>> 0x0000000000401694 <+20>: mov 0x410d(%rip),%rcx #
> > >>>>>> 0x4057a8 <__libc+40>
> > >>>>>> 0x000000000040169b <+27>: mov 0x40f6(%rip),%rbx #
> > >>>>>> 0x405798 <__libc+24>
> > >>>>>> 0x00000000004016a2 <+34>: lea -0xe0(%rdi,%rax,1),%rax
> > >>>>>> 0x00000000004016aa <+42>: lea -0x1(%rcx),%r12
> > >>>>>> => 0x00000000004016ae <+46>: andn %rax,%r12,%r12
> > >>>>> This instruction, andn, is not in the base x86_64 ISA. It's part of
> > >>>>> the BMI1 extension:
> > >>>>>
> > >>>>> https://en.wikipedia.org/wiki/Bit_Manipulation_Instruction_Sets#BMI1_(Bit_Manipulation_Instruction_Set_1)
> > >>>>>
> > >>>>> Apparently Gentoo is providing cross compilers that default to
> > >>>>> producing "native ISA level" code for the host, rather than baseline
> > >>>>> ISA for the target. But:
> > >>>>>
> > >>>>>> as a bonus (I thought this might also help):
> > >>>>>> (%:~/projects/musl-test)┌- x86_64-pc-linux-musl-gcc -v -static -O0 -g
> > >>>>>> hello.c
> > >>>>>> Using built-in specs.
> > >>>>>> COLLECT_GCC=x86_64-pc-linux-musl-gcc
> > >>>>>> COLLECT_LTO_WRAPPER=/usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/lto-wrapper
> > >>>>>> Target: x86_64-pc-linux-musl
> > >>>>>> Configured with:
> > >>>>>> /var/tmp/portage/cross-x86_64-pc-linux-musl/gcc-9.1.0/work/gcc-9.1..0/configure
> > >>>>>> --host=x86_64-pc-linux-gnu --target=x86_64-pc-linux-musl
> > >>>>>> --build=x86_64-pc-linux-gnu --prefix=/usr
> > >>>>>> --bindir=/usr/x86_64-pc-linux-gnu/x86_64-pc-linux-musl/gcc-bin/9..1.0
> > >>>>>> --includedir=/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/include
> > >>>>>> --datadir=/usr/share/gcc-data/x86_64-pc-linux-musl/9.1.0
> > >>>>>> --mandir=/usr/share/gcc-data/x86_64-pc-linux-musl/9.1.0/man
> > >>>>>> --infodir=/usr/share/gcc-data/x86_64-pc-linux-musl/9.1.0/info
> > >>>>>> --with-gxx-include-dir=/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/include/g++-v9
> > >>>>>> --with-python-dir=/share/gcc-data/x86_64-pc-linux-musl/9.1.0/python
> > >>>>>> --enable-languages=c,c++,fortran --enable-obsolete --enable-secureplt
> > >>>>>> --disable-werror --with-system-zlib --enable-nls
> > >>>>>> --without-included-gettext --enable-checking=release
> > >>>>>> --with-bugurl=https://bugs.gentoo.org/ --with-pkgversion='Gentoo 9.1.0
> > >>>>>> p1.0' --disable-esp --enable-libstdcxx-time
> > >>>>>> --enable-poison-system-directories
> > >>>>>> --with-sysroot=/usr/x86_64-pc-linux-musl --disable-bootstrap
> > >>>>>> --enable-__cxa_atexit --disable-multilib --with-multilib-list=m64
> > >>>>>> --disable-altivec --disable-fixed-point --enable-targets=all
> > >>>>>> --enable-libgomp --disable-libmudflap --disable-libssp
> > >>>>>> --disable-systemtap --disable-vtable-verify --disable-libvtv
> > >>>>>> --enable-lto --without-isl --disable-libsanitizer --enable-default-pie
> > >>>>>> --enable-default-ssp
> > >>>>>> Thread model: posix
> > >>>>>> gcc version 9.1.0 (Gentoo 9.1.0 p1.0)
> > >>>>>> COLLECT_GCC_OPTIONS='-v' '-static' '-O0' '-g' '-mtune=generic' '-march=x86-64'
> > >>>>>> /usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/cc1 -quiet -v hello.c
> > >>>>>> -quiet -dumpbase hello.c -mtune=generic -march=x86-64 -auxbase hello
> > >>>>>> -g -O0 -version -o /tmp/ccoTkh38.s
> > >>>>>> GNU C17 (Gentoo 9.1.0 p1.0) version 9.1.0 (x86_64-pc-linux-musl)
> > >>>>>> compiled by GNU C version 8.3.0, GMP version 6.1.2, MPFR version
> > >>>>>> 4.0.2, MPC version 1.1.0, isl version none
> > >>>>>> GGC heuristics: --param ggc-min-expand=100 --param ggc-min-heapsize=131072
> > >>>>>> ignoring nonexistent directory "/usr/x86_64-pc-linux-musl/usr/local/include"
> > >>>>>> ignoring nonexistent directory
> > >>>>>> "/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/../../../../x86_64-pc-linux-musl/include"
> > >>>>>> #include "..." search starts here:
> > >>>>>> #include <...> search starts here:
> > >>>>>> /usr/x86_64-pc-linux-musl/usr/include
> > >>>>>> /usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/include
> > >>>>>> End of search list.
> > >>>>>> GNU C17 (Gentoo 9.1.0 p1.0) version 9.1.0 (x86_64-pc-linux-musl)
> > >>>>>> compiled by GNU C version 8.3.0, GMP version 6.1.2, MPFR version
> > >>>>>> 4.0.2, MPC version 1.1.0, isl version none
> > >>>>>> GGC heuristics: --param ggc-min-expand=100 --param ggc-min-heapsize=131072
> > >>>>>> Compiler executable checksum: a3183e5f435d1938198d432af6db159b
> > >>>>>> COLLECT_GCC_OPTIONS='-v' '-static' '-O0' '-g' '-mtune=generic' '-march=x86-64'
> > >>>>>> /usr/libexec/gcc/x86_64-pc-linux-musl/as -v --64 -o /tmp/ccHq7CL6..o
> > >>>>>> /tmp/ccoTkh38.s
> > >>>>>> GNU assembler version 2.32.0 (x86_64-pc-linux-musl) using BFD version
> > >>>>>> (Gentoo 2.32 p2) 2.32.0
> > >>>>>> COMPILER_PATH=/usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/:/usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/:/usr/libexec/gcc/x86_64-pc-linux-musl/:/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/:/usr/lib/gcc/x86_64-pc-linux-musl/
> > >>>>>> LIBRARY_PATH=/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/:/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/../../../../x86_64-pc-linux-musl/lib/:/usr/x86_64-pc-linux-musl/lib/:/usr/x86_64-pc-linux-musl/usr/lib/
> > >>>>>> COLLECT_GCC_OPTIONS='-v' '-static' '-O0' '-g' '-mtune=generic' '-march=x86-64'
> > >>>>>> /usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/collect2 -plugin
> > >>>>>> /usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/liblto_plugin.so
> > >>>>>> -plugin-opt=/usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/lto-wrapper
> > >>>>>> -plugin-opt=-fresolution=/tmp/ccWcifv4.res
> > >>>>>> -plugin-opt=-pass-through=-lgcc -plugin-opt=-pass-through=-lgcc_eh
> > >>>>>> -plugin-opt=-pass-through=-lc --sysroot=/usr/x86_64-pc-linux-musl -m
> > >>>>>> elf_x86_64 -static /usr/x86_64-pc-linux-musl/usr/lib/crt1.o
> > >>>>>> /usr/x86_64-pc-linux-musl/usr/lib/crti.o
> > >>>>>> /usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/crtbeginT.o
> > >>>>>> -L/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0
> > >>>>>> -L/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/../../../../x86_64-pc-linux-musl/lib
> > >>>>>> -L/usr/x86_64-pc-linux-musl/lib -L/usr/x86_64-pc-linux-musl/usr/lib
> > >>>>>> /tmp/ccHq7CL6.o --start-group -lgcc -lgcc_eh -lc --end-group
> > >>>>>> /usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/crtend.o
> > >>>>>> /usr/x86_64-pc-linux-musl/usr/lib/crtn.o
> > >>>>>> COLLECT_GCC_OPTIONS='-v' '-static' '-O0' '-g' '-mtune=generic' '-march=x86-64'
> > >>>>>>
> > >>>>>> mtune=generic and march=x86-64 suggests it isn't trying to do
> > >>>>>> something weird on the compile computer.
> > >>>>> Indeed, it looks like the default is right. So you probably need to
> > >>>>> check how musl was built. Is it also a package provided by Gentoo, and
> > >>>>> did they perhaps use -march=native even though it's being cross
> > >>>>> compiled?
> > >>>>>
> > >>>>> Rich
> > >>>
> >
> >
^ permalink raw reply [flat|nested] 13+ messages in thread
* Re: Illegal instruction in __copy_tls()
2019-06-06 0:24 ` Rich Felker
@ 2019-06-06 0:34 ` tenspd137 .
0 siblings, 0 replies; 13+ messages in thread
From: tenspd137 . @ 2019-06-06 0:34 UTC (permalink / raw)
To: Rich Felker; +Cc: musl
[-- Attachment #1: Type: text/plain, Size: 12752 bytes --]
Thanks everyone for all your help! I think I have a way forward then.
Much appreciated!
C
On Wed, Jun 5, 2019, 6:24 PM Rich Felker <dalias@libc.org> wrote:
> On Wed, Jun 05, 2019 at 05:37:49PM -0600, tenspd137 . wrote:
> > bummer.... Hmm - I wonder if an i686 cross compiler would work?
>
> Yes, you can do that. It's just that gcc's multilib dir layout is not
> compatible with musl -- it assumes library headers can be shared
> between 32- and 64-bit versions of "the same" arch rather than
> treating them as completely separate things.
>
> Rich
>
>
> > On Wed, Jun 5, 2019 at 5:34 PM Michael Everitt <m.j.everitt@iee.org>
> wrote:
> > >
> > > Musl doesn't support multilib ... :] fyi
> > >
> > > On 06/06/19 00:32, tenspd137 . wrote:
> > > > Quick question - anyone know how to make a crossdev crosscompiler
> > > > multilib so I can use -m32 when I compile?
> > > >
> > > > Thanks!
> > > >
> > > > On Wed, Jun 5, 2019 at 5:09 PM tenspd137 . <dcday137@gmail.com>
> wrote:
> > > >> I probably don't fully understand how it works. In
> > > >> /etc/x86_64-pc-linux-musl/etc.portage/make.conf, march is not
> > > >> specified. It is specified in /etc/portage/make.conf. When I
> removed
> > > >> it from there, things worked. Then I just put it back after using
> > > >> crossdev to make x86_64-pc-linux-musl-*.
> > > >>
> > > >> Either way, loads of fun :)
> > > >>
> > > >> Thanks!
> > > >>
> > > >> -C
> > > >>
> > > >> On Wed, Jun 5, 2019 at 3:56 PM Michael Everitt <m.j.everitt@iee.org>
> wrote:
> > > >>> In your /usr/${CTARGET}/etc/portage/make.conf you can set
> appropriate
> > > >>> target flags there. But using 'march=native' is going to catch you
> out a
> > > >>> lot cross-compiling anything ... :) At least if you've got it set
> to
> > > >>> something, you're going to see errors that point immediately to
> your CFLAGS
> > > >>> when/if it goes wrong!
> > > >>>
> > > >>> Michael.
> > > >>>
> > > >>> On 05/06/19 22:27, tenspd137 . wrote:
> > > >>>> Thanks! That was indeed the problem. I had march=native for all
> > > >>>> portage related stuff set, and my guess is that crossdev read
> that to
> > > >>>> start. I removed that, reran the crossdev tool to buiild the
> cross
> > > >>>> toolchain, and can now build static binaries that run on different
> > > >>>> systems.
> > > >>>>
> > > >>>> Much appreciated!
> > > >>>>
> > > >>>> -C
> > > >>>>
> > > >>>> On Wed, Jun 5, 2019 at 2:07 PM Rich Felker <dalias@libc.org>
> wrote:
> > > >>>>> On Wed, Jun 05, 2019 at 01:53:58PM -0600, tenspd137 . wrote:
> > > >>>>>> Sure -
> > > >>>>>>
> > > >>>>>> strace -d -v ./a.out:
> > > >>>>>> strace: ptrace_setoptions = 0x51
> > > >>>>>> strace: new tcb for pid 26302, active tcbs:1
> > > >>>>>> strace: [wait(0x80137f) = 26302]
> WIFSTOPPED,sig=SIGSTOP,EVENT_STOP (128)
> > > >>>>>> strace: pid 26302 has TCB_STARTUP, initializing it
> > > >>>>>> strace: [wait(0x80057f) = 26302]
> WIFSTOPPED,sig=SIGTRAP,EVENT_STOP (128)
> > > >>>>>> strace: [wait(0x00127f) = 26302] WIFSTOPPED,sig=SIGCONT
> > > >>>>>> strace: [wait(0x00857f) = 26302] WIFSTOPPED,sig=133
> > > >>>>>> execve("./a.out", ["./a.out"], ["SSH_CONNECTION=15.86.136.27
> 5196"...,
> > > >>>>>> "LANG=en_US.UTF-8", "XDG_SESSION_ID=41", "USER=dayd",
> > > >>>>>> "PWD=/home/dayd/projects/musl-tes"..., "HOME=/home/dayd",
> > > >>>>>> "SSH_CLIENT=xx.xxx.xxx.xx 51960 22",
> "CCACHE_DIR=/ssd/dayd/.ccache",
> > > >>>>>> "VMWARE_USE_SHIPPED_GTK=yes",
> "XDG_DATA_DIRS=/usr/local/share:/"...,
> > > >>>>>> "USECCACHE=ON", "SSH_TTY=/dev/pts/2", "MAIL=/var/mail/dayd",
> > > >>>>>> "TERM=rxvt-unicode-256color", "SHELL=/bin/bash", "SHLVL=1",
> > > >>>>>> "PYTHONPATH=:/home/dayd/projects/"..., "LOGNAME=dayd",
> > > >>>>>> "DBUS_SESSION_BUS_ADDRESS=unix:pa"...,
> > > >>>>>> "XDG_RUNTIME_DIR=/run/user/6686",
> > > >>>>>> "PATH=/usr/lib/ccache/bin/:/usr/l"..., "USEDISTCC=OFF",
> > > >>>>>> "_=/usr/bin/strace", "OLDPWD=/home/dayd/projects"]strace:
> > > >>>>>> [wait(0x04057f) = 26302] WIFSTOPPED,sig=SIGTRAP,EVENT_EXEC (4)
> > > >>>>>> strace: [wait(0x00857f) = 26302] WIFSTOPPED,sig=133
> > > >>>>>> ) = 0
> > > >>>>>> strace: [wait(0x00047f) = 26302] WIFSTOPPED,sig=SIGILL
> > > >>>>>> --- SIGILL {si_signo=SIGILL, si_code=ILL_ILLOPN,
> si_addr=0x40169e} ---
> > > >>>>>> strace: [wait(0x06057f) = 26302]
> WIFSTOPPED,sig=SIGTRAP,EVENT_EXIT (6)
> > > >>>>>> strace: [wait(0x000084) = 26302] WIFSIGNALED,core,sig=SIGILL
> > > >>>>>> +++ killed by SIGILL (core dumped) +++
> > > >>>>>> strace: dropped tcb for pid 26302, 0 remain
> > > >>>>>> Illegal instruction (core dumped)
> > > >>>>>>
> ******************************************************************************************
> > > >>>>>> (gdb) bt
> > > >>>>>> #0 0x00000000004016ae in __copy_tls ()
> > > >>>>>> #1 0x0000000000000000 in ?? ()
> > > >>>>>>
> *****************************************************************************************
> > > >>>>>>
> > > >>>>>> (gdb) disassemble
> > > >>>>>> Dump of assembler code for function __copy_tls:
> > > >>>>>> 0x0000000000401680 <+0>: push %r13
> > > >>>>>> 0x0000000000401682 <+2>: mov %rdi,%r13
> > > >>>>>> 0x0000000000401685 <+5>: push %r12
> > > >>>>>> 0x0000000000401687 <+7>: push %rbp
> > > >>>>>> 0x0000000000401688 <+8>: push %rbx
> > > >>>>>> 0x0000000000401689 <+9>: sub $0x8,%rsp
> > > >>>>>> 0x000000000040168d <+13>: mov 0x410c(%rip),%rax
> #
> > > >>>>>> 0x4057a0 <__libc+32>
> > > >>>>>> 0x0000000000401694 <+20>: mov 0x410d(%rip),%rcx
> #
> > > >>>>>> 0x4057a8 <__libc+40>
> > > >>>>>> 0x000000000040169b <+27>: mov 0x40f6(%rip),%rbx
> #
> > > >>>>>> 0x405798 <__libc+24>
> > > >>>>>> 0x00000000004016a2 <+34>: lea -0xe0(%rdi,%rax,1),%rax
> > > >>>>>> 0x00000000004016aa <+42>: lea -0x1(%rcx),%r12
> > > >>>>>> => 0x00000000004016ae <+46>: andn %rax,%r12,%r12
> > > >>>>> This instruction, andn, is not in the base x86_64 ISA. It's part
> of
> > > >>>>> the BMI1 extension:
> > > >>>>>
> > > >>>>>
> https://en.wikipedia.org/wiki/Bit_Manipulation_Instruction_Sets#BMI1_(Bit_Manipulation_Instruction_Set_1)
> > > >>>>>
> > > >>>>> Apparently Gentoo is providing cross compilers that default to
> > > >>>>> producing "native ISA level" code for the host, rather than
> baseline
> > > >>>>> ISA for the target. But:
> > > >>>>>
> > > >>>>>> as a bonus (I thought this might also help):
> > > >>>>>> (%:~/projects/musl-test)┌- x86_64-pc-linux-musl-gcc -v -static
> -O0 -g
> > > >>>>>> hello.c
> > > >>>>>> Using built-in specs.
> > > >>>>>> COLLECT_GCC=x86_64-pc-linux-musl-gcc
> > > >>>>>>
> COLLECT_LTO_WRAPPER=/usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/lto-wrapper
> > > >>>>>> Target: x86_64-pc-linux-musl
> > > >>>>>> Configured with:
> > > >>>>>>
> /var/tmp/portage/cross-x86_64-pc-linux-musl/gcc-9.1.0/work/gcc-9.1..0/configure
> > > >>>>>> --host=x86_64-pc-linux-gnu --target=x86_64-pc-linux-musl
> > > >>>>>> --build=x86_64-pc-linux-gnu --prefix=/usr
> > > >>>>>>
> --bindir=/usr/x86_64-pc-linux-gnu/x86_64-pc-linux-musl/gcc-bin/9..1.0
> > > >>>>>> --includedir=/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/include
> > > >>>>>> --datadir=/usr/share/gcc-data/x86_64-pc-linux-musl/9.1.0
> > > >>>>>> --mandir=/usr/share/gcc-data/x86_64-pc-linux-musl/9.1.0/man
> > > >>>>>> --infodir=/usr/share/gcc-data/x86_64-pc-linux-musl/9.1.0/info
> > > >>>>>>
> --with-gxx-include-dir=/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/include/g++-v9
> > > >>>>>>
> --with-python-dir=/share/gcc-data/x86_64-pc-linux-musl/9.1.0/python
> > > >>>>>> --enable-languages=c,c++,fortran --enable-obsolete
> --enable-secureplt
> > > >>>>>> --disable-werror --with-system-zlib --enable-nls
> > > >>>>>> --without-included-gettext --enable-checking=release
> > > >>>>>> --with-bugurl=https://bugs.gentoo.org/
> --with-pkgversion='Gentoo 9.1.0
> > > >>>>>> p1.0' --disable-esp --enable-libstdcxx-time
> > > >>>>>> --enable-poison-system-directories
> > > >>>>>> --with-sysroot=/usr/x86_64-pc-linux-musl --disable-bootstrap
> > > >>>>>> --enable-__cxa_atexit --disable-multilib
> --with-multilib-list=m64
> > > >>>>>> --disable-altivec --disable-fixed-point --enable-targets=all
> > > >>>>>> --enable-libgomp --disable-libmudflap --disable-libssp
> > > >>>>>> --disable-systemtap --disable-vtable-verify --disable-libvtv
> > > >>>>>> --enable-lto --without-isl --disable-libsanitizer
> --enable-default-pie
> > > >>>>>> --enable-default-ssp
> > > >>>>>> Thread model: posix
> > > >>>>>> gcc version 9.1.0 (Gentoo 9.1.0 p1.0)
> > > >>>>>> COLLECT_GCC_OPTIONS='-v' '-static' '-O0' '-g' '-mtune=generic'
> '-march=x86-64'
> > > >>>>>> /usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/cc1 -quiet -v
> hello.c
> > > >>>>>> -quiet -dumpbase hello.c -mtune=generic -march=x86-64 -auxbase
> hello
> > > >>>>>> -g -O0 -version -o /tmp/ccoTkh38.s
> > > >>>>>> GNU C17 (Gentoo 9.1.0 p1.0) version 9.1.0 (x86_64-pc-linux-musl)
> > > >>>>>> compiled by GNU C version 8.3.0, GMP version 6.1.2, MPFR
> version
> > > >>>>>> 4.0.2, MPC version 1.1.0, isl version none
> > > >>>>>> GGC heuristics: --param ggc-min-expand=100 --param
> ggc-min-heapsize=131072
> > > >>>>>> ignoring nonexistent directory
> "/usr/x86_64-pc-linux-musl/usr/local/include"
> > > >>>>>> ignoring nonexistent directory
> > > >>>>>>
> "/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/../../../../x86_64-pc-linux-musl/include"
> > > >>>>>> #include "..." search starts here:
> > > >>>>>> #include <...> search starts here:
> > > >>>>>> /usr/x86_64-pc-linux-musl/usr/include
> > > >>>>>> /usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/include
> > > >>>>>> End of search list.
> > > >>>>>> GNU C17 (Gentoo 9.1.0 p1.0) version 9.1.0 (x86_64-pc-linux-musl)
> > > >>>>>> compiled by GNU C version 8.3.0, GMP version 6.1.2, MPFR
> version
> > > >>>>>> 4.0.2, MPC version 1.1.0, isl version none
> > > >>>>>> GGC heuristics: --param ggc-min-expand=100 --param
> ggc-min-heapsize=131072
> > > >>>>>> Compiler executable checksum: a3183e5f435d1938198d432af6db159b
> > > >>>>>> COLLECT_GCC_OPTIONS='-v' '-static' '-O0' '-g' '-mtune=generic'
> '-march=x86-64'
> > > >>>>>> /usr/libexec/gcc/x86_64-pc-linux-musl/as -v --64 -o
> /tmp/ccHq7CL6..o
> > > >>>>>> /tmp/ccoTkh38.s
> > > >>>>>> GNU assembler version 2.32.0 (x86_64-pc-linux-musl) using BFD
> version
> > > >>>>>> (Gentoo 2.32 p2) 2.32.0
> > > >>>>>>
> COMPILER_PATH=/usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/:/usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/:/usr/libexec/gcc/x86_64-pc-linux-musl/:/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/:/usr/lib/gcc/x86_64-pc-linux-musl/
> > > >>>>>>
> LIBRARY_PATH=/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/:/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/../../../../x86_64-pc-linux-musl/lib/:/usr/x86_64-pc-linux-musl/lib/:/usr/x86_64-pc-linux-musl/usr/lib/
> > > >>>>>> COLLECT_GCC_OPTIONS='-v' '-static' '-O0' '-g' '-mtune=generic'
> '-march=x86-64'
> > > >>>>>> /usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/collect2 -plugin
> > > >>>>>> /usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/liblto_plugin.so
> > > >>>>>>
> -plugin-opt=/usr/libexec/gcc/x86_64-pc-linux-musl/9.1.0/lto-wrapper
> > > >>>>>> -plugin-opt=-fresolution=/tmp/ccWcifv4.res
> > > >>>>>> -plugin-opt=-pass-through=-lgcc
> -plugin-opt=-pass-through=-lgcc_eh
> > > >>>>>> -plugin-opt=-pass-through=-lc
> --sysroot=/usr/x86_64-pc-linux-musl -m
> > > >>>>>> elf_x86_64 -static /usr/x86_64-pc-linux-musl/usr/lib/crt1.o
> > > >>>>>> /usr/x86_64-pc-linux-musl/usr/lib/crti.o
> > > >>>>>> /usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/crtbeginT.o
> > > >>>>>> -L/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0
> > > >>>>>>
> -L/usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/../../../../x86_64-pc-linux-musl/lib
> > > >>>>>> -L/usr/x86_64-pc-linux-musl/lib
> -L/usr/x86_64-pc-linux-musl/usr/lib
> > > >>>>>> /tmp/ccHq7CL6.o --start-group -lgcc -lgcc_eh -lc --end-group
> > > >>>>>> /usr/lib/gcc/x86_64-pc-linux-musl/9.1.0/crtend.o
> > > >>>>>> /usr/x86_64-pc-linux-musl/usr/lib/crtn.o
> > > >>>>>> COLLECT_GCC_OPTIONS='-v' '-static' '-O0' '-g' '-mtune=generic'
> '-march=x86-64'
> > > >>>>>>
> > > >>>>>> mtune=generic and march=x86-64 suggests it isn't trying to do
> > > >>>>>> something weird on the compile computer.
> > > >>>>> Indeed, it looks like the default is right. So you probably need
> to
> > > >>>>> check how musl was built. Is it also a package provided by
> Gentoo, and
> > > >>>>> did they perhaps use -march=native even though it's being cross
> > > >>>>> compiled?
> > > >>>>>
> > > >>>>> Rich
> > > >>>
> > >
> > >
>
[-- Attachment #2: Type: text/html, Size: 18835 bytes --]
^ permalink raw reply [flat|nested] 13+ messages in thread
end of thread, other threads:[~2019-06-06 0:34 UTC | newest]
Thread overview: 13+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2019-06-05 18:16 Illegal instruction in __copy_tls() tenspd137 .
2019-06-05 18:37 ` Rich Felker
2019-06-05 19:53 ` tenspd137 .
2019-06-05 20:07 ` Rich Felker
2019-06-05 21:27 ` tenspd137 .
2019-06-05 21:56 ` Michael Everitt
2019-06-05 23:09 ` tenspd137 .
2019-06-05 23:32 ` tenspd137 .
2019-06-05 23:34 ` Michael Everitt
2019-06-05 23:37 ` tenspd137 .
2019-06-05 23:41 ` tenspd137 .
2019-06-06 0:24 ` Rich Felker
2019-06-06 0:34 ` tenspd137 .
Code repositories for project(s) associated with this public inbox
https://git.vuxu.org/mirror/musl/
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).