[ISSUE] nix-channel --update crashes on musl

[ISSUE] nix-channel --update crashes on musl

[loreb]

[-- Attachment #1: Type: text/plain, Size: 1502 bytes --]

New issue by loreb on void-packages repository

https://github.com/void-linux/void-packages/issues/37382

Description:
<!-- Don't request update of package. We have a script for that. https://repo-default.voidlinux.org/void-updates/void-updates.txt. However, a quality pull request may help. -->
### System

* xuname:  
  Void 5.10.117_1 x86_64-musl GenuineIntel uptodate rFFF
* package:  
  nix-2.8.1_1

### Expected behavior
It works as usual

### Actual behavior
```
$ nix-channel --update
unpacking channels...
RT34
$ echo $?
162
$ strace nix-channel --update
(...)
vfork()
+++ killed by SIGRT_2 +++
RT34
```


### Steps to reproduce the behavior

Run the above on a musl machine.

To make it more interesting, if you stop the nix-daemon service,
log in as root, and run /etc/sv/nix-daemon/run by hand the behavior changes:
nix-daemon starts to spew many, many, *many* messages saying that it accepted a connection from $pid until it runs out of memory while keeping tens of thousands of nix-daemon processes alive (or zombies?); I have no idea if adding substantially more memory would help, but I know at least that this used to work before.

The bug happens the exact same way with the newly released 2.9.0 (I believe - I had to fiddle with the `--with-sandbox-shell` option to get it to compile for some reason).

`grep -R SIGRT` in the nix sources doesn't return any result, so I guess it's in some dependency (boost?)

Any help is greatly appreciated.

Re: nix-channel --update crashes on musl

[paper42]

[-- Attachment #1: Type: text/plain, Size: 297 bytes --]

New comment by paper42 on void-packages repository

https://github.com/void-linux/void-packages/issues/37382#issuecomment-1152760606

Comment:
I can not reproduce this on aarch64-musl
```
%: nix-channel --update
unpacking channels...
created 0 symlinks in user environment
%: echo $?
0
```

Re: nix-channel --update crashes on musl

[loreb]

[-- Attachment #1: Type: text/plain, Size: 558 bytes --]

New comment by loreb on void-packages repository

https://github.com/void-linux/void-packages/issues/37382#issuecomment-1152918647

Comment:
@paper42 thank you; for some reason I can boot alpine/debian/ubuntu under qemu-system-aarch64 but not void...
Just out of curiosity (it makes no difference here, both on real hw/freshly installed vm) - did you enable the nix-daemon service & subscribe to a channel before? The command is `nix-channel --add https://nixos.org/channels/nixpkgs-unstable`.
Sorry I forgot to add those, I'm editing the original message

Re: nix-channel --update crashes on musl

[xiarenfan]

[-- Attachment #1: Type: text/plain, Size: 248 bytes --]

New comment by xiarenfan on void-packages repository

https://github.com/void-linux/void-packages/issues/37382#issuecomment-1296920123

Comment:
Can be used
```sh
sh <(curl -L https://nixos.org/nix/install) --no-daemon
```
to avoid the problem

Re: nix-channel --update crashes on musl

[loreb]

[-- Attachment #1: Type: text/plain, Size: 465 bytes --]

New comment by loreb on void-packages repository

https://github.com/void-linux/void-packages/issues/37382#issuecomment-1300360761

Comment:
> Can be used
> 
> ```shell
> sh <(curl -L https://nixos.org/nix/install) --no-daemon
> ```
> 
> to avoid the problem

Witchcraft! :)

TBH I kinda gave up because currently I'm only using it for a game and that SIGRT apparently comes from the Bohem garbage collector; does the bug happen on your computer as well?

Re: nix-channel --update crashes on musl

[xiarenfan]

[-- Attachment #1: Type: text/plain, Size: 827 bytes --]

New comment by xiarenfan on void-packages repository

https://github.com/void-linux/void-packages/issues/37382#issuecomment-1301519468

Comment:
> > Can be used
> > ```shell
> > sh <(curl -L https://nixos.org/nix/install) --no-daemon
> > ```
> > 
> > 
> >     
> >       
> >     
> > 
> >       
> >     
> > 
> >     
> >   
> > to avoid the problem
> 
> Witchcraft! :)
> 
> TBH I kinda gave up because currently I'm only using it for a game and that SIGRT apparently comes from the Bohem garbage collector; does the bug happen on your computer as well?

The error did happen on my computer，I think it's nix-daemon's service issue.because it's service only `/var/service/nix-daemon`
```sh
exec nix-deamon
``` 
but i try `sv status nix-daemon`
```sh
down nix-daemon: 0s, normally up ,want up
```

Re: nix-channel --update crashes on musl

[loreb]

[-- Attachment #1: Type: text/plain, Size: 1090 bytes --]

New comment by loreb on void-packages repository

https://github.com/void-linux/void-packages/issues/37382#issuecomment-1302029588

Comment:
@xiarenfan not what I see, nix-daemon (from xbps-install) is up but running commands fails; try looking at runsvdir (`ps auxww|grep runsvdir`) or the syslog for clues (if the version you're trying to run is the one from nixos.org it's because you need to modify its $PATH).

The command you suggested works even if installed with `--daemon`, but there's a catch...
```
$ file ./store/xdlpraypxdimjyfrr4k06narrv8nmfgh-nix-2.11.1/bin/nix
./store/xdlpraypxdimjyfrr4k06narrv8nmfgh-nix-2.11.1/bin/nix: ELF 64-bit LSB executable, x86-64, version 1 (GNU/Linux), dynamically linked, interpreter /nix/store/scd5n7xsn0hh0lvhhnycr9gx0h8xfzsl-glibc-2.34-210/lib/ld-linux-x86-64.so.2, for GNU/Linux 2.6.32, BuildID[sha1]=4c07925e180f9517c88c38492c85b966acfb251c, not stripped
```

The binary from nixos.org works because it is a glibc binary that ships its own glibc -to verify, run `ldd $(which nix)` and notice the libc symbols that fail to resolve.

Re: nix-channel --update crashes on musl

[vincele]

[-- Attachment #1: Type: text/plain, Size: 429 bytes --]

New comment by vincele on void-packages repository

https://github.com/void-linux/void-packages/issues/37382#issuecomment-1575180416

Comment:
Still happens on:

    # xuname
    Void 6.1.31_1 x86_64-musl AuthenticAMD uptodate rrnFFFFFFFF

    # xbps-query -Rs nix-2
    [*] nix-2.11.0_5 Purely functional package manager

    # sv status nix-daemon
    run: nix-daemon: (pid 17445) 1804s; run: log: (pid 17444) 1804s

Re: nix-channel --update crashes on musl

[vincele]

[-- Attachment #1: Type: text/plain, Size: 223 bytes --]

New comment by vincele on void-packages repository

https://github.com/void-linux/void-packages/issues/37382#issuecomment-1575184354

Comment:
@paper42 : does the above reproduction make the "needs-testing" tag removable ?

Re: nix-channel --update crashes on musl

[vincele]

[-- Attachment #1: Type: text/plain, Size: 383 bytes --]

New comment by vincele on void-packages repository

https://github.com/void-linux/void-packages/issues/37382#issuecomment-1575198483

Comment:
This is probably musl-related, as I don't have the error in a x86_64 glibc chroot.

    $ nix-channel --update
    error: creating directory '/nix/store/.links': Permission denied

Which looks normal as I don't have /nix in the chroot

Re: nix-channel --update crashes on musl

[vincele]

[-- Attachment #1: Type: text/plain, Size: 388 bytes --]

New comment by vincele on void-packages repository

https://github.com/void-linux/void-packages/issues/37382#issuecomment-1575198483

Comment:
This is probably musl-related, as I don't have the same error in a x86_64 glibc chroot.

    $ nix-channel --update
    error: creating directory '/nix/store/.links': Permission denied

Which looks normal as I don't have /nix in the chroot

Re: nix-channel --update crashes on musl

[vincele]

[-- Attachment #1: Type: text/plain, Size: 395 bytes --]

New comment by vincele on void-packages repository

https://github.com/void-linux/void-packages/issues/37382#issuecomment-1575198483

Comment:
This is probably x86_64-musl-related, as I don't have the same error in a x86_64 glibc chroot.

    $ nix-channel --update
    error: creating directory '/nix/store/.links': Permission denied

Which looks normal as I don't have /nix in the chroot

Re: nix-channel --update crashes on musl

[vincele]

[-- Attachment #1: Type: text/plain, Size: 396 bytes --]

New comment by vincele on void-packages repository

https://github.com/void-linux/void-packages/issues/37382#issuecomment-1575198483

Comment:
This is probably x86_64-musl-related, as I don't have the same error in a x86_64 glibc chroot.

    $ nix-channel --update
    error: creating directory '/nix/store/.links': Permission denied

Which looks normal as /nix doesn't exist in the chroot

Re: nix-channel --update crashes on musl

[vincele]

[-- Attachment #1: Type: text/plain, Size: 495 bytes --]

New comment by vincele on void-packages repository

https://github.com/void-linux/void-packages/issues/37382#issuecomment-1575198483

Comment:
This is probably x86_64-musl-related, as I don't have the same error in a x86_64 glibc chroot.

    $ nix-channel --update
    error: creating directory '/nix/store/.links': Permission denied

Which looks normal as /nix doesn't exist in the chroot

Is it possible to create an updated musl-1.2.4 chroot to test if the new version would fix it ?

Re: nix-channel --update crashes on musl

[vincele]

[-- Attachment #1: Type: text/plain, Size: 545 bytes --]

New comment by vincele on void-packages repository

https://github.com/void-linux/void-packages/issues/37382#issuecomment-1575198483

Comment:
This is probably x86_64-musl-related, as I don't have the same error in a x86_64 glibc chroot.

    $ nix-channel --update
    error: creating directory '/nix/store/.links': Permission denied

Which looks better, and is probably related to the fact that the nix daemon does not run in that chroot.

Is it possible to create an updated musl-1.2.4 chroot to test if the new version would fix it ?

Re: nix-channel --update crashes on musl

[loreb]

[-- Attachment #1: Type: text/plain, Size: 408 bytes --]

New comment by loreb on void-packages repository

https://github.com/void-linux/void-packages/issues/37382#issuecomment-1576918127

Comment:
No idea, I've always used kvm for this kind of things.
Anyway nix 2.16.0 stops at `configure: error: librapidcheck is not found`, ie https://github.com/emil-e/rapidcheck

I really don't feel like struggling with cmake atm, losing vs cargo has drained me enough ^^

Re: nix-channel --update crashes on musl

[vincele]

[-- Attachment #1: Type: text/plain, Size: 222 bytes --]

New comment by vincele on void-packages repository

https://github.com/void-linux/void-packages/issues/37382#issuecomment-1576981376

Comment:
I tested this in a VM with void glibc x86_64 and nix is working properly here.

Re: nix-channel --update crashes on musl

[vincele]

[-- Attachment #1: Type: text/plain, Size: 471 bytes --]

New comment by vincele on void-packages repository

https://github.com/void-linux/void-packages/issues/37382#issuecomment-1576981376

Comment:
I tested this in a VM with void glibc x86_64 and nix is working properly here.

    # xbps-query -Rs nix-2
    [*] nix-2.11.0_5 Purely functional package manager
    # sv statux nix-daemon
    run: nix-daemon: (pid 969) 489s; run: log: (pid 968) 489s
    # xuname
    Void 6.1.31_1 x86_64 GenuineIntel/KVM uptodate rFF

Re: nix-channel --update crashes on musl

[vincele]

[-- Attachment #1: Type: text/plain, Size: 763 bytes --]

New comment by vincele on void-packages repository

https://github.com/void-linux/void-packages/issues/37382#issuecomment-1576981376

Comment:
I tested this in a VM with void glibc x86_64 and nix is working properly here.

    # xbps-query -Rs nix-2
    [*] nix-2.11.0_5 Purely functional package manager
    # sv statux nix-daemon
    run: nix-daemon: (pid 969) 489s; run: log: (pid 968) 489s
    # xuname
    Void 6.1.31_1 x86_64 GenuineIntel/KVM uptodate rFF
    
    $ nix-channel --add http://nixos.org/channels/nixpkgs-unstable
    [...]
    $ nix-channel --update
    [...]
    $ nix-env -iA nixpkgs.hello
    [...]
    $ nix-env --query --installed
    hello-2.12.1
    $ hello -g 'Hello, from Nix on Void'
    Hello, from Nix on Void

Re: nix-channel --update crashes on musl

[vincele]

[-- Attachment #1: Type: text/plain, Size: 827 bytes --]

New comment by vincele on void-packages repository

https://github.com/void-linux/void-packages/issues/37382#issuecomment-1576981376

Comment:
I tested this in a VM with void glibc x86_64 and nix is working properly here.

    # xbps-query -Rs nix-2
    [*] nix-2.11.0_5 Purely functional package manager
    # sv statux nix-daemon
    run: nix-daemon: (pid 969) 489s; run: log: (pid 968) 489s
    # xuname
    Void 6.1.31_1 x86_64 GenuineIntel/KVM uptodate rFF
    
    $ nix-channel --add http://nixos.org/channels/nixpkgs-unstable
    [...]
    $ nix-channel --update
    [...]
    $ nix-env -iA nixpkgs.hello
    [...]

    $ nix-env --query --installed
    hello-2.12.1

    $ which hello
    /home/void/.nix-profile/bin/hello

    $ hello -g 'Hello, from Nix on Void'
    Hello, from Nix on Void

Re: nix-channel --update crashes on musl

[vincele]

[-- Attachment #1: Type: text/plain, Size: 296 bytes --]

New comment by vincele on void-packages repository

https://github.com/void-linux/void-packages/issues/37382#issuecomment-1575184354

Comment:
@paper42 : does the above reproduction make the "needs-testing" tag removable ?

EDIT: is there a "musl" tag, that would help classifying those bugs ?

Re: nix-channel --update crashes on musl

[loreb]

[-- Attachment #1: Type: text/plain, Size: 194 bytes --]

New comment by loreb on void-packages repository

https://github.com/void-linux/void-packages/issues/37382#issuecomment-1577105747

Comment:
Oh sorry I misunderstood - yes, nix+glibc works fine

Re: nix-channel --update crashes on musl

[loreb]

[-- Attachment #1: Type: text/plain, Size: 383 bytes --]

New comment by loreb on void-packages repository

https://github.com/void-linux/void-packages/issues/37382#issuecomment-1604433729

Comment:
FWIW newer versions of nix require newer version of json-c++ and rapidcheck; I built the latest release at https://github.com/loreb/void-packages/tree/nix2.16.0 and `nix-channel --update` still fails the same way on musl (didn't test glibc).

Re: nix-channel --update crashes on musl

[loreb]

[-- Attachment #1: Type: text/plain, Size: 405 bytes --]

New comment by loreb on void-packages repository

https://github.com/void-linux/void-packages/issues/37382#issuecomment-1638201225

Comment:
@paper42 could you take a look at the PR? One of the check fails, but it looks pretty bogus to me - iiuc the problem is that it fails to install postgresql{13-15}-libs together, which are explicitly declared to be in conflict - or am I misunderstanding something?

Re: nix-channel --update crashes on musl

[classabbyamp]

[-- Attachment #1: Type: text/plain, Size: 248 bytes --]

New comment by classabbyamp on void-packages repository

https://github.com/void-linux/void-packages/issues/37382#issuecomment-1638225819

Comment:
postgresql13 needs to be removed from the repos, the template is removed. I've started that process

Re: nix-channel --update crashes on musl

[classabbyamp]

[-- Attachment #1: Type: text/plain, Size: 280 bytes --]

New comment by classabbyamp on void-packages repository

https://github.com/void-linux/void-packages/issues/37382#issuecomment-1638225819

Comment:
postgresql13 needs to be removed from the repos, the template is removed. I've started that process. once it's gone it should work.

Re: nix-channel --update crashes on musl

[loreb]

[-- Attachment #1: Type: text/plain, Size: 160 bytes --]

New comment by loreb on void-packages repository

https://github.com/void-linux/void-packages/issues/37382#issuecomment-1638293969

Comment:
Oh great thank you

Re: nix-channel --update crashes on musl

[loreb]

[-- Attachment #1: Type: text/plain, Size: 182 bytes --]

New comment by loreb on void-packages repository

https://github.com/void-linux/void-packages/issues/37382#issuecomment-1638414565

Comment:
Same except it's postgresql14 this time.

Re: [ISSUE] [CLOSED] nix-channel --update crashes on musl

[classabbyamp]

[-- Attachment #1: Type: text/plain, Size: 1886 bytes --]

Closed issue by loreb on void-packages repository

https://github.com/void-linux/void-packages/issues/37382

Description:
<!-- Don't request update of package. We have a script for that. https://repo-default.voidlinux.org/void-updates/void-updates.txt. However, a quality pull request may help. -->
### System

* xuname:  
  Void 5.10.117_1 x86_64-musl GenuineIntel uptodate rFFF
* package:  
  nix-2.8.1_1

### Expected behavior
It works as usual

### Actual behavior
```
$ nix-channel --update
unpacking channels...
RT34
$ echo $?
162
$ strace nix-channel --update
(...)
vfork()
+++ killed by SIGRT_2 +++
RT34
```


### Steps to reproduce the behavior

Run the above on a musl machine.

To make it more interesting, if you stop the nix-daemon service,
log in as root, and run /etc/sv/nix-daemon/run by hand the behavior changes:
nix-daemon starts to spew many, many, *many* messages saying that it accepted a connection from $pid until it runs out of memory while keeping tens of thousands of nix-daemon processes alive (or zombies?); I have no idea if adding substantially more memory would help, but I know at least that this used to work before.

The bug happens the exact same way with the newly released 2.9.0 (I believe - I had to fiddle with the `--with-sandbox-shell` option to get it to compile for some reason).

`grep -R SIGRT` in the nix sources doesn't return any result, so I guess it's in some dependency (boost?)

Any help is greatly appreciated.

edit:
it makes no difference on my machine (or a vm), but in case you've never used nix before,
you're supposed to first enable the nix-daemon service and then,
as an unprivileged user, subscribe to a nix channel (`nix-channel --add https://nixos.org/channels/nixpkgs-unstable`) before trying to update.
AND maybe do it from a fresh login to pick up on /etc/profile.d/nix*.sh