* Deadlock when receiving kill-signal from child process
@ 2015-08-03 11:25 Mathias Fredriksson
2015-08-03 15:52 ` Bart Schaefer
0 siblings, 1 reply; 41+ messages in thread
From: Mathias Fredriksson @ 2015-08-03 11:25 UTC (permalink / raw)
To: zsh-workers
[-- Attachment #1.1: Type: text/plain, Size: 1057 bytes --]
On OSX 10.10 using ZSH 5.0.5 (OSX), 5.0.7 and 5.0.8 (Homebrew) I am able to
trigger a deadlock of zsh when sending a kill-signal from a child process
to a parent process. This is reproducible with almost all kill signals
(KILL, INT, ALRM, etc). WINCH is the only signal that has proved to be
unaffected.
This is not just OSX specific either. Multiple systems seem affected (e.g.
Ubuntu, Xubuntu, Arch Linux) as can be seen from this (very likely related)
issue[1]. Weirdly not all systems or configurations seem affected.
I've tried to debug this myself (attached debug output) but I'm not very
comfortable around such tools. Sorry if this has been reported/fixed
already.
Sample code to reproduce blow. Note: it does not always trigger a deadlock,
it might take a couple of runs and it probably depends on the system
running it.
[1] https://github.com/sorin-ionescu/prezto/issues/888
--
child() {
sleep 0.1
kill -USR1 $$
}
TRAPUSR1() {
print -n "."
}
for i in {1..99}; do
child &!
done
for i in {1..100}; do
sleep 0.00001
done
[-- Attachment #1.2: Type: text/html, Size: 1538 bytes --]
[-- Attachment #2: zsh_deadlock.out --]
[-- Type: application/octet-stream, Size: 38288 bytes --]
93100/0x76ed6: 251554415 5 2 kill(0x16BB9, 0x0, 0x1) = 0 0
93100/0x76ed6: 251554417 3 1 read(0xB, "\0", 0x1) = -1 Err#35
93100/0x76ed6: 251554422 2 0 sigprocmask(0x1, 0x7FFF5149726C, 0x7FFF51497268) = 0x0 0
93100/0x76ed6: 251554423 2 0 sigprocmask(0x2, 0x7FFF5149726C, 0x7FFF51497268) = 0x0 0
93100/0x76ed6: 251554425 2 0 sigprocmask(0x1, 0x7FFF51499F8C, 0x7FFF51499F88) = 0x0 0
93100/0x76ed6: 251554426 2 0 sigprocmask(0x2, 0x7FFF51499F8C, 0x7FFF51499F88) = 0x0 0
93100/0x76ed6: 251554429 2 0 sigprocmask(0x1, 0x7FFF51499F8C, 0x7FFF51499F88) = 0x0 0
93100/0x76ed6: 251554431 2 0 sigprocmask(0x1, 0x7FFF51499F8C, 0x7FFF51499F88) = 0x0 0
93100/0x76ed6: 251554432 2 0 sigprocmask(0x2, 0x7FFF51499F8C, 0x7FFF51499F88) = 0x0 0
93100/0x76ed6: 251554454 2 0 sigprocmask(0x1, 0x7FFF5149CF1C, 0x7FFF5149CF18) = 0x0 0
93100/0x76ed6: 251554458 2 0 sigprocmask(0x1, 0x7FFF5149CF1C, 0x7FFF5149CF18) = 0x0 0
93100/0x76ed6: 251554459 3 0 sigprocmask(0x2, 0x7FFF5149CF1C, 0x7FFF5149CF18) = 0x0 0
93100/0x76ed6: 251554475 2 0 sigprocmask(0x3, 0x7FFF514A00FC, 0x7FFF514A00F8) = 0x0 0
93100/0x76ed6: 251554480 7 4 close(0x4) = 0 0
93100/0x76ed6: 251554482 3 1 read(0x3, "\0", 0x1) = 0 0
93100/0x76ed6: 251554485 3 2 close(0x3) = 0 0
93100/0x76ed6: 251554487 2 0 sigprocmask(0x1, 0x7FFF514A2C4C, 0x7FFF514A2C48) = 0x0 0
97243/0x79833: 124 275358 18446744073708459 thread_selfid(0x0, 0x7FFF5148596C, 0x7FFF51485968) = 497715 0
97239/0x7982f: 916 7 3 write_nocancel(0x1, "**[[DIRPATH_REMOVED]]**\n\0", 0x39) = 57 0
97239/0x7982f: 925 3 0 sigprocmask(0x1, 0x7FFF5147C54C, 0x7FFF5147C548) = 0x0 0
97239/0x7982f: 926 3 0 sigprocmask(0x2, 0x7FFF5147C54C, 0x7FFF5147C548) = 0x0 0
97239/0x7982f: 931 5 3 close(0x1) = 0 0
93100/0x76ed6: 251292614 4 0 sigprocmask(0x3, 0x7FFF51482154, 0x7FFF51482150) = 0x0 0
93100/0x76ed6: 251292619 6 3 wait4_nocancel(0xFFFFFFFF, 0x7FFF51482114, 0x13) = 97238 0
93100/0x76ed6: 251292629 12 9 getrusage(0xFFFFFFFF, 0x10E7D1778, 0x13) = 0 0
93100/0x76ed6: 251292630 2 0 wait4_nocancel(0xFFFFFFFF, 0x7FFF51482114, 0x13) = 0 0
93100/0x76ed6: 251292632 3 1 sigreturn(0x7FFF51482600, 0x1E, 0x13) = 0 Err#-2
93100/0x76ed6: 251292635 2 0 sigprocmask(0x1, 0x7FFF514826CC, 0x7FFF514826C8) = 0x0 0
93100/0x76ed6: 251292636 2 0 kill(0x17BD6, 0x0, 0x1) = -1 Err#3
93100/0x76ed6: 251292637 2 0 sigprocmask(0x2, 0x7FFF514826CC, 0x7FFF514826C8) = 0x0 0
93100/0x76ed6: 251292753 2 0 sigprocmask(0x1, 0x7FFF514828BC, 0x7FFF514828B8) = 0x0 0
93100/0x76ed6: 251293544 3 0 sigprocmask(0x1, 0x7FFF5147CE3C, 0x7FFF5147CE38) = 0x0 0
93100/0x76ed6: 251293545 2 0 sigprocmask(0x2, 0x7FFF5147CE3C, 0x7FFF5147CE38) = 0x0 0
93100/0x76ed6: 251293555 2 0 sigprocmask(0x1, 0x7FFF5147FB4C, 0x7FFF5147FB48) = 0x0 0
93100/0x76ed6: 251293555 2 0 sigprocmask(0x2, 0x7FFF5147FB4C, 0x7FFF5147FB48) = 0x0 0
93100/0x76ed6: 251293557 2 0 sigprocmask(0x1, 0x7FFF514828BC, 0x7FFF514828B8) = 0x0 0
93100/0x76ed6: 251293558 2 0 sigprocmask(0x2, 0x7FFF514828BC, 0x7FFF514828B8) = 0x0 0
93100/0x76ed6: 251293558 2 0 sigprocmask(0x1, 0x7FFF514828BC, 0x7FFF514828B8) = 0x0 0
93100/0x76ed6: 251293572 2 0 sigprocmask(0x1, 0x7FFF514828BC, 0x7FFF514828B8) = 0x0 0
93100/0x76ed6: 251293573 2 0 sigprocmask(0x2, 0x7FFF514828BC, 0x7FFF514828B8) = 0x0 0
93100/0x76ed6: 251293573 2 0 sigprocmask(0x1, 0x7FFF514828BC, 0x7FFF514828B8) = 0x0 0
93100/0x76ed6: 251293578 2 0 sigprocmask(0x1, 0x7FFF514828BC, 0x7FFF514828B8) = 0x0 0
93100/0x76ed6: 251293579 2 0 sigprocmask(0x2, 0x7FFF514828BC, 0x7FFF514828B8) = 0x0 0
93100/0x76ed6: 251293579 2 0 sigprocmask(0x1, 0x7FFF514828BC, 0x7FFF514828B8) = 0x0 0
93100/0x76ed6: 251293582 2 0 sigprocmask(0x1, 0x7FFF514828BC, 0x7FFF514828B8) = 0x0 0
93100/0x76ed6: 251293583 2 0 sigprocmask(0x2, 0x7FFF514828BC, 0x7FFF514828B8) = 0x0 0
93100/0x76ed6: 251293600 2 0 sigprocmask(0x1, 0x7FFF5148584C, 0x7FFF51485848) = 0x0 0
93100/0x76ed6: 251293602 2 0 sigprocmask(0x1, 0x7FFF5148584C, 0x7FFF51485848) = 0x0 0
93100/0x76ed6: 251293603 2 0 sigprocmask(0x2, 0x7FFF5148584C, 0x7FFF51485848) = 0x0 0
93100/0x76ed6: 251293635 2 0 sigprocmask(0x1, 0x7FFF514887DC, 0x7FFF514887D8) = 0x0 0
93100/0x76ed6: 251293640 2 0 sigprocmask(0x1, 0x7FFF5148584C, 0x7FFF51485848) = 0x0 0
93100/0x76ed6: 251293644 2 0 sigprocmask(0x1, 0x7FFF5148584C, 0x7FFF51485848) = 0x0 0
93100/0x76ed6: 251293645 2 0 sigprocmask(0x2, 0x7FFF5148584C, 0x7FFF51485848) = 0x0 0
93100/0x76ed6: 251293646 2 0 sigprocmask(0x1, 0x7FFF5148584C, 0x7FFF51485848) = 0x0 0
93100/0x76ed6: 251293649 2 0 sigprocmask(0x1, 0x7FFF5148584C, 0x7FFF51485848) = 0x0 0
93100/0x76ed6: 251293650 2 0 sigprocmask(0x2, 0x7FFF5148584C, 0x7FFF51485848) = 0x0 0
93100/0x76ed6: 251293650 2 0 sigprocmask(0x1, 0x7FFF5148584C, 0x7FFF51485848) = 0x0 0
93100/0x76ed6: 251293654 2 0 sigprocmask(0x1, 0x7FFF5148584C, 0x7FFF51485848) = 0x0 0
93100/0x76ed6: 251293655 2 0 sigprocmask(0x2, 0x7FFF5148584C, 0x7FFF51485848) = 0x0 0
93100/0x76ed6: 251293660 2 0 sigprocmask(0x1, 0x7FFF5148584C, 0x7FFF51485848) = 0x0 0
93100/0x76ed6: 251293667 2 0 sigprocmask(0x1, 0x7FFF51482ADC, 0x7FFF51482AD8) = 0x0 0
93100/0x76ed6: 251293680 2 0 sigprocmask(0x1, 0x7FFF51482ADC, 0x7FFF51482AD8) = 0x0 0
93100/0x76ed6: 251293681 2 0 sigprocmask(0x2, 0x7FFF51482ADC, 0x7FFF51482AD8) = 0x0 0
93100/0x76ed6: 251293682 2 0 sigprocmask(0x1, 0x7FFF5148584C, 0x7FFF51485848) = 0x0 0
93100/0x76ed6: 251293683 2 0 sigprocmask(0x2, 0x7FFF5148584C, 0x7FFF51485848) = 0x0 0
93100/0x76ed6: 251293683 2 0 sigprocmask(0x1, 0x7FFF5148584C, 0x7FFF51485848) = 0x0 0
93100/0x76ed6: 251293686 2 0 sigprocmask(0x1, 0x7FFF51482B3C, 0x7FFF51482B38) = 0x0 0
93100/0x76ed6: 251293696 2 0 sigprocmask(0x1, 0x7FFF51482B3C, 0x7FFF51482B38) = 0x0 0
93100/0x76ed6: 251293697 2 0 sigprocmask(0x2, 0x7FFF51482B3C, 0x7FFF51482B38) = 0x0 0
93100/0x76ed6: 251293698 2 0 sigprocmask(0x1, 0x7FFF5148584C, 0x7FFF51485848) = 0x0 0
93100/0x76ed6: 251293698 2 0 sigprocmask(0x2, 0x7FFF5148584C, 0x7FFF51485848) = 0x0 0
93100/0x76ed6: 251293699 2 0 sigprocmask(0x1, 0x7FFF5148584C, 0x7FFF51485848) = 0x0 0
93100/0x76ed6: 251293701 2 0 sigprocmask(0x1, 0x7FFF5148584C, 0x7FFF51485848) = 0x0 0
93100/0x76ed6: 251293701 2 0 sigprocmask(0x2, 0x7FFF5148584C, 0x7FFF51485848) = 0x0 0
93100/0x76ed6: 251293708 2 0 sigprocmask(0x1, 0x7FFF514887DC, 0x7FFF514887D8) = 0x0 0
93100/0x76ed6: 251293709 2 0 sigprocmask(0x1, 0x7FFF514887DC, 0x7FFF514887D8) = 0x0 0
93100/0x76ed6: 251293710 2 0 sigprocmask(0x2, 0x7FFF514887DC, 0x7FFF514887D8) = 0x0 0
93100/0x76ed6: 251293749 2 0 sigprocmask(0x1, 0x7FFF5148B76C, 0x7FFF5148B768) = 0x0 0
93100/0x76ed6: 251293763 7 4 pipe(0x1, 0x7FFF5148B76C, 0x7FFF5148B768) = 5 0
93100/0x76ed6: 251293765 3 1 fcntl(0x5, 0x0, 0xA) = 12 0
93100/0x76ed6: 251293766 2 0 close(0x5) = 0 0
93100/0x76ed6: 251293767 2 0 fcntl(0x6, 0x0, 0xA) = 13 0
93100/0x76ed6: 251293768 1 0 close(0x6) = 0 0
93100/0x76ed6: 251293768 2 0 sigprocmask(0x1, 0x7FFF51488A9C, 0x7FFF51488A98) = 0x0 0
93100/0x76ed6: 251423166 10 2 close(0xD) = 0 0
93100/0x76ed6: 251423169 6 1 fcntl_nocancel(0xC, 0x3, 0x0) = 0 0
93100/0x76ed6: 251423215 7 2 fstat64(0xC, 0x7FFF514888D8, 0x0) = 0 0
93100/0x76ed6: 251553878 10 1 close(0xD) = 0 0
93100/0x76ed6: 251553881 5 1 fcntl_nocancel(0xC, 0x3, 0x0) = 0 0
93100/0x76ed6: 251553922 7 2 fstat64(0xC, 0x7FFF514888D8, 0x0) = 0 0
97242/0x79832: 391 7 1 sigprocmask(0x2, 0x7FFF51488A9C, 0x7FFF51488A98) = 0x0 0
97242/0x79832: 409 5 1 close(0xC) = 0 0
97242/0x79832: 413 6 2 dup2(0xD, 0x1, 0x7FFF51488A98) = 1 0
97242/0x79832: 414 3 0 close(0xD) = 0 0
97242/0x79832: 449 4 0 sigaction(0xE, 0x7FFF51488968, 0x7FFF51488990) = 0 0
97242/0x79832: 453 3 0 sigaction(0x16, 0x7FFF51488A18, 0x7FFF51488A40) = 0 0
97242/0x79832: 454 3 0 sigaction(0x15, 0x7FFF51488A18, 0x7FFF51488A40) = 0 0
97242/0x79832: 455 3 0 sigaction(0x12, 0x7FFF51488A18, 0x7FFF51488A40) = 0 0
97242/0x79832: 456 3 0 sigaction(0xF, 0x7FFF51488A18, 0x7FFF51488A40) = 0 0
97242/0x79832: 457 3 0 sigaction(0x2, 0x7FFF51488A18, 0x7FFF51488A40) = 0 0
97242/0x79832: 458 3 0 sigaction(0xD, 0x7FFF51488A18, 0x7FFF51488A40) = 0 0
97242/0x79832: 458 3 0 sigaction(0x3, 0x7FFF51488A18, 0x7FFF51488A40) = 0 0
97242/0x79832: 494 4 0 getrusage(0xFFFFFFFF, 0x10E7D1778, 0x7FFF51488A40) = 0 0
97242/0x79832: 522 4 0 sigprocmask(0x1, 0x7FFF514888FC, 0x7FFF514888F8) = 0x0 0
97238/0x7982e: 132647 131937 131767 fork() = 97239 0
97238/0x7982e: 132714 6 1 close(0xD) = 0 0
97238/0x7982e: 132717 5 1 fcntl_nocancel(0xC, 0x3, 0x0) = 0 0
97238/0x7982e: 132738 5 1 fstat64(0xC, 0x7FFF5147C528, 0x0) = 0 0
97238/0x7982e: 132770 828 12 read_nocancel(0xC, "**[[DIRPATH_REMOVED]]**\n\0", 0x4000) = 57 0
97238/0x7982e: 132780 18 3 read_nocancel(0xC, "\0", 0x4000) = 0 0
97238/0x7982e: 132785 7 3 close_nocancel(0xC) = 0 0
97238/0x7982e: 132799 4 0 sigprocmask(0x1, 0x7FFF5147C69C, 0x7FFF5147C698) = 0x0 0
97238/0x7982e: 132801 3 0 kill(0x17BD7, 0x0, 0x1) = 0 0
97238/0x7982e: 132806 131 3 sigsuspend(0x2, 0x0, 0x1) = -1 Err#4
97238/0x7982e: 132820 6 3 sigprocmask(0x1, 0x7FFF5147C124, 0x7FFF5147C120) = 0x0 0
97240/0x79830: 474 7 1 sigprocmask(0x2, 0x7FFF51488A9C, 0x7FFF51488A98) = 0x0 0
97240/0x79830: 491 5 1 close(0xC) = 0 0
97240/0x79830: 494 6 2 dup2(0xD, 0x1, 0x7FFF51488A98) = 1 0
97240/0x79830: 495 3 0 close(0xD) = 0 0
97240/0x79830: 522 5 1 sigaction(0xE, 0x7FFF51488968, 0x7FFF51488990) = 0 0
97240/0x79830: 532 3 0 sigaction(0x16, 0x7FFF51488A18, 0x7FFF51488A40) = 0 0
97240/0x79830: 533 3 0 sigaction(0x15, 0x7FFF51488A18, 0x7FFF51488A40) = 0 0
97240/0x79830: 534 3 0 sigaction(0x12, 0x7FFF51488A18, 0x7FFF51488A40) = 0 0
97240/0x79830: 535 3 0 sigaction(0xF, 0x7FFF51488A18, 0x7FFF51488A40) = 0 0
97240/0x79830: 535 3 0 sigaction(0x2, 0x7FFF51488A18, 0x7FFF51488A40) = 0 0
97240/0x79830: 536 3 0 sigaction(0xD, 0x7FFF51488A18, 0x7FFF51488A40) = 0 0
97240/0x79830: 537 3 0 sigaction(0x3, 0x7FFF51488A18, 0x7FFF51488A40) = 0 0
97240/0x79830: 554 5 0 getrusage(0xFFFFFFFF, 0x10E7D1778, 0x7FFF51488A40) = 0 0
97240/0x79830: 584 4 0 sigprocmask(0x1, 0x7FFF514888FC, 0x7FFF514888F8) = 0x0 0
97240/0x79830: 700 4 0 sigprocmask(0x1, 0x7FFF5148596C, 0x7FFF51485968) = 0x0 0
97240/0x79830: 807 4 0 sigprocmask(0x1, 0x7FFF5148596C, 0x7FFF51485968) = 0x0 0
97240/0x79830: 809 3 0 sigprocmask(0x2, 0x7FFF5148596C, 0x7FFF51485968) = 0x0 0
97240/0x79830: 834 4 0 sigprocmask(0x1, 0x7FFF5148596C, 0x7FFF51485968) = 0x0 0
97240/0x79830: 854 10 4 write_nocancel(0x1, "%F{cyan}%T \n\0", 0xC) = 12 0
97240/0x79830: 856 3 0 sigprocmask(0x1, 0x7FFF5148596C, 0x7FFF51485968) = 0x0 0
97240/0x79830: 857 3 0 sigprocmask(0x2, 0x7FFF5148596C, 0x7FFF51485968) = 0x0 0
97240/0x79830: 945 9 5 close(0x1) = 0 0
97242/0x79832: 691 71 6 sigprocmask(0x1, 0x7FFF5148596C, 0x7FFF51485968) = 0x0 0
97242/0x79832: 964 38 32 access("/etc/localtime\0", 0x4, 0x7FFF51485968) = 0 0
97242/0x79832: 993 31 25 open_nocancel("/etc/localtime\0", 0x0, 0x0) = 5 0
97242/0x79832: 996 5 2 fstat64(0x5, 0x7FFF5147EEE0, 0x0) = 0 0
97242/0x79832: 1004 12 7 read_nocancel(0x5, "TZif\0", 0x2A64) = 682 0
97242/0x79832: 1007 7 2 close_nocancel(0x5) = 0 0
97242/0x79832: 1125 8 3 write_nocancel(0x1, "66\n\0", 0x3) = 3 0
97242/0x79832: 1128 3 0 sigprocmask(0x1, 0x7FFF5148596C, 0x7FFF51485968) = 0x0 0
97242/0x79832: 1129 3 0 sigprocmask(0x2, 0x7FFF5148596C, 0x7FFF51485968) = 0x0 0
97242/0x79832: 1179 6 3 close(0x1) = 0 0
93100/0x76ed6: 251553995 1911 71 read_nocancel(0xC, "66\n\0", 0x4000) = 3 0
93100/0x76ed6: 251554000 4 1 read_nocancel(0xC, "\0", 0x4000) = 0 0
93100/0x76ed6: 251554004 6 3 close_nocancel(0xC) = 0 0
93100/0x76ed6: 251554019 4 0 sigprocmask(0x1, 0x7FFF51488A4C, 0x7FFF51488A48) = 0x0 0
93100/0x76ed6: 251554021 3 1 kill(0x17BDA, 0x0, 0x1) = 0 0
kill -ALRM
93100/0x76ed6: 251554493 35458225056 4 sigsuspend(0x2, 0x7FFF514A2C4C, 0x7FFF514A2C48) = -1 Err#4
93100/0x76ed6: 251554503 87 2 sigprocmask(0x1, 0x7FFF514A26D4, 0x7FFF514A26D0) = 0x0 0
93100/0x76ed6: 251554504 4 0 sigprocmask(0x3, 0x7FFF514A26D4, 0x7FFF514A26D0) = 0x0 0
93100/0x76ed6: 251554509 6 2 sigreturn(0x7FFF514A2B80, 0x1E, 0x7FFF514A26D0) = 0 Err#-2
93100/0x76ed6: 251554512 3 0 sigprocmask(0x1, 0x7FFF514A2C4C, 0x7FFF514A2C48) = 0x0 0
kill -9
18/0xaf052: 21 86 0 thread_selfid(0x0, 0x0, 0x0) = 716882 0
18/0xaf052: 60 10 3 stack_snapshot(0x0, 0x7FCE84022000, 0x10000) = 14745 0
18/0xaf052: 84 10 4 kevent64(0x3, 0x101DCFD58, 0x1) = 1 0
93114/0x76ee4: 3671 35541264647 13 read(0x0, "\0", 0x4000) = -1 Err#4
16491/0xaf055: 9 422732 18446744067692683 thread_selfid(0x1, 0x7FFF5149C1C4, 0x7FFF5149C1C0) = 716885 0
93100/0x76ed6: 251554517 63356186 4 sigsuspend(0x2, 0x7FFF514A2C4C, 0x7FFF514A2C48) = -1 Err#4
93113/0x76ee3: 6016792 35541212127 11 read(0x0, "\0", 0x1) = -1 Err#4
93113/0x76ee3: 6016801 79 1 sigprocmask(0x1, 0x7FFF5149C1C4, 0x7FFF5149C1C0) = 0x0 0
93113/0x76ee3: 6016803 3 0 sigprocmask(0x3, 0x7FFF5149C1C4, 0x7FFF5149C1C0) = 0x0 0
18/0xaf052: 97 69 0 __disable_threadsignal(0x1, 0x0, 0x0) = 0 0
394/0xaf0b0: 19 100 0 thread_selfid(0x0, 0x0, 0x0) = 716976 0
394/0xaf0b0: 51 31 25 read(0xE, "\2613-|7\342\226a\266J\340\034\0", 0x40) = 64 0
394/0xaf0b0: 67 10 3 bsdthread_ctl(0x400, 0x182BF, 0x800) = 0 0
394/0xaf0b0: 94 75 12 read(0xE, "r\317\207\332\253\263\255\236\001\331\340\253\304\003\020<\234\251^O\376\326\373\016\225\215\321\005`\261\357\233\255\023\271#hd\265m'\254\v\321\305K\005\2572c\337\352\2252=\304\274\027\002Z\016M\t\017\0", 0x40) = 64 0
394/0xaf0b0: 109 7 1 bsdthread_ctl(0x400, 0x182BF, 0x800) = 0 0
394/0xaf0b0: 128 12 9 read(0xE, "\335@N\247\324\364\321\n\264XbQK\312\333g\030\346,|X\327\020b(\361\241\335$4S\314\275]\023\257\312\310\025\327\364\375\222q`\325\033\214\"\365>*\022e\344\027\354\326>X@ \377\027\0", 0x40 = 64 0
394/0xaf0b0: 165 9 1 read(0x12, "\0", 0x8000) = -1 Err#35
394/0xaf0b0: 206 5 0 read(0x12, "\0", 0x8000) = -1 Err#35
394/0xaf0b0: 283 75 0 __disable_threadsignal(0x1, 0x0, 0x0) = 0 0
336/0xaf114: 15 88 1 thread_selfid(0x0, 0x0, 0x0) = 717076 0
336/0xaf114: 33 6 1 kevent64(0x3, 0x107CDBDF8, 0x1) = 1 0
336/0xaf114: 41 76 0 __disable_threadsignal(0x1, 0x0, 0x0) = 0 0
79/0xaf164: 46 105 1 bsdthread_ctl(0x100, 0x8FF, 0x7123) = 0 0
79/0xaf164: 52 4 0 bsdthread_ctl(0x100, 0x8FF, 0x0) = 0 0
79/0xaf164: 14 80 1 thread_selfid(0x0, 0x0, 0x0) = 717156 0
79/0xaf164: 19 4 0 bsdthread_ctl(0x100, 0x8FF, 0x7123) = 0 0
79/0xaf164: 36 11 8 workq_kernreturn(0x20, 0x0, 0x1) = 0 0
79/0xaf164: 37 3 0 bsdthread_ctl(0x100, 0x8FF, 0x0) = 0 0
79/0xaf164: 60 92 2 bsdthread_ctl(0x100, 0x8FF, 0x7123) = 0 0
79/0xaf164: 63 3 0 bsdthread_ctl(0x100, 0x8FF, 0x0) = 0 0
79/0xaf164: 97 67 2 bsdthread_ctl(0x100, 0x8FF, 0x7A57) = 0 0
79/0xaf164: 753 4 0 bsdthread_ctl(0x100, 0x8FF, 0x0) = 0 0
79/0xaf164: 74 79 1 bsdthread_ctl(0x100, 0x8FF, 0xA21B) = 0 0
79/0xaf164: 87 7 3 workq_kernreturn(0x20, 0x0, 0x1) = 0 0
79/0xaf164: 89 4 0 bsdthread_ctl(0x100, 0x8FF, 0x0) = 0 0
79/0xaf164: 764 9 0 bsdthread_ctl(0x100, 0x8FF, 0xA22B) = 0 0
79/0xaf164: 779 71 3 workq_kernreturn(0x20, 0x0, 0x1) = 0 0
79/0xaf164: 781 4 0 bsdthread_ctl(0x100, 0x8FF, 0x0) = 0 0
643/0xaf19c: 17 54 0 __pthread_canceled(0x2, 0x0, 0x0) = 0 0
643/0xaf19c: 21 6 2 psynch_cvsignal(0x600000161948, 0x100, 0x0) = 257 0
643/0xaf19c: 25 7 2 psynch_mutexdrop(0x600000161908, 0x303, 0x200) = 0 0
643/0xaf19c: 28 3 0 __pthread_canceled(0x1, 0x303, 0x200) = 0 0
643/0xaf19c: 29 2 0 __pthread_canceled(0x2, 0x303, 0x200) = 0 0
643/0xaf19c: 36 9 6 socket(0x2, 0x2, 0x0) = 15 0
643/0xaf19c: 38 3 1 fcntl(0xF, 0x4, 0x4) = 0 0
643/0xaf19c: 39 3 1 setsockopt(0xF, 0xFFFF, 0x20) = 0 0
643/0xaf19c: 66 29 26 sendto(0xF, 0x10000AD00, 0x10) = 16 0
643/0xaf19c: 68 3 0 __pthread_canceled(0x1, 0x10000AD00, 0x10) = 0 0
643/0xaf19c: 73 53 0 __pthread_canceled(0x2, 0x10000AD00, 0x10) = 0 0
79/0xaf164: 823 125 1 __disable_threadsignal(0x1, 0x0, 0x0) = 0 0
643/0xaf19c: 7 10 1 thread_selfid(0x0, 0x0, 0x0) = 717212 0
643/0xaf19c: 86 1004030 11 select(0x400, 0x100605E20, 0x0, 0x0, 0x100605E10) = 0 0
643/0xaf19c: 91 54 0 __pthread_canceled(0x1, 0x100605E20, 0x0) = 0 0
643/0xaf19c: 92 2 0 __pthread_canceled(0x2, 0x100605E20, 0x0) = 0 0
643/0xaf19c: 104 1004911 11 select(0x400, 0x100605E20, 0x0, 0x0, 0x100605E10) = 0 0
643/0xaf19c: 110 53 0 __pthread_canceled(0x1, 0x100605E20, 0x0) = 0 0
643/0xaf19c: 111 2 0 __pthread_canceled(0x2, 0x100605E20, 0x0) = 0 0
643/0xaf19c: 118 1003943 6 select(0x400, 0x100605E20, 0x0, 0x0, 0x100605E10) = 0 0
643/0xaf19c: 121 53 0 __pthread_canceled(0x1, 0x100605E20, 0x0) = 0 0
643/0xaf19c: 122 2 0 __pthread_canceled(0x2, 0x100605E20, 0x0) = 0 0
643/0xaf19c: 127 1003585 5 select(0x400, 0x100605E20, 0x0, 0x0, 0x100605E10) = 0 0
643/0xaf19c: 130 86 0 __pthread_canceled(0x1, 0x100605E20, 0x0) = 0 0
643/0xaf19c: 131 4 0 __pthread_canceled(0x2, 0x100605E20, 0x0) = 0 0
643/0xaf19c: 139 1004688 7 select(0x400, 0x100605E20, 0x0, 0x0, 0x100605E10) = 0 0
643/0xaf19c: 144 93 1 __pthread_canceled(0x1, 0x100605E20, 0x0) = 0 0
643/0xaf19c: 149 50 0 __pthread_canceled(0x2, 0x100605E20, 0x0) = 0 0
643/0xaf19c: 161 1003412 9 select(0x400, 0x100605E20, 0x0, 0x0, 0x100605E10) = 0 0
643/0xaf19c: 166 94 1 shutdown(0xF, 0x2, 0x0) = -1 Err#57
643/0xaf19c: 176 14 8 close(0xF) = 0 0
643/0xaf1e3: 8 58 0 thread_selfid(0x0, 0x0, 0x0) = 717283 0
643/0xaf1e3: 13 4 0 __pthread_canceled(0x2, 0x0, 0x0) = 0 0
643/0xaf1e3: 18 6 3 psynch_cvsignal(0x600000160748, 0x100, 0x0) = 257 0
643/0xaf1e3: 22 2 0 __pthread_canceled(0x1, 0x100, 0x0) = 0 0
643/0xaf1e3: 22 2 0 __pthread_canceled(0x2, 0x100, 0x0) = 0 0
643/0xaf1e3: 28 8 5 socket(0x2, 0x2, 0x0) = 14 0
643/0xaf1e3: 31 5 2 fcntl(0xE, 0x4, 0x4) = 0 0
643/0xaf1e3: 35 6 2 setsockopt(0xE, 0xFFFF, 0x20) = 0 0
643/0xaf1e3: 81 50 45 sendto(0xE, 0x10000AD00, 0x10) = 16 0
643/0xaf1e3: 84 3 0 __pthread_canceled(0x1, 0x10000AD00, 0x10) = 0 0
643/0xaf1e3: 84 3 0 __pthread_canceled(0x2, 0x10000AD00, 0x10) = 0 0
643/0xaf19c: 183 1004331 6 __semwait_signal(0xD07, 0x0, 0x1) = -1 Err#60
643/0xaf19c: 194 94 1 __disable_threadsignal(0x1, 0x0, 0x1) = 0 0
643/0xaf1e3: 94 1002400 9 select(0x400, 0x100582E20, 0x0, 0x0, 0x100582E10) = 0 0
643/0xaf1e3: 99 80 0 __pthread_canceled(0x1, 0x100582E20, 0x0) = 0 0
643/0xaf1e3: 101 6 0 __pthread_canceled(0x2, 0x100582E20, 0x0) = 0 0
643/0xaf1e3: 115 1001195 12 select(0x400, 0x100582E20, 0x0, 0x0, 0x100582E10) = 0 0
643/0xaf1e3: 119 65 0 __pthread_canceled(0x1, 0x100582E20, 0x0) = 0 0
643/0xaf1e3: 120 3 0 __pthread_canceled(0x2, 0x100582E20, 0x0) = 0 0
643/0xaf1e3: 155 63 0 __pthread_canceled(0x1, 0x100582E20, 0x0) = 0 0
643/0xaf1e3: 156 3 0 __pthread_canceled(0x2, 0x100582E20, 0x0) = 0 0
643/0xaf1e3: 145 1004925 24 select(0x400, 0x100582E20, 0x0, 0x0, 0x100582E10) = 0 0
643/0xaf1e3: 180 1004109 22 select(0x400, 0x100582E20, 0x0, 0x0, 0x100582E10) = 0 0
643/0xaf1e3: 185 53 0 __pthread_canceled(0x1, 0x100582E20, 0x0) = 0 0
643/0xaf1e3: 186 2 0 __pthread_canceled(0x2, 0x100582E20, 0x0) = 0 0
643/0xaf1e3: 248 52 0 __pthread_canceled(0x2, 0x100582E20, 0x0) = 0 0
643/0xaf1e3: 225 1004682 38 select(0x400, 0x100582E20, 0x0, 0x0, 0x100582E10) = 0 0
643/0xaf1e3: 240 188 10 __pthread_canceled(0x1, 0x100582E20, 0x0) = 0 0
643/0xaf1e3: 261 1002730 11 select(0x400, 0x100582E20, 0x0, 0x0, 0x100582E10) = 0 0
643/0xaf1e3: 266 81 1 shutdown(0xE, 0x2, 0x0) = -1 Err#57
643/0xaf1e3: 270 6 3 close(0xE) = 0 0
643/0xaf1ed: 77 63 0 __pthread_canceled(0x1, 0x10000AD00, 0x10) = 0 0
643/0xaf1ed: 78 2 0 __pthread_canceled(0x2, 0x10000AD00, 0x10) = 0 0
643/0xaf1e3: 310 57 2 __disable_threadsignal(0x1, 0x0, 0x1) = 0 0
643/0xaf1ed: 6 55 0 thread_selfid(0x0, 0x0, 0x0) = 717293 0
643/0xaf1ed: 10 3 0 __pthread_canceled(0x2, 0x0, 0x0) = 0 0
643/0xaf1ed: 14 6 2 psynch_cvsignal(0x608000160F88, 0x100, 0x0) = 257 0
643/0xaf1ed: 16 2 0 __pthread_canceled(0x1, 0x100, 0x0) = 0 0
643/0xaf1ed: 17 2 0 __pthread_canceled(0x2, 0x100, 0x0) = 0 0
643/0xaf1ed: 21 6 4 socket(0x2, 0x2, 0x0) = 14 0
643/0xaf1ed: 24 4 1 fcntl(0xE, 0x4, 0x4) = 0 0
643/0xaf1ed: 27 6 2 setsockopt(0xE, 0xFFFF, 0x20) = 0 0
643/0xaf1ed: 73 48 44 sendto(0xE, 0x10000AD00, 0x10) = 16 0
643/0xaf1e3: 293 1004823 22 __semwait_signal(0xD07, 0x0, 0x1) = -1 Err#60
643/0xaf1ed: 85 1003630 6 select(0x400, 0x100582E20, 0x0, 0x0, 0x100582E10) = 0 0
643/0xaf1ed: 87 53 0 __pthread_canceled(0x1, 0x100582E20, 0x0) = 0 0
643/0xaf1ed: 88 2 0 __pthread_canceled(0x2, 0x100582E20, 0x0) = 0 0
643/0xaf1ed: 97 1004027 7 select(0x400, 0x100582E20, 0x0, 0x0, 0x100582E10) = 0 0
643/0xaf1ed: 101 92 0 __pthread_canceled(0x1, 0x100582E20, 0x0) = 0 0
643/0xaf1ed: 102 4 0 __pthread_canceled(0x2, 0x100582E20, 0x0) = 0 0
643/0xaf1ed: 109 1004818 6 select(0x400, 0x100582E20, 0x0, 0x0, 0x100582E10) = 0 0
643/0xaf1ed: 112 54 0 __pthread_canceled(0x1, 0x100582E20, 0x0) = 0 0
643/0xaf1ed: 113 2 0 __pthread_canceled(0x2, 0x100582E20, 0x0) = 0 0
643/0xaf1ed: 119 1003729 5 select(0x400, 0x100582E20, 0x0, 0x0, 0x100582E10) = 0 0
643/0xaf1ed: 122 75 0 __pthread_canceled(0x1, 0x100582E20, 0x0) = 0 0
643/0xaf1ed: 123 5 0 __pthread_canceled(0x2, 0x100582E20, 0x0) = 0 0
643/0xaf1ed: 132 1004609 6 select(0x400, 0x100582E20, 0x0, 0x0, 0x100582E10) = 0 0
643/0xaf1ed: 134 53 0 __pthread_canceled(0x1, 0x100582E20, 0x0) = 0 0
643/0xaf1ed: 135 2 0 __pthread_canceled(0x2, 0x100582E20, 0x0) = 0 0
643/0xaf1ed: 146 1004204 10 select(0x400, 0x100582E20, 0x0, 0x0, 0x100582E10) = 0 0
643/0xaf1ed: 154 54 1 shutdown(0xE, 0x2, 0x0) = -1 Err#57
643/0xaf1ed: 160 8 5 close(0xE) = 0 0
643/0xaf22d: 12 95 1 thread_selfid(0x0, 0x0, 0x0) = 717357 0
643/0xaf22d: 18 4 0 __pthread_canceled(0x2, 0x0, 0x0) = 0 0
643/0xaf22d: 24 8 3 psynch_cvsignal(0x600000160748, 0x100, 0x0) = 257 0
643/0xaf22d: 27 3 0 __pthread_canceled(0x1, 0x100, 0x0) = 0 0
643/0xaf22d: 28 3 0 __pthread_canceled(0x2, 0x100, 0x0) = 0 0
643/0xaf22d: 36 11 7 socket(0x2, 0x2, 0x0) = 14 0
643/0xaf22d: 39 6 2 fcntl(0xE, 0x4, 0x4) = 0 0
643/0xaf22d: 43 7 3 setsockopt(0xE, 0xFFFF, 0x20) = 0 0
643/0xaf22d: 87 46 42 sendto(0xE, 0x10000AD00, 0x10) = 16 0
643/0xaf22d: 99 4 0 __pthread_canceled(0x2, 0x10000AD00, 0x10) = 0 0
643/0xaf1ed: 166 1002886 5 __semwait_signal(0xD07, 0x0, 0x1) = -1 Err#60
643/0xaf1ed: 177 57 2 __disable_threadsignal(0x1, 0x0, 0x1) = 0 0
643/0xaf22d: 95 9 1 __pthread_canceled(0x1, 0x10000AD00, 0x10) = 0 0
643/0xaf22d: 113 1004298 12 select(0x400, 0x100582E20, 0x0, 0x0, 0x100582E10) = 0 0
643/0xaf22d: 121 54 0 __pthread_canceled(0x1, 0x100582E20, 0x0) = 0 0
643/0xaf22d: 122 2 0 __pthread_canceled(0x2, 0x100582E20, 0x0) = 0 0
643/0xaf22d: 133 1000804 10 select(0x400, 0x100582E20, 0x0, 0x0, 0x100582E10) = 0 0
643/0xaf22d: 142 100 3 __pthread_canceled(0x1, 0x100582E20, 0x0) = 0 0
643/0xaf22d: 152 88 1 __pthread_canceled(0x2, 0x100582E20, 0x0) = 0 0
643/0xaf22d: 168 1002433 14 select(0x400, 0x100582E20, 0x0, 0x0, 0x100582E10) = 0 0
643/0xaf22d: 180 87 1 __pthread_canceled(0x1, 0x100582E20, 0x0) = 0 0
643/0xaf22d: 182 2 0 __pthread_canceled(0x2, 0x100582E20, 0x0) = 0 0
643/0xaf22d: 207 1004819 24 select(0x400, 0x100582E20, 0x0, 0x0, 0x100582E10) = 0 0
643/0xaf22d: 213 54 0 __pthread_canceled(0x1, 0x100582E20, 0x0) = 0 0
643/0xaf22d: 214 2 0 __pthread_canceled(0x2, 0x100582E20, 0x0) = 0 0
643/0xaf22d: 241 86 0 __pthread_canceled(0x1, 0x100582E20, 0x0) = 0 0
643/0xaf22d: 243 2 0 __pthread_canceled(0x2, 0x100582E20, 0x0) = 0 0
643/0xaf22d: 226 1003847 10 select(0x400, 0x100582E20, 0x0, 0x0, 0x100582E10) = 0 0
643/0xaf22d: 255 1003744 11 select(0x400, 0x100582E20, 0x0, 0x0, 0x100582E10) = 0 0
643/0xaf22d: 262 91 1 shutdown(0xE, 0x2, 0x0) = -1 Err#57
643/0xaf22d: 272 14 9 close(0xE) = 0 0
643/0xaf22d: 281 1004776 6 __semwait_signal(0xD07, 0x0, 0x1) = -1 Err#60
643/0xaf22d: 291 93 0 __disable_threadsignal(0x1, 0x0, 0x1) = 0 0
643/0xaf247: 7 69 0 thread_selfid(0x0, 0x0, 0x0) = 717383 0
643/0xaf247: 13 3 0 __pthread_canceled(0x2, 0x0, 0x0) = 0 0
643/0xaf247: 17 6 2 psynch_cvsignal(0x600000161948, 0x100, 0x0) = 257 0
643/0xaf247: 20 6 2 psynch_mutexdrop(0x600000161908, 0x303, 0x200) = 0 0
643/0xaf247: 23 3 0 __pthread_canceled(0x1, 0x303, 0x200) = 0 0
643/0xaf247: 23 2 0 __pthread_canceled(0x2, 0x303, 0x200) = 0 0
643/0xaf247: 30 8 6 socket(0x2, 0x2, 0x0) = 15 0
643/0xaf247: 32 4 1 fcntl(0xF, 0x4, 0x4) = 0 0
643/0xaf247: 34 3 1 setsockopt(0xF, 0xFFFF, 0x20) = 0 0
643/0xaf247: 62 31 28 sendto(0xF, 0x10000AD00, 0x10) = 16 0
643/0xaf247: 64 3 0 __pthread_canceled(0x1, 0x10000AD00, 0x10) = 0 0
643/0xaf247: 65 4 0 __pthread_canceled(0x2, 0x10000AD00, 0x10) = 0 0
643/0xaf247: 73 1004705 7 select(0x400, 0x100605E20, 0x0, 0x0, 0x100605E10) = 0 0
643/0xaf247: 76 83 0 __pthread_canceled(0x1, 0x100605E20, 0x0) = 0 0
643/0xaf247: 77 2 0 __pthread_canceled(0x2, 0x100605E20, 0x0) = 0 0
643/0xaf247: 90 1004139 12 select(0x400, 0x100605E20, 0x0, 0x0, 0x100605E10) = 0 0
643/0xaf247: 98 88 2 __pthread_canceled(0x1, 0x100605E20, 0x0) = 0 0
643/0xaf247: 100 2 0 __pthread_canceled(0x2, 0x100605E20, 0x0) = 0 0
643/0xaf247: 110 1004943 9 select(0x400, 0x100605E20, 0x0, 0x0, 0x100605E10) = 0 0
643/0xaf247: 113 58 0 __pthread_canceled(0x1, 0x100605E20, 0x0) = 0 0
643/0xaf247: 114 2 0 __pthread_canceled(0x2, 0x100605E20, 0x0) = 0 0
643/0xaf247: 124 1003992 8 select(0x400, 0x100605E20, 0x0, 0x0, 0x100605E10) = 0 0
643/0xaf247: 128 68 0 __pthread_canceled(0x1, 0x100605E20, 0x0) = 0 0
643/0xaf247: 136 67 2 __pthread_canceled(0x2, 0x100605E20, 0x0) = 0 0
643/0xaf247: 152 1004386 10 select(0x400, 0x100605E20, 0x0, 0x0, 0x100605E10) = 0 0
643/0xaf247: 165 200 8 __pthread_canceled(0x1, 0x100605E20, 0x0) = 0 0
643/0xaf247: 166 4 0 __pthread_canceled(0x2, 0x100605E20, 0x0) = 0 0
643/0xaf247: 177 1003822 10 select(0x400, 0x100605E20, 0x0, 0x0, 0x100605E10) = 0 0
643/0xaf247: 182 54 1 shutdown(0xF, 0x2, 0x0) = -1 Err#57
643/0xaf247: 188 7 4 close(0xF) = 0 0
643/0xaf25a: 22 56 0 thread_selfid(0x0, 0x0, 0x0) = 717402 0
643/0xaf25a: 28 3 0 __pthread_canceled(0x2, 0x0, 0x0) = 0 0
643/0xaf25a: 32 6 3 psynch_cvsignal(0x600000160748, 0x100, 0x0) = 257 0
643/0xaf25a: 35 2 0 __pthread_canceled(0x1, 0x100, 0x0) = 0 0
643/0xaf25a: 36 2 0 __pthread_canceled(0x2, 0x100, 0x0) = 0 0
643/0xaf25a: 41 7 4 socket(0x2, 0x2, 0x0) = 14 0
643/0xaf25a: 44 4 1 fcntl(0xE, 0x4, 0x4) = 0 0
643/0xaf25a: 47 6 2 setsockopt(0xE, 0xFFFF, 0x20) = 0 0
643/0xaf25a: 88 43 39 sendto(0xE, 0x10000AD00, 0x10) = 16 0
643/0xaf247: 196 1003587 6 __semwait_signal(0xD07, 0x0, 0x1) = -1 Err#60
643/0xaf247: 206 56 2 __disable_threadsignal(0x1, 0x0, 0x1) = 0 0
643/0xaf25a: 100 110 0 __pthread_canceled(0x1, 0x10000AD00, 0x10) = 0 0
643/0xaf25a: 101 2 0 __pthread_canceled(0x2, 0x10000AD00, 0x10) = 0 0
643/0xaf25a: 109 1003598 6 select(0x400, 0x100582E20, 0x0, 0x0, 0x100582E10) = 0 0
643/0xaf25a: 113 57 1 __pthread_canceled(0x1, 0x100582E20, 0x0) = 0 0
643/0xaf25a: 114 3 0 __pthread_canceled(0x2, 0x100582E20, 0x0) = 0 0
643/0xaf25a: 122 1000135 7 select(0x400, 0x100582E20, 0x0, 0x0, 0x100582E10) = 0 0
643/0xaf25a: 127 73 0 __pthread_canceled(0x1, 0x100582E20, 0x0) = 0 0
643/0xaf25a: 128 3 0 __pthread_canceled(0x2, 0x100582E20, 0x0) = 0 0
643/0xaf25a: 136 1004577 6 select(0x400, 0x100582E20, 0x0, 0x0, 0x100582E10) = 0 0
643/0xaf25a: 140 91 0 __pthread_canceled(0x1, 0x100582E20, 0x0) = 0 0
643/0xaf25a: 142 4 0 __pthread_canceled(0x2, 0x100582E20, 0x0) = 0 0
643/0xaf25a: 149 1000961 6 select(0x400, 0x100582E20, 0x0, 0x0, 0x100582E10) = 0 0
643/0xaf25a: 151 57 0 __pthread_canceled(0x1, 0x100582E20, 0x0) = 0 0
643/0xaf25a: 153 4 0 __pthread_canceled(0x2, 0x100582E20, 0x0) = 0 0
643/0xaf25a: 159 1002299 6 select(0x400, 0x100582E20, 0x0, 0x0, 0x100582E10) = 0 0
643/0xaf25a: 163 93 0 __pthread_canceled(0x1, 0x100582E20, 0x0) = 0 0
643/0xaf25a: 165 5 0 __pthread_canceled(0x2, 0x100582E20, 0x0) = 0 0
643/0xaf25a: 174 1003983 7 select(0x400, 0x100582E20, 0x0, 0x0, 0x100582E10) = 0 0
643/0xaf25a: 177 60 1 shutdown(0xE, 0x2, 0x0) = -1 Err#57
643/0xaf25a: 180 5 2 close(0xE) = 0 0
643/0xaf25a: 185 1004727 3 __semwait_signal(0xD07, 0x0, 0x1) = -1 Err#60
643/0xaf25a: 191 75 2 __disable_threadsignal(0x1, 0x0, 0x1) = 0 0
643/0xaf287: 8 103 0 thread_selfid(0x0, 0x0, 0x0) = 717447 0
643/0xaf287: 17 4 0 __pthread_canceled(0x2, 0x0, 0x0) = 0 0
643/0xaf287: 23 9 4 psynch_cvsignal(0x600000161948, 0x100, 0x0) = 257 0
643/0xaf287: 28 8 3 psynch_mutexdrop(0x600000161908, 0x303, 0x200) = 0 0
643/0xaf287: 34 5 1 __pthread_canceled(0x1, 0x303, 0x200) = 0 0
643/0xaf287: 35 3 0 __pthread_canceled(0x2, 0x303, 0x200) = 0 0
643/0xaf287: 44 12 8 socket(0x2, 0x2, 0x0) = 14 0
643/0xaf287: 47 5 1 fcntl(0xE, 0x4, 0x4) = 0 0
643/0xaf287: 50 6 2 setsockopt(0xE, 0xFFFF, 0x20) = 0 0
643/0xaf287: 94 46 42 sendto(0xE, 0x10000AD00, 0x10) = 16 0
643/0xaf287: 96 3 0 __pthread_canceled(0x1, 0x10000AD00, 0x10) = 0 0
643/0xaf287: 97 3 0 __pthread_canceled(0x2, 0x10000AD00, 0x10) = 0 0
643/0xaf287: 114 1004632 16 select(0x400, 0x100582E20, 0x0, 0x0, 0x100582E10) = 0 0
643/0xaf287: 118 100 0 __pthread_canceled(0x1, 0x100582E20, 0x0) = 0 0
643/0xaf287: 119 2 0 __pthread_canceled(0x2, 0x100582E20, 0x0) = 0 0
643/0xaf287: 136 65 0 __pthread_canceled(0x1, 0x100582E20, 0x0) = 0 0
643/0xaf287: 138 2 0 __pthread_canceled(0x2, 0x100582E20, 0x0) = 0 0
643/0xaf287: 131 1005010 11 select(0x400, 0x100582E20, 0x0, 0x0, 0x100582E10) = 0 0
643/0xaf287: 156 101 0 __pthread_canceled(0x1, 0x100582E20, 0x0) = 0 0
643/0xaf287: 157 3 0 __pthread_canceled(0x2, 0x100582E20, 0x0) = 0 0
643/0xaf287: 148 1000190 9 select(0x400, 0x100582E20, 0x0, 0x0, 0x100582E10) = 0 0
^ permalink raw reply [flat|nested] 41+ messages in thread* Re: Deadlock when receiving kill-signal from child process 2015-08-03 11:25 Deadlock when receiving kill-signal from child process Mathias Fredriksson @ 2015-08-03 15:52 ` Bart Schaefer 2015-08-03 20:36 ` Mathias Fredriksson 0 siblings, 1 reply; 41+ messages in thread From: Bart Schaefer @ 2015-08-03 15:52 UTC (permalink / raw) To: zsh-workers On Aug 3, 2:25pm, Mathias Fredriksson wrote: } } On OSX 10.10 using ZSH 5.0.5 (OSX), 5.0.7 and 5.0.8 (Homebrew) I am } able to trigger a deadlock of zsh when sending a kill-signal from a } child process to a parent process. Is that 5.0.8 or 5.0.8-dev-1 from SourceForge git? I *think* this problem should have been fixed by workers/35642 (git 811027a22a806f753537abee1575da8714d3fa0a) and I cannot reproduce with ZSH_PATCHLEVEL = zsh-5.0.8-154-gd90f921. -- Barton E. Schaefer ^ permalink raw reply [flat|nested] 41+ messages in thread
* Re: Deadlock when receiving kill-signal from child process 2015-08-03 15:52 ` Bart Schaefer @ 2015-08-03 20:36 ` Mathias Fredriksson 2015-08-03 20:58 ` Bart Schaefer 0 siblings, 1 reply; 41+ messages in thread From: Mathias Fredriksson @ 2015-08-03 20:36 UTC (permalink / raw) To: zsh-workers On Mon, Aug 3, 2015 at 6:52 PM, Bart Schaefer wrote: } } Is that 5.0.8 or 5.0.8-dev-1 from SourceForge git? It is 5.0.8 } } I *think* this problem should have been fixed by workers/35642 (git } 811027a22a806f753537abee1575da8714d3fa0a) and I cannot reproduce with } ZSH_PATCHLEVEL = zsh-5.0.8-154-gd90f921. I just tried applying this patch to 5.0.8 and I am still able to reproduce, occasionally zsh even exits with the following (maybe related): zsh: illegal hardware instruction ./zsh_deadlock.zsh If workers/35642 alone was supposed to fix this I think it remains unfixed. ^ permalink raw reply [flat|nested] 41+ messages in thread
* Re: Deadlock when receiving kill-signal from child process 2015-08-03 20:36 ` Mathias Fredriksson @ 2015-08-03 20:58 ` Bart Schaefer 2015-08-04 21:52 ` Mathias Fredriksson 0 siblings, 1 reply; 41+ messages in thread From: Bart Schaefer @ 2015-08-03 20:58 UTC (permalink / raw) To: zsh-workers On Aug 3, 11:36pm, Mathias Fredriksson wrote: } } I just tried applying this patch to 5.0.8 and I am still able to } reproduce, occasionally zsh even exits with the following (maybe } related): } } zsh: illegal hardware instruction ./zsh_deadlock.zsh If you can get a stack trace from the deadlocked zsh, that would be helpful. A stack trace from the SIGILL's zsh might also be helpful, but that is less likely. ^ permalink raw reply [flat|nested] 41+ messages in thread
* Re: Deadlock when receiving kill-signal from child process 2015-08-03 20:58 ` Bart Schaefer @ 2015-08-04 21:52 ` Mathias Fredriksson 2015-08-05 0:05 ` Mathias Fredriksson 2015-08-05 6:53 ` Bart Schaefer 0 siblings, 2 replies; 41+ messages in thread From: Mathias Fredriksson @ 2015-08-04 21:52 UTC (permalink / raw) To: zsh-workers [-- Attachment #1: Type: text/plain, Size: 597 bytes --] On Mon, Aug 3, 2015 at 11:58 PM, Bart Schaefer wrote: } } If you can get a stack trace from the deadlocked zsh, that would be } helpful. I've tried to produce a stack trace on OS X with dtruss, but it slows down zsh too much and I am never able to reproduce the deadlock scenario. I have however managed to get a dump with strace on Gentoo (also here, I've applied the patch discussed earlier), see attachment. } } A stack trace from the SIGILL's zsh might also be helpful, but that is } less likely. I will see if I manage to do it, but even without a debugger, I have rarely seen this error. [-- Attachment #2: deadlock.trace --] [-- Type: application/octet-stream, Size: 52272 bytes --] execve("./deadlock.zsh", ["./deadlock.zsh"], [/* 16 vars */]) = 0 brk(0) = 0xdbc000 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7fed2e89b000 access("/etc/ld.so.preload", R_OK) = -1 ENOENT (No such file or directory) open("/etc/ld.so.cache", O_RDONLY|O_CLOEXEC) = 3 fstat(3, {st_mode=S_IFREG|0644, st_size=28002, ...}) = 0 mmap(NULL, 28002, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7fed2e894000 close(3) = 0 open("/lib64/libc.so.6", O_RDONLY|O_CLOEXEC) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0`\33\2\0\0\0\0\0@\0\0\0\0\0\0\0\210\364\31\0\0\0\0\0\0\0\0\0@\0008\0\v\0@\0A\0@\0\6\0\0\0\5\0\0\0@\0\0\0\0\0\0\0@\0\0\0\0\0\0\0@\0\0\0\0\0\0\0h\2\0\0\0\0\0\0h\2\0\0\0\0\0\0\10\0\0\0\0\0\0\0\3\0\0\0\4\0\0\0\360\330\26\0\0\0\0\0\360\330\26\0\0\0\0\0\360\330\26\0\0\0\0\0\34\0\0\0\0\0\0\0\34\0\0\0\0\0\0\0\20\0\0\0\0\0\0\0\1\0\0\0\5\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\322\220\31\0\0\0\0\0\322\220\31\0\0\0\0\0\0\0 \0\0\0\0\0\1\0\0\0\6\0\0\0`\227\31\0\0\0\0\0`\2279\0\0\0\0\0`\2279\0\0\0\0\0\370O\0\0\0\0\0\0\370\224\0\0\0\0\0\0\0\0 \0\0\0\0\0\2\0\0\0\6\0\0\0\240\313\31\0\0\0\0\0\240\3139\0\0\0\0\0\240\3139\0\0\0\0\0\340\1\0\0\0\0\0\0\340\1\0\0\0\0\0\0\10\0\0\0\0\0\0\0\4\0\0\0\4\0\0\0\250\2\0\0\0\0\0\0\250\2\0\0\0\0\0\0\250\2\0\0\0\0\0\0 \0\0\0\0\0\0\0 \0\0\0\0\0\0\0\4\0\0\0\0\0\0\0\7\0\0\0\4\0\0\0`\227\31\0\0\0\0\0`\2279\0\0\0\0\0`\2279\0\0\0\0\0\20\0\0\0\0\0\0\0\200\0\0\0\0\0\0\0\10\0\0\0\0\0\0\0P\345td\4\0\0\0\f\331\26\0\0\0\0\0\f\331\26\0\0\0\0\0\f\331\26\0\0\0\0\0li\0\0\0\0\0\0li\0\0\0\0\0\0\4\0\0\0\0\0\0\0Q\345td\6\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\20\0\0\0\0\0\0\0R\345td\4\0\0\0`\227\31\0\0\0\0\0`\2279\0\0\0\0\0`\2279\0\0\0\0\0\2408\0\0\0\0\0\0\2408\0\0\0\0\0\0\1\0\0\0\0\0\0\0\200\25\4e\0(\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\10\0\0\0\0\0\0\0\4\0\0\0\20\0\0\0\1\0\0\0GNU\0\0\0\0\0\2\0\0\0\6\0\0\0\20\0\0\0\363\3\0\0\n\0\0\0\0\1\0\0\16\0\0\0\0000\20D\240 \2\1\210\3\346\220\305E\214\0\300\0\10\0\5\200\0`\300\200\0\r\212\f\0\4\20\0\210D2\10.@\210P4, \16\"H&\204\300\214\4\10\0\2\2\16\241\254\32\4f\300\0\3002\0\300\0P\1"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0755, st_size=1705160, ...}) = 0 mmap(NULL, 3812440, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7fed2e2d9000 mprotect(0x7fed2e473000, 2093056, PROT_NONE) = 0 mmap(0x7fed2e672000, 24576, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x199000) = 0x7fed2e672000 mmap(0x7fed2e678000, 15448, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7fed2e678000 close(3) = 0 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7fed2e893000 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7fed2e892000 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7fed2e891000 arch_prctl(ARCH_SET_FS, 0x7fed2e892700) = 0 mprotect(0x7fed2e672000, 16384, PROT_READ) = 0 mprotect(0x605000, 4096, PROT_READ) = 0 mprotect(0x7fed2e89c000, 4096, PROT_READ) = 0 munmap(0x7fed2e894000, 28002) = 0 brk(0) = 0xdbc000 brk(0xddd000) = 0xddd000 open("/usr/lib64/locale/locale-archive", O_RDONLY|O_CLOEXEC) = 3 fstat(3, {st_mode=S_IFREG|0644, st_size=1607712, ...}) = 0 mmap(NULL, 1607712, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7fed2e708000 close(3) = 0 execve("/bin/zsh", ["zsh", "./deadlock.zsh"], [/* 16 vars */]) = 0 brk(0) = 0x1b1b000 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7ff1c877d000 access("/etc/ld.so.preload", R_OK) = -1 ENOENT (No such file or directory) open("/etc/ld.so.cache", O_RDONLY|O_CLOEXEC) = 3 fstat(3, {st_mode=S_IFREG|0644, st_size=28002, ...}) = 0 mmap(NULL, 28002, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7ff1c8776000 close(3) = 0 open("/lib64/libdl.so.2", O_RDONLY|O_CLOEXEC) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\340\16\0\0\0\0\0\0@\0\0\0\0\0\0\0\2201\0\0\0\0\0\0\0\0\0\0@\0008\0\n\0@\0\33\0\32\0\6\0\0\0\5\0\0\0@\0\0\0\0\0\0\0@\0\0\0\0\0\0\0@\0\0\0\0\0\0\0000\2\0\0\0\0\0\0000\2\0\0\0\0\0\0\10\0\0\0\0\0\0\0\3\0\0\0\4\0\0\0P\32\0\0\0\0\0\0P\32\0\0\0\0\0\0P\32\0\0\0\0\0\0\34\0\0\0\0\0\0\0\34\0\0\0\0\0\0\0\20\0\0\0\0\0\0\0\1\0\0\0\5\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0T\36\0\0\0\0\0\0T\36\0\0\0\0\0\0\0\0 \0\0\0\0\0\1\0\0\0\6\0\0\0p-\0\0\0\0\0\0p- \0\0\0\0\0p- \0\0\0\0\0000\3\0\0\0\0\0\0\250\3\0\0\0\0\0\0\0\0 \0\0\0\0\0\2\0\0\0\6\0\0\0\230-\0\0\0\0\0\0\230- \0\0\0\0\0\230- \0\0\0\0\0\0\2\0\0\0\0\0\0\0\2\0\0\0\0\0\0\10\0\0\0\0\0\0\0\4\0\0\0\4\0\0\0p\2\0\0\0\0\0\0p\2\0\0\0\0\0\0p\2\0\0\0\0\0\0 \0\0\0\0\0\0\0 \0\0\0\0\0\0\0\4\0\0\0\0\0\0\0P\345td\4\0\0\0l\32\0\0\0\0\0\0l\32\0\0\0\0\0\0l\32\0\0\0\0\0\0\274\0\0\0\0\0\0\0\274\0\0\0\0\0\0\0\4\0\0\0\0\0\0\0Q\345td\6\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\20\0\0\0\0\0\0\0R\345td\4\0\0\0p-\0\0\0\0\0\0p- \0\0\0\0\0p- \0\0\0\0\0\220\2\0\0\0\0\0\0\220\2\0\0\0\0\0\0\1\0\0\0\0\0\0\0\200\25\4e\0(\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\10\0\0\0\0\0\0\0\4\0\0\0\20\0\0\0\1\0\0\0GNU\0\0\0\0\0\2\0\0\0\6\0\0\0\20\0\0\0\33\0\0\0\33\0\0\0\2\0\0\0\7\0\0\0\230\2\21\0\200H\0\4\22\0\0@\203(\10\236\33\0\0\0\0\0\0\0\34\0\0\0\0\0\0\0\0\0\0\0\35\0\0\0\0\0\0\0\36\0\0\0\0\0\0\0\37\0\0\0\0\0\0\0 \0\0\0\0\0\0\0!\0\0\0#\0\0\0$\0\0\0&\0\0\0'\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0(\0\0\0\0\0\0\0\0\0\0\0\353\26\251\30"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0755, st_size=14416, ...}) = 0 mmap(NULL, 2109720, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7ff1c835a000 mprotect(0x7ff1c835c000, 2097152, PROT_NONE) = 0 mmap(0x7ff1c855c000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x2000) = 0x7ff1c855c000 close(3) = 0 open("/lib64/libncursesw.so.5", O_RDONLY|O_CLOEXEC) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0pS\1\0\0\0\0\0@\0\0\0\0\0\0\0X\1\6\0\0\0\0\0\0\0\0\0@\0008\0\7\0@\0\31\0\30\0\1\0\0\0\5\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\214\257\5\0\0\0\0\0\214\257\5\0\0\0\0\0\0\0 \0\0\0\0\0\1\0\0\0\6\0\0\0\220\273\5\0\0\0\0\0\220\273%\0\0\0\0\0\220\273%\0\0\0\0\0\360D\0\0\0\0\0\0\270N\0\0\0\0\0\0\0\0 \0\0\0\0\0\2\0\0\0\6\0\0\0\200\354\5\0\0\0\0\0\200\354%\0\0\0\0\0\200\354%\0\0\0\0\0\320\1\0\0\0\0\0\0\320\1\0\0\0\0\0\0\10\0\0\0\0\0\0\0P\345td\4\0\0\0\264,\5\0\0\0\0\0\264,\5\0\0\0\0\0\264,\5\0\0\0\0\0\304\25\0\0\0\0\0\0\304\25\0\0\0\0\0\0\4\0\0\0\0\0\0\0Q\345td\6\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\20\0\0\0\0\0\0\0R\345td\4\0\0\0\220\273\5\0\0\0\0\0\220\273%\0\0\0\0\0\220\273%\0\0\0\0\0p4\0\0\0\0\0\0p4\0\0\0\0\0\0\1\0\0\0\0\0\0\0\200\25\4e\0(\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\10\0\0\0\0\0\0\0\305\3\0\0g\0\0\0@\0\0\0\f\0\0\0J \306\10\0\204&\210\2611\f!\3160\t\32h\240\1\1\300P0\21\27&\356B\1B\206A\34\202@\5\2\t(!\0\204\4 \0\1\0020\2\20\0\240\0%\21A\312\35\311a\1\242\247\20m\1\241\4\1\20 H|\20\300\0\240A\0\6PD\4\221\n\0\\F\0\0 \22\30\220\0034H\7\214 \1\204s%P\206 *\210\0012\1\30\0\205\0\0@\20\10\2\200B4\6\f#`\4\304\0@\2\22\3\6\1c\f&\300B\0001@\320\20\f\30D\202\220\20\205\264Q4M\0\212\10Ps\5\nf\260\4\210Q\320\302V\261\34\v\20\4\240,\200\250\t\f\2068R\0B\0\2$\302\202\20\1 \0\332\204-\302\2619\260\0$\21\1\0\24\0\1\31Vd.\214\220$\2\0\f\242\202\fX@\10\4\f!\233!;0C\"\7!\370\372\200\210\5\200\363\21\2\31\7\0\222\303\223V@P1(\1\0\2\2D\1(=\211\t4\t$\0\20\4\0\22\24\214*\202\224\230\322\2\5j\214\320\nB\223\254\0247\226\0\1\3\20 \10 R8`\7\4A\0\200A\0\22\0\240\305\302\20(\4,\320\210\3408\20"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0755, st_size=395160, ...}) = 0 mmap(NULL, 2493000, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7ff1c80f9000 mprotect(0x7ff1c8154000, 2097152, PROT_NONE) = 0 mmap(0x7ff1c8354000, 24576, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x5b000) = 0x7ff1c8354000 close(3) = 0 open("/lib64/libm.so.6", O_RDONLY|O_CLOEXEC) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\360T\0\0\0\0\0\0@\0\0\0\0\0\0\0\330\341\17\0\0\0\0\0\0\0\0\0@\0008\0\n\0@\0\33\0\32\0\6\0\0\0\5\0\0\0@\0\0\0\0\0\0\0@\0\0\0\0\0\0\0@\0\0\0\0\0\0\0000\2\0\0\0\0\0\0000\2\0\0\0\0\0\0\10\0\0\0\0\0\0\0\3\0\0\0\4\0\0\0\340p\17\0\0\0\0\0\340p\17\0\0\0\0\0\340p\17\0\0\0\0\0\34\0\0\0\0\0\0\0\34\0\0\0\0\0\0\0\20\0\0\0\0\0\0\0\1\0\0\0\5\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\274\332\17\0\0\0\0\0\274\332\17\0\0\0\0\0\0\0 \0\0\0\0\0\1\0\0\0\6\0\0\0\240\335\17\0\0\0\0\0\240\335/\0\0\0\0\0\240\335/\0\0\0\0\0L\3\0\0\0\0\0\0\230\3\0\0\0\0\0\0\0\0 \0\0\0\0\0\2\0\0\0\6\0\0\0\270\335\17\0\0\0\0\0\270\335/\0\0\0\0\0\270\335/\0\0\0\0\0\0\2\0\0\0\0\0\0\0\2\0\0\0\0\0\0\10\0\0\0\0\0\0\0\4\0\0\0\4\0\0\0p\2\0\0\0\0\0\0p\2\0\0\0\0\0\0p\2\0\0\0\0\0\0 \0\0\0\0\0\0\0 \0\0\0\0\0\0\0\4\0\0\0\0\0\0\0P\345td\4\0\0\0\374p\17\0\0\0\0\0\374p\17\0\0\0\0\0\374p\17\0\0\0\0\0\374\22\0\0\0\0\0\0\374\22\0\0\0\0\0\0\4\0\0\0\0\0\0\0Q\345td\6\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\20\0\0\0\0\0\0\0R\345td\4\0\0\0\240\335\17\0\0\0\0\0\240\335/\0\0\0\0\0\240\335/\0\0\0\0\0`\2\0\0\0\0\0\0`\2\0\0\0\0\0\0\1\0\0\0\0\0\0\0\200\25\4e\0(\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\10\0\0\0\0\0\0\0\4\0\0\0\20\0\0\0\1\0\0\0GNU\0\0\0\0\0\2\0\0\0\6\0\0\0\20\0\0\0\35\3\0\0\24\0\0\0@\0\0\0\f\0\0\0%\0`\0\0\240.\"\200\0\26\211\0 E\"\2\0\300``i\10\212\0\t\0\0\0\0\0\0\0\0\0\0\0\0\212P\20\1\10\0\0\4\1\302\24\1 \210\"\0\304\243X\240\n\6\216\0\212\0\0\4\0@\0\0 \20\0\5\0\5\r\7\7\22A\0\1\0\10\0\0@\0\t\0\20\4D\30\4\200a(\22@\4\1\nE\221 @\200\f\22\1\0\0\0\0\0\0\0\0\4\2\0\0\0@\0\200"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0755, st_size=1042584, ...}) = 0 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7ff1c8775000 mmap(NULL, 3137848, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7ff1c7dfa000 mprotect(0x7ff1c7ef8000, 2093056, PROT_NONE) = 0 mmap(0x7ff1c80f7000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0xfd000) = 0x7ff1c80f7000 close(3) = 0 open("/lib64/libc.so.6", O_RDONLY|O_CLOEXEC) = 3 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0`\33\2\0\0\0\0\0@\0\0\0\0\0\0\0\210\364\31\0\0\0\0\0\0\0\0\0@\0008\0\v\0@\0A\0@\0\6\0\0\0\5\0\0\0@\0\0\0\0\0\0\0@\0\0\0\0\0\0\0@\0\0\0\0\0\0\0h\2\0\0\0\0\0\0h\2\0\0\0\0\0\0\10\0\0\0\0\0\0\0\3\0\0\0\4\0\0\0\360\330\26\0\0\0\0\0\360\330\26\0\0\0\0\0\360\330\26\0\0\0\0\0\34\0\0\0\0\0\0\0\34\0\0\0\0\0\0\0\20\0\0\0\0\0\0\0\1\0\0\0\5\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\322\220\31\0\0\0\0\0\322\220\31\0\0\0\0\0\0\0 \0\0\0\0\0\1\0\0\0\6\0\0\0`\227\31\0\0\0\0\0`\2279\0\0\0\0\0`\2279\0\0\0\0\0\370O\0\0\0\0\0\0\370\224\0\0\0\0\0\0\0\0 \0\0\0\0\0\2\0\0\0\6\0\0\0\240\313\31\0\0\0\0\0\240\3139\0\0\0\0\0\240\3139\0\0\0\0\0\340\1\0\0\0\0\0\0\340\1\0\0\0\0\0\0\10\0\0\0\0\0\0\0\4\0\0\0\4\0\0\0\250\2\0\0\0\0\0\0\250\2\0\0\0\0\0\0\250\2\0\0\0\0\0\0 \0\0\0\0\0\0\0 \0\0\0\0\0\0\0\4\0\0\0\0\0\0\0\7\0\0\0\4\0\0\0`\227\31\0\0\0\0\0`\2279\0\0\0\0\0`\2279\0\0\0\0\0\20\0\0\0\0\0\0\0\200\0\0\0\0\0\0\0\10\0\0\0\0\0\0\0P\345td\4\0\0\0\f\331\26\0\0\0\0\0\f\331\26\0\0\0\0\0\f\331\26\0\0\0\0\0li\0\0\0\0\0\0li\0\0\0\0\0\0\4\0\0\0\0\0\0\0Q\345td\6\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\20\0\0\0\0\0\0\0R\345td\4\0\0\0`\227\31\0\0\0\0\0`\2279\0\0\0\0\0`\2279\0\0\0\0\0\2408\0\0\0\0\0\0\2408\0\0\0\0\0\0\1\0\0\0\0\0\0\0\200\25\4e\0(\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\10\0\0\0\0\0\0\0\4\0\0\0\20\0\0\0\1\0\0\0GNU\0\0\0\0\0\2\0\0\0\6\0\0\0\20\0\0\0\363\3\0\0\n\0\0\0\0\1\0\0\16\0\0\0\0000\20D\240 \2\1\210\3\346\220\305E\214\0\300\0\10\0\5\200\0`\300\200\0\r\212\f\0\4\20\0\210D2\10.@\210P4, \16\"H&\204\300\214\4\10\0\2\2\16\241\254\32\4f\300\0\3002\0\300\0P\1"..., 832) = 832 fstat(3, {st_mode=S_IFREG|0755, st_size=1705160, ...}) = 0 mmap(NULL, 3812440, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7ff1c7a57000 mprotect(0x7ff1c7bf1000, 2093056, PROT_NONE) = 0 mmap(0x7ff1c7df0000, 24576, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x199000) = 0x7ff1c7df0000 mmap(0x7ff1c7df6000, 15448, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7ff1c7df6000 close(3) = 0 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7ff1c8774000 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7ff1c8773000 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7ff1c8772000 arch_prctl(ARCH_SET_FS, 0x7ff1c8773700) = 0 mprotect(0x7ff1c7df0000, 16384, PROT_READ) = 0 mprotect(0x7ff1c80f7000, 4096, PROT_READ) = 0 mprotect(0x7ff1c8354000, 16384, PROT_READ) = 0 mprotect(0x7ff1c855c000, 4096, PROT_READ) = 0 mprotect(0x6aa000, 4096, PROT_READ) = 0 mprotect(0x7ff1c877e000, 4096, PROT_READ) = 0 munmap(0x7ff1c8776000, 28002) = 0 brk(0) = 0x1b1b000 brk(0x1b3c000) = 0x1b3c000 open("/usr/lib64/locale/locale-archive", O_RDONLY|O_CLOEXEC) = 3 fstat(3, {st_mode=S_IFREG|0644, st_size=1607712, ...}) = 0 mmap(NULL, 1607712, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7ff1c85e9000 close(3) = 0 getrlimit(RLIMIT_NOFILE, {rlim_cur=1024, rlim_max=4*1024}) = 0 getuid() = 0 geteuid() = 0 getgid() = 0 getegid() = 0 ioctl(0, TCGETS, {B38400 opost isig icanon echo ...}) = 0 ioctl(0, TCGETS, {B38400 opost isig icanon echo ...}) = 0 ioctl(0, TCGETS, {B38400 opost isig icanon echo ...}) = 0 fstat(0, {st_mode=S_IFCHR|0620, st_rdev=makedev(136, 5), ...}) = 0 readlink("/proc/self/fd/0", "/dev/pts/5", 4095) = 10 stat("/dev/pts/5", {st_mode=S_IFCHR|0620, st_rdev=makedev(136, 5), ...}) = 0 open("/dev/pts/5", O_RDWR|O_NOCTTY) = 3 fcntl(3, F_DUPFD, 10) = 10 close(3) = 0 fcntl(10, F_GETFD) = 0 fcntl(10, F_SETFD, FD_CLOEXEC) = 0 getpid() = 49318 pipe([3, 4]) = 0 dup(0) = 5 dup(0) = 6 dup(0) = 7 dup(0) = 8 dup(0) = 9 getppid() = 49316 getuid() = 0 open("/etc/nsswitch.conf", O_RDONLY|O_CLOEXEC) = 11 fcntl(11, F_GETFD) = 0x1 (flags FD_CLOEXEC) fstat(11, {st_mode=S_IFREG|0644, st_size=508, ...}) = 0 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7ff1c877c000 read(11, "# /etc/nsswitch.conf:\n# $Header: /var/cvsroot/gentoo/src/patchsets/glibc/extra/etc/nsswitch.conf,v 1.1 2006/09/29 23:52:23 vapier Exp $\n\npasswd: compat\nshadow: compat\ngroup: compat\n\n# passwd: db files nis\n# shadow: db files nis\n# group: db files nis\n\nhosts: files dns\nnetworks: files dns\n\nservices: db files\nprotocols: db files\nrpc: db files\nethers: db files\nnetmasks: files\nnetgroup: files\nbootparams: files\n\nautomount: files\naliases: files\n", 4096) = 508 read(11, "", 4096) = 0 close(11) = 0 munmap(0x7ff1c877c000, 4096) = 0 open("/etc/ld.so.cache", O_RDONLY|O_CLOEXEC) = 11 fstat(11, {st_mode=S_IFREG|0644, st_size=28002, ...}) = 0 mmap(NULL, 28002, PROT_READ, MAP_PRIVATE, 11, 0) = 0x7ff1c8776000 close(11) = 0 open("/lib64/libnss_compat.so.2", O_RDONLY|O_CLOEXEC) = 11 read(11, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0P\24\0\0\0\0\0\0@\0\0\0\0\0\0\0\360\203\0\0\0\0\0\0\0\0\0\0@\0008\0\n\0@\0\33\0\32\0\6\0\0\0\5\0\0\0@\0\0\0\0\0\0\0@\0\0\0\0\0\0\0@\0\0\0\0\0\0\0000\2\0\0\0\0\0\0000\2\0\0\0\0\0\0\10\0\0\0\0\0\0\0\3\0\0\0\4\0\0\0Pb\0\0\0\0\0\0Pb\0\0\0\0\0\0Pb\0\0\0\0\0\0\34\0\0\0\0\0\0\0\34\0\0\0\0\0\0\0\20\0\0\0\0\0\0\0\1\0\0\0\5\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\364m\0\0\0\0\0\0\364m\0\0\0\0\0\0\0\0 \0\0\0\0\0\1\0\0\0\6\0\0\0\230}\0\0\0\0\0\0\230} \0\0\0\0\0\230} \0\0\0\0\0h\5\0\0\0\0\0\0(\7\0\0\0\0\0\0\0\0 \0\0\0\0\0\2\0\0\0\6\0\0\0\260}\0\0\0\0\0\0\260} \0\0\0\0\0\260} \0\0\0\0\0\20\2\0\0\0\0\0\0\20\2\0\0\0\0\0\0\10\0\0\0\0\0\0\0\4\0\0\0\4\0\0\0p\2\0\0\0\0\0\0p\2\0\0\0\0\0\0p\2\0\0\0\0\0\0 \0\0\0\0\0\0\0 \0\0\0\0\0\0\0\4\0\0\0\0\0\0\0P\345td\4\0\0\0lb\0\0\0\0\0\0lb\0\0\0\0\0\0lb\0\0\0\0\0\0\254\1\0\0\0\0\0\0\254\1\0\0\0\0\0\0\4\0\0\0\0\0\0\0Q\345td\6\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\20\0\0\0\0\0\0\0R\345td\4\0\0\0\230}\0\0\0\0\0\0\230} \0\0\0\0\0\230} \0\0\0\0\0h\2\0\0\0\0\0\0h\2\0\0\0\0\0\0\1\0\0\0\0\0\0\0\200\25\4e\0(\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\10\0\0\0\0\0\0\0\4\0\0\0\20\0\0\0\1\0\0\0GNU\0\0\0\0\0\2\0\0\0\6\0\0\0\20\0\0\0\32\0\0\0)\0\0\0\2\0\0\0\7\0\0\0Q\0\1\2\20\t\220\r\20\4\23\200\1H\272\201)\0\0\0*\0\0\0+\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0,\0\0\0-\0\0\0.\0\0\0\0\0\0\0000\0\0\0\0\0\0\0\0\0\0\0002\0\0\0003\0\0\0004\0\0\0\0\0\0\0\0\0\0\0005\0\0\0\0\0\0\0006\0\0\0007\0\0\0\0\0\0\0008\0\0\0\207[\246\22\365\33=\274"..., 832) = 832 fstat(11, {st_mode=S_IFREG|0755, st_size=35504, ...}) = 0 mmap(NULL, 2131136, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 11, 0) = 0x7ff1c784e000 mprotect(0x7ff1c7855000, 2097152, PROT_NONE) = 0 mmap(0x7ff1c7a55000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 11, 0x7000) = 0x7ff1c7a55000 close(11) = 0 open("/lib64/libnsl.so.1", O_RDONLY|O_CLOEXEC) = 11 read(11, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0pA\0\0\0\0\0\0@\0\0\0\0\0\0\0XD\1\0\0\0\0\0\0\0\0\0@\0008\0\n\0@\0\33\0\32\0\6\0\0\0\5\0\0\0@\0\0\0\0\0\0\0@\0\0\0\0\0\0\0@\0\0\0\0\0\0\0000\2\0\0\0\0\0\0000\2\0\0\0\0\0\0\10\0\0\0\0\0\0\0\3\0\0\0\4\0\0\0\200\26\1\0\0\0\0\0\200\26\1\0\0\0\0\0\200\26\1\0\0\0\0\0\34\0\0\0\0\0\0\0\34\0\0\0\0\0\0\0\20\0\0\0\0\0\0\0\1\0\0\0\5\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\224:\1\0\0\0\0\0\224:\1\0\0\0\0\0\0\0 \0\0\0\0\0\1\0\0\0\6\0\0\0h=\1\0\0\0\0\0h=!\0\0\0\0\0h=!\0\0\0\0\0\0\6\0\0\0\0\0\0000-\0\0\0\0\0\0\0\0 \0\0\0\0\0\2\0\0\0\6\0\0\0\200=\1\0\0\0\0\0\200=!\0\0\0\0\0\200=!\0\0\0\0\0\0\2\0\0\0\0\0\0\0\2\0\0\0\0\0\0\10\0\0\0\0\0\0\0\4\0\0\0\4\0\0\0p\2\0\0\0\0\0\0p\2\0\0\0\0\0\0p\2\0\0\0\0\0\0 \0\0\0\0\0\0\0 \0\0\0\0\0\0\0\4\0\0\0\0\0\0\0P\345td\4\0\0\0\234\26\1\0\0\0\0\0\234\26\1\0\0\0\0\0\234\26\1\0\0\0\0\0\234\5\0\0\0\0\0\0\234\5\0\0\0\0\0\0\4\0\0\0\0\0\0\0Q\345td\6\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\20\0\0\0\0\0\0\0R\345td\4\0\0\0h=\1\0\0\0\0\0h=!\0\0\0\0\0h=!\0\0\0\0\0\230\2\0\0\0\0\0\0\230\2\0\0\0\0\0\0\1\0\0\0\0\0\0\0\200\25\4e\0(\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\10\0\0\0\0\0\0\0\4\0\0\0\20\0\0\0\1\0\0\0GNU\0\0\0\0\0\2\0\0\0\6\0\0\0\20\0\0\0\370\0\0\0s\0\0\0\20\0\0\0\n\0\0\0\1\0015\232 '@\0@\0\0\2\f!\1\10\0:\0\0\241\nX\0H\0\16,\0\5\200\6`\260\23 @\224\21\20@\344r\224D\350\206@1\250\202@\260z\1=\10\331\0\0\20\26\200\0044B\201*\0209\203K\200\20 \"\221\3\0D\200\302*d`E\10\0\4\4\t\4PDB\200\20\300\22!\4`@\0\32 \0\0\0\10\4\2\200\220\200\0\344#\0\212$\2\206\210\0\0`\300"..., 832) = 832 fstat(11, {st_mode=S_IFREG|0755, st_size=84760, ...}) = 0 mmap(NULL, 2189976, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 11, 0) = 0x7ff1c7637000 mprotect(0x7ff1c764b000, 2093056, PROT_NONE) = 0 mmap(0x7ff1c784a000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 11, 0x13000) = 0x7ff1c784a000 mmap(0x7ff1c784c000, 6808, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7ff1c784c000 close(11) = 0 mprotect(0x7ff1c784a000, 4096, PROT_READ) = 0 mprotect(0x7ff1c7a55000, 4096, PROT_READ) = 0 munmap(0x7ff1c8776000, 28002) = 0 open("/etc/ld.so.cache", O_RDONLY|O_CLOEXEC) = 11 fstat(11, {st_mode=S_IFREG|0644, st_size=28002, ...}) = 0 mmap(NULL, 28002, PROT_READ, MAP_PRIVATE, 11, 0) = 0x7ff1c8776000 close(11) = 0 open("/lib64/libnss_nis.so.2", O_RDONLY|O_CLOEXEC) = 11 read(11, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\20\"\0\0\0\0\0\0@\0\0\0\0\0\0\0\220\242\0\0\0\0\0\0\0\0\0\0@\0008\0\n\0@\0\33\0\32\0\6\0\0\0\5\0\0\0@\0\0\0\0\0\0\0@\0\0\0\0\0\0\0@\0\0\0\0\0\0\0000\2\0\0\0\0\0\0000\2\0\0\0\0\0\0\10\0\0\0\0\0\0\0\3\0\0\0\4\0\0\0\20\207\0\0\0\0\0\0\20\207\0\0\0\0\0\0\20\207\0\0\0\0\0\0\34\0\0\0\0\0\0\0\34\0\0\0\0\0\0\0\20\0\0\0\0\0\0\0\1\0\0\0\5\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\214\230\0\0\0\0\0\0\214\230\0\0\0\0\0\0\0\0 \0\0\0\0\0\1\0\0\0\6\0\0\0\200\235\0\0\0\0\0\0\200\235 \0\0\0\0\0\200\235 \0\0\0\0\0$\4\0\0\0\0\0\0X\7\0\0\0\0\0\0\0\0 \0\0\0\0\0\2\0\0\0\6\0\0\0\230\235\0\0\0\0\0\0\230\235 \0\0\0\0\0\230\235 \0\0\0\0\0 \2\0\0\0\0\0\0 \2\0\0\0\0\0\0\10\0\0\0\0\0\0\0\4\0\0\0\4\0\0\0p\2\0\0\0\0\0\0p\2\0\0\0\0\0\0p\2\0\0\0\0\0\0 \0\0\0\0\0\0\0 \0\0\0\0\0\0\0\4\0\0\0\0\0\0\0P\345td\4\0\0\0,\207\0\0\0\0\0\0,\207\0\0\0\0\0\0,\207\0\0\0\0\0\0d\2\0\0\0\0\0\0d\2\0\0\0\0\0\0\4\0\0\0\0\0\0\0Q\345td\6\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\20\0\0\0\0\0\0\0R\345td\4\0\0\0\200\235\0\0\0\0\0\0\200\235 \0\0\0\0\0\200\235 \0\0\0\0\0\200\2\0\0\0\0\0\0\200\2\0\0\0\0\0\0\1\0\0\0\0\0\0\0\200\25\4e\0(\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\10\0\0\0\0\0\0\0\4\0\0\0\20\0\0\0\1\0\0\0GNU\0\0\0\0\0\2\0\0\0\6\0\0\0\20\0\0\0g\0\0\0005\0\0\0\10\0\0\0\t\0\0\0\0\0\4X\" \22\0\0\0Bg\3\0\1\4\t\03448P\30\6\243\331\220\212$ \1\10\0\342@\310\224E\20\211\244\0\0\4\20\10@\0@!\0\0\4\0\0\0\200\0\v\0y\343\0D\202\0\0\0\0005\0\0\0006\0\0\0\0\0\0\0007\0\0\0008\0\0\0009\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0:\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0;\0\0\0\0\0\0\0"..., 832) = 832 fstat(11, {st_mode=S_IFREG|0755, st_size=43344, ...}) = 0 mmap(NULL, 2139352, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 11, 0) = 0x7ff1c742c000 mprotect(0x7ff1c7436000, 2093056, PROT_NONE) = 0 mmap(0x7ff1c7635000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 11, 0x9000) = 0x7ff1c7635000 close(11) = 0 open("/lib64/libnss_files.so.2", O_RDONLY|O_CLOEXEC) = 11 read(11, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\0#\0\0\0\0\0\0@\0\0\0\0\0\0\0h\262\0\0\0\0\0\0\0\0\0\0@\0008\0\n\0@\0\33\0\32\0\6\0\0\0\5\0\0\0@\0\0\0\0\0\0\0@\0\0\0\0\0\0\0@\0\0\0\0\0\0\0000\2\0\0\0\0\0\0000\2\0\0\0\0\0\0\10\0\0\0\0\0\0\0\3\0\0\0\4\0\0\0\260\225\0\0\0\0\0\0\260\225\0\0\0\0\0\0\260\225\0\0\0\0\0\0\34\0\0\0\0\0\0\0\34\0\0\0\0\0\0\0\20\0\0\0\0\0\0\0\1\0\0\0\5\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0d\255\0\0\0\0\0\0d\255\0\0\0\0\0\0\0\0 \0\0\0\0\0\1\0\0\0\6\0\0\0\230\255\0\0\0\0\0\0\230\255 \0\0\0\0\0\230\255 \0\0\0\0\0\340\3\0\0\0\0\0\0\30\10\0\0\0\0\0\0\0\0 \0\0\0\0\0\2\0\0\0\6\0\0\0\260\255\0\0\0\0\0\0\260\255 \0\0\0\0\0\260\255 \0\0\0\0\0\0\2\0\0\0\0\0\0\0\2\0\0\0\0\0\0\10\0\0\0\0\0\0\0\4\0\0\0\4\0\0\0p\2\0\0\0\0\0\0p\2\0\0\0\0\0\0p\2\0\0\0\0\0\0 \0\0\0\0\0\0\0 \0\0\0\0\0\0\0\4\0\0\0\0\0\0\0P\345td\4\0\0\0\314\225\0\0\0\0\0\0\314\225\0\0\0\0\0\0\314\225\0\0\0\0\0\0D\3\0\0\0\0\0\0D\3\0\0\0\0\0\0\4\0\0\0\0\0\0\0Q\345td\6\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\20\0\0\0\0\0\0\0R\345td\4\0\0\0\230\255\0\0\0\0\0\0\230\255 \0\0\0\0\0\230\255 \0\0\0\0\0h\2\0\0\0\0\0\0h\2\0\0\0\0\0\0\1\0\0\0\0\0\0\0\200\25\4e\0(\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\10\0\0\0\0\0\0\0\4\0\0\0\20\0\0\0\1\0\0\0GNU\0\0\0\0\0\2\0\0\0\6\0\0\0\20\0\0\0k\0\0\0002\0\0\0\10\0\0\0\t\0\0\0\22F\344\25\240\245\201\0\t\10\2\30\223\6\210\0\0\0z\0]\201\240Jx\2108*\220\200\0$\7!\5\24)\"\226<\0\4\0\33\0\20\2\0\0@\10\201\3100\200\200B@\206\0\302\0\200\3002\0\0\0003\0\0\0\0\0\0\0004\0\0\0005\0\0\0006\0\0\0007\0\0\0008\0\0\0\0\0\0\0009\0\0\0\0\0\0\0:\0\0\0<\0\0\0=\0\0\0\0\0\0\0?\0\0\0"..., 832) = 832 fstat(11, {st_mode=S_IFREG|0755, st_size=47400, ...}) = 0 mmap(NULL, 2143664, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 11, 0) = 0x7ff1c7220000 mprotect(0x7ff1c722b000, 2093056, PROT_NONE) = 0 mmap(0x7ff1c742a000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 11, 0xa000) = 0x7ff1c742a000 close(11) = 0 mprotect(0x7ff1c742a000, 4096, PROT_READ) = 0 mprotect(0x7ff1c7635000, 4096, PROT_READ) = 0 munmap(0x7ff1c8776000, 28002) = 0 open("/etc/passwd", O_RDONLY|O_CLOEXEC) = 11 fcntl(11, F_GETFD) = 0x1 (flags FD_CLOEXEC) lseek(11, 0, SEEK_CUR) = 0 fstat(11, {st_mode=S_IFREG|0644, st_size=1057, ...}) = 0 mmap(NULL, 1057, PROT_READ, MAP_SHARED, 11, 0) = 0x7ff1c877c000 lseek(11, 1057, SEEK_SET) = 1057 munmap(0x7ff1c877c000, 1057) = 0 close(11) = 0 stat("/root", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 stat(".", {st_mode=S_IFDIR|0755, st_size=4096, ...}) = 0 mmap(NULL, 16384, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7ff1c8779000 stat(".", {st_mode=S_IFDIR|0755, st_size=4096, ...}) = 0 stat("..", {st_mode=S_IFDIR|0755, st_size=4096, ...}) = 0 openat(AT_FDCWD, "..", O_RDONLY|O_NONBLOCK|O_DIRECTORY|O_CLOEXEC) = 11 getdents(11, /* 4 entries */, 32768) = 112 lstat("../mathias", {st_mode=S_IFDIR|0755, st_size=4096, ...}) = 0 close(11) = 0 chdir("..") = 0 stat("..", {st_mode=S_IFDIR|0755, st_size=4096, ...}) = 0 openat(AT_FDCWD, "..", O_RDONLY|O_NONBLOCK|O_DIRECTORY|O_CLOEXEC) = 11 getdents(11, /* 23 entries */, 32768) = 592 lstat("../home", {st_mode=S_IFDIR|0755, st_size=4096, ...}) = 0 close(11) = 0 chdir("..") = 0 stat("..", {st_mode=S_IFDIR|0755, st_size=4096, ...}) = 0 chdir("/home/mathias") = 0 open("/usr/lib64/gconv/gconv-modules.cache", O_RDONLY) = 11 fstat(11, {st_mode=S_IFREG|0644, st_size=26244, ...}) = 0 mmap(NULL, 26244, PROT_READ, MAP_SHARED, 11, 0) = 0x7ff1c85e2000 close(11) = 0 uname({sysname="Linux", nodename="asustorx", ...}) = 0 open("/proc/self/loginuid", O_RDONLY) = 11 read(11, "1000", 12) = 4 close(11) = 0 open("/etc/passwd", O_RDONLY|O_CLOEXEC) = 11 lseek(11, 0, SEEK_CUR) = 0 fstat(11, {st_mode=S_IFREG|0644, st_size=1057, ...}) = 0 mmap(NULL, 1057, PROT_READ, MAP_SHARED, 11, 0) = 0x7ff1c8778000 lseek(11, 1057, SEEK_SET) = 1057 munmap(0x7ff1c8778000, 1057) = 0 close(11) = 0 uname({sysname="Linux", nodename="asustorx", ...}) = 0 ioctl(10, TIOCGWINSZ, {ws_row=29, ws_col=125, ws_xpixel=0, ws_ypixel=0}) = 0 getrlimit(RLIMIT_CPU, {rlim_cur=RLIM64_INFINITY, rlim_max=RLIM64_INFINITY}) = 0 getrlimit(RLIMIT_FSIZE, {rlim_cur=RLIM64_INFINITY, rlim_max=RLIM64_INFINITY}) = 0 getrlimit(RLIMIT_DATA, {rlim_cur=RLIM64_INFINITY, rlim_max=RLIM64_INFINITY}) = 0 getrlimit(RLIMIT_STACK, {rlim_cur=8192*1024, rlim_max=RLIM64_INFINITY}) = 0 getrlimit(RLIMIT_CORE, {rlim_cur=0, rlim_max=RLIM64_INFINITY}) = 0 getrlimit(RLIMIT_RSS, {rlim_cur=RLIM64_INFINITY, rlim_max=RLIM64_INFINITY}) = 0 getrlimit(RLIMIT_NPROC, {rlim_cur=31595, rlim_max=31595}) = 0 getrlimit(RLIMIT_NOFILE, {rlim_cur=1024, rlim_max=4*1024}) = 0 getrlimit(RLIMIT_MEMLOCK, {rlim_cur=64*1024, rlim_max=64*1024}) = 0 getrlimit(RLIMIT_AS, {rlim_cur=RLIM64_INFINITY, rlim_max=RLIM64_INFINITY}) = 0 getrlimit(RLIMIT_LOCKS, {rlim_cur=RLIM64_INFINITY, rlim_max=RLIM64_INFINITY}) = 0 getrlimit(RLIMIT_SIGPENDING, {rlim_cur=31595, rlim_max=31595}) = 0 getrlimit(RLIMIT_MSGQUEUE, {rlim_cur=800*1024, rlim_max=800*1024}) = 0 getrlimit(RLIMIT_NICE, {rlim_cur=0, rlim_max=0}) = 0 getrlimit(RLIMIT_RTPRIO, {rlim_cur=0, rlim_max=0}) = 0 getrlimit(RLIMIT_RTTIME, {rlim_cur=RLIM64_INFINITY, rlim_max=RLIM64_INFINITY}) = 0 getrusage(RUSAGE_CHILDREN, {ru_utime={0, 0}, ru_stime={0, 0}, ...}) = 0 close(3) = 0 close(4) = 0 close(5) = 0 close(6) = 0 close(7) = 0 close(8) = 0 close(9) = 0 rt_sigaction(SIGQUIT, {SIG_IGN, [QUIT], SA_RESTORER|SA_RESTART, 0x7ff1c7a8c480}, {SIG_DFL, [], 0}, 8) = 0 rt_sigaction(SIGHUP, {SIG_IGN, [HUP], SA_RESTORER|SA_RESTART, 0x7ff1c7a8c480}, {SIG_DFL, [], 0}, 8) = 0 rt_sigaction(SIGHUP, {0x478810, [], SA_RESTORER, 0x7ff1c7a8c480}, NULL, 8) = 0 rt_sigaction(SIGCHLD, {0x478810, [], SA_RESTORER, 0x7ff1c7a8c480}, NULL, 8) = 0 rt_sigaction(SIGWINCH, {0x478810, [], SA_RESTORER, 0x7ff1c7a8c480}, NULL, 8) = 0 rt_sigprocmask(SIG_BLOCK, [WINCH], [], 8) = 0 stat("/etc/zsh/zshenv.zwc", 0x7fff0bbc5280) = -1 ENOENT (No such file or directory) stat("/etc/zsh/zshenv", 0x7fff0bbc5310) = -1 ENOENT (No such file or directory) open("/etc/zsh/zshenv", O_RDONLY|O_NOCTTY) = -1 ENOENT (No such file or directory) stat("/root/.zshenv.zwc", 0x7fff0bbc5280) = -1 ENOENT (No such file or directory) stat("/root/.zshenv", 0x7fff0bbc5310) = -1 ENOENT (No such file or directory) open("/root/.zshenv", O_RDONLY|O_NOCTTY) = -1 ENOENT (No such file or directory) access("./deadlock.zsh", F_OK) = 0 stat("./deadlock.zsh", {st_mode=S_IFREG|0755, st_size=232, ...}) = 0 open("./deadlock.zsh", O_RDONLY|O_NOCTTY) = 3 fcntl(3, F_DUPFD, 10) = 11 close(3) = 0 fcntl(11, F_GETFL) = 0x8000 (flags O_RDONLY|O_LARGEFILE) fstat(11, {st_mode=S_IFREG|0755, st_size=232, ...}) = 0 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7ff1c8778000 lseek(11, 0, SEEK_CUR) = 0 rt_sigprocmask(SIG_UNBLOCK, [WINCH], [WINCH], 8) = 0 read(11, "#!/usr/bin/env zsh\n\nchild() {\n sleep 0.001\n kill -USR1 $$\n sleep 0.000001\n kill -USR1 $$\n}\n\nTRAPUSR1() {\n print -n \".\"\n}\n\nfor i in {1..10}; do\n child &!\ndone\n\nfor i in {1..99}; do\n sleep 0.000001\ndone\n\nsleep 1\n\n", 4096) = 232 rt_sigprocmask(SIG_BLOCK, [WINCH], [], 8) = 0 rt_sigprocmask(SIG_UNBLOCK, [WINCH], [WINCH], 8) = 0 rt_sigprocmask(SIG_BLOCK, [WINCH], [], 8) = 0 rt_sigprocmask(SIG_UNBLOCK, [WINCH], [WINCH], 8) = 0 rt_sigprocmask(SIG_BLOCK, [WINCH], [], 8) = 0 rt_sigprocmask(SIG_UNBLOCK, [WINCH], [WINCH], 8) = 0 rt_sigprocmask(SIG_BLOCK, [WINCH], [], 8) = 0 rt_sigprocmask(SIG_UNBLOCK, [WINCH], [WINCH], 8) = 0 rt_sigprocmask(SIG_BLOCK, [WINCH], [], 8) = 0 rt_sigprocmask(SIG_UNBLOCK, [WINCH], [WINCH], 8) = 0 rt_sigprocmask(SIG_BLOCK, [WINCH], [], 8) = 0 rt_sigprocmask(SIG_UNBLOCK, [WINCH], [WINCH], 8) = 0 rt_sigprocmask(SIG_BLOCK, [WINCH], [], 8) = 0 rt_sigprocmask(SIG_UNBLOCK, [WINCH], [WINCH], 8) = 0 rt_sigprocmask(SIG_BLOCK, [WINCH], [], 8) = 0 rt_sigprocmask(SIG_UNBLOCK, [WINCH], [WINCH], 8) = 0 rt_sigprocmask(SIG_BLOCK, [WINCH], [], 8) = 0 rt_sigprocmask(SIG_UNBLOCK, [WINCH], [WINCH], 8) = 0 rt_sigprocmask(SIG_BLOCK, [WINCH], [], 8) = 0 rt_sigprocmask(SIG_UNBLOCK, [WINCH], [WINCH], 8) = 0 rt_sigprocmask(SIG_BLOCK, [WINCH], [], 8) = 0 rt_sigprocmask(SIG_UNBLOCK, [WINCH], [WINCH], 8) = 0 rt_sigprocmask(SIG_BLOCK, [WINCH], [], 8) = 0 rt_sigaction(SIGUSR1, {0x478810, [], SA_RESTORER, 0x7ff1c7a8c480}, NULL, 8) = 0 rt_sigprocmask(SIG_UNBLOCK, [WINCH], [WINCH], 8) = 0 rt_sigprocmask(SIG_BLOCK, [WINCH], [], 8) = 0 rt_sigprocmask(SIG_UNBLOCK, [WINCH], [WINCH], 8) = 0 rt_sigprocmask(SIG_BLOCK, [WINCH], [], 8) = 0 rt_sigprocmask(SIG_UNBLOCK, [WINCH], [WINCH], 8) = 0 rt_sigprocmask(SIG_BLOCK, [WINCH], [], 8) = 0 rt_sigprocmask(SIG_UNBLOCK, [WINCH], [WINCH], 8) = 0 rt_sigprocmask(SIG_BLOCK, [WINCH], [], 8) = 0 rt_sigprocmask(SIG_BLOCK, [CHLD], [WINCH], 8) = 0 rt_sigprocmask(SIG_BLOCK, [CHLD], [CHLD WINCH], 8) = 0 rt_sigprocmask(SIG_BLOCK, [CHLD], [CHLD WINCH], 8) = 0 pipe([3, 4]) = 0 clone(child_stack=0, flags=CLONE_CHILD_CLEARTID|CLONE_CHILD_SETTID|SIGCHLD, child_tidptr=0x7ff1c87739d0) = 49319 close(4) = 0 read(3, "", 1) = 0 close(3) = 0 rt_sigprocmask(SIG_UNBLOCK, [CHLD], [CHLD WINCH], 8) = 0 rt_sigprocmask(SIG_BLOCK, [CHLD], [WINCH], 8) = 0 rt_sigprocmask(SIG_BLOCK, [CHLD], [CHLD WINCH], 8) = 0 pipe([3, 4]) = 0 clone(child_stack=0, flags=CLONE_CHILD_CLEARTID|CLONE_CHILD_SETTID|SIGCHLD, child_tidptr=0x7ff1c87739d0) = 49321 close(4) = 0 read(3, "", 1) = 0 close(3) = 0 rt_sigprocmask(SIG_UNBLOCK, [CHLD], [CHLD WINCH], 8) = 0 rt_sigprocmask(SIG_BLOCK, [CHLD], [WINCH], 8) = 0 rt_sigprocmask(SIG_BLOCK, [CHLD], [CHLD WINCH], 8) = 0 pipe([3, 4]) = 0 clone(child_stack=0, flags=CLONE_CHILD_CLEARTID|CLONE_CHILD_SETTID|SIGCHLD, child_tidptr=0x7ff1c87739d0) = 49323 close(4) = 0 read(3, "", 1) = 0 close(3) = 0 rt_sigprocmask(SIG_UNBLOCK, [CHLD], [CHLD WINCH], 8) = 0 rt_sigprocmask(SIG_BLOCK, [CHLD], [WINCH], 8) = 0 rt_sigprocmask(SIG_BLOCK, [CHLD], [CHLD WINCH], 8) = 0 pipe([3, 4]) = 0 clone(child_stack=0, flags=CLONE_CHILD_CLEARTID|CLONE_CHILD_SETTID|SIGCHLD, child_tidptr=0x7ff1c87739d0) = 49325 close(4) = 0 read(3, "", 1) = 0 close(3) = 0 --- SIGUSR1 {si_signo=SIGUSR1, si_code=SI_USER, si_pid=49319, si_uid=0} --- rt_sigprocmask(SIG_BLOCK, ~[RTMIN RT_1], [USR1 CHLD WINCH], 8) = 0 rt_sigprocmask(SIG_SETMASK, [USR1 CHLD WINCH], ~[KILL STOP RTMIN RT_1], 8) = 0 rt_sigprocmask(SIG_BLOCK, [CHLD], [USR1 CHLD WINCH], 8) = 0 write(1, ".", 1) = 1 rt_sigprocmask(SIG_BLOCK, [CHLD], [USR1 CHLD WINCH], 8) = 0 rt_sigprocmask(SIG_UNBLOCK, [CHLD], [USR1 CHLD WINCH], 8) = 0 rt_sigreturn({mask=[CHLD WINCH]}) = 0 --- SIGUSR1 {si_signo=SIGUSR1, si_code=SI_USER, si_pid=49321, si_uid=0} --- rt_sigprocmask(SIG_BLOCK, ~[RTMIN RT_1], [USR1 CHLD WINCH], 8) = 0 rt_sigprocmask(SIG_SETMASK, [USR1 CHLD WINCH], ~[KILL STOP RTMIN RT_1], 8) = 0 rt_sigprocmask(SIG_BLOCK, [CHLD], [USR1 CHLD WINCH], 8) = 0 write(1, ".", 1) = 1 rt_sigprocmask(SIG_BLOCK, [CHLD], [USR1 CHLD WINCH], 8) = 0 rt_sigprocmask(SIG_UNBLOCK, [CHLD], [USR1 CHLD WINCH], 8) = 0 rt_sigreturn({mask=[CHLD WINCH]}) = 0 rt_sigprocmask(SIG_UNBLOCK, [CHLD], [CHLD WINCH], 8) = 0 rt_sigprocmask(SIG_BLOCK, [CHLD], [WINCH], 8) = 0 rt_sigprocmask(SIG_BLOCK, [CHLD], [CHLD WINCH], 8) = 0 pipe([3, 4]) = 0 clone(child_stack=0, flags=CLONE_CHILD_CLEARTID|CLONE_CHILD_SETTID|SIGCHLD, child_tidptr=0x7ff1c87739d0) = 49329 close(4) = 0 read(3, 0x7fff0bbc4940, 1) = ? ERESTARTSYS (To be restarted if SA_RESTART is set) --- SIGUSR1 {si_signo=SIGUSR1, si_code=SI_USER, si_pid=49323, si_uid=0} --- rt_sigprocmask(SIG_BLOCK, ~[RTMIN RT_1], [USR1 CHLD WINCH], 8) = 0 rt_sigprocmask(SIG_SETMASK, [USR1 CHLD WINCH], ~[KILL STOP RTMIN RT_1], 8) = 0 rt_sigprocmask(SIG_BLOCK, [CHLD], [USR1 CHLD WINCH], 8) = 0 write(1, ".", 1) = 1 rt_sigprocmask(SIG_BLOCK, [CHLD], [USR1 CHLD WINCH], 8) = 0 rt_sigprocmask(SIG_UNBLOCK, [CHLD], [USR1 CHLD WINCH], 8) = 0 --- SIGCHLD {si_signo=SIGCHLD, si_code=CLD_EXITED, si_pid=49319, si_uid=0, si_status=0, si_utime=0, si_stime=0} --- rt_sigprocmask(SIG_BLOCK, ~[RTMIN RT_1], [USR1 CHLD WINCH], 8) = 0 rt_sigprocmask(SIG_SETMASK, [USR1 CHLD WINCH], ~[KILL STOP RTMIN RT_1], 8) = 0 wait4(-1, [{WIFEXITED(s) && WEXITSTATUS(s) == 0}], WNOHANG|WSTOPPED|WCONTINUED, {ru_utime={0, 0}, ru_stime={0, 0}, ...}) = 49319 getrusage(RUSAGE_CHILDREN, {ru_utime={0, 0}, ru_stime={0, 0}, ...}) = 0 wait4(-1, 0x7fff0bbc2efc, WNOHANG|WSTOPPED|WCONTINUED, 0x7fff0bbc2f20) = 0 rt_sigreturn({mask=[USR1 WINCH]}) = 0 rt_sigreturn({mask=[CHLD WINCH]}) = -1 EINTR (Interrupted system call) read(3, "", 1) = 0 close(3) = 0 rt_sigprocmask(SIG_UNBLOCK, [CHLD], [CHLD WINCH], 8) = 0 rt_sigprocmask(SIG_BLOCK, [CHLD], [WINCH], 8) = 0 rt_sigprocmask(SIG_BLOCK, [CHLD], [CHLD WINCH], 8) = 0 pipe([3, 4]) = 0 clone(child_stack=0, flags=CLONE_CHILD_CLEARTID|CLONE_CHILD_SETTID|SIGCHLD, child_tidptr=0x7ff1c87739d0) = 49331 close(4) = 0 read(3, "", 1) = 0 --- SIGUSR1 {si_signo=SIGUSR1, si_code=SI_USER, si_pid=49321, si_uid=0} --- rt_sigprocmask(SIG_BLOCK, ~[RTMIN RT_1], [USR1 CHLD WINCH], 8) = 0 rt_sigprocmask(SIG_SETMASK, [USR1 CHLD WINCH], ~[KILL STOP RTMIN RT_1], 8) = 0 rt_sigprocmask(SIG_BLOCK, [CHLD], [USR1 CHLD WINCH], 8) = 0 write(1, ".", 1) = 1 rt_sigprocmask(SIG_BLOCK, [CHLD], [USR1 CHLD WINCH], 8) = 0 rt_sigprocmask(SIG_UNBLOCK, [CHLD], [USR1 CHLD WINCH], 8) = 0 --- SIGCHLD {si_signo=SIGCHLD, si_code=CLD_EXITED, si_pid=49321, si_uid=0, si_status=0, si_utime=0, si_stime=0} --- rt_sigprocmask(SIG_BLOCK, ~[RTMIN RT_1], [USR1 CHLD WINCH], 8) = 0 rt_sigprocmask(SIG_SETMASK, [USR1 CHLD WINCH], ~[KILL STOP RTMIN RT_1], 8) = 0 wait4(-1, [{WIFEXITED(s) && WEXITSTATUS(s) == 0}], WNOHANG|WSTOPPED|WCONTINUED, {ru_utime={0, 0}, ru_stime={0, 0}, ...}) = 49321 getrusage(RUSAGE_CHILDREN, {ru_utime={0, 0}, ru_stime={0, 0}, ...}) = 0 wait4(-1, 0x7fff0bbc2efc, WNOHANG|WSTOPPED|WCONTINUED, 0x7fff0bbc2f20) = 0 rt_sigreturn({mask=[USR1 WINCH]}) = 0 rt_sigreturn({mask=[CHLD WINCH]}) = 0 close(3) = 0 rt_sigprocmask(SIG_UNBLOCK, [CHLD], [CHLD WINCH], 8) = 0 rt_sigprocmask(SIG_BLOCK, [CHLD], [WINCH], 8) = 0 rt_sigprocmask(SIG_BLOCK, [CHLD], [CHLD WINCH], 8) = 0 pipe([3, 4]) = 0 clone(child_stack=0, flags=CLONE_CHILD_CLEARTID|CLONE_CHILD_SETTID|SIGCHLD, child_tidptr=0x7ff1c87739d0) = 49334 close(4) = 0 read(3, "", 1) = 0 close(3) = 0 rt_sigprocmask(SIG_UNBLOCK, [CHLD], [CHLD WINCH], 8) = 0 rt_sigprocmask(SIG_BLOCK, [CHLD], [WINCH], 8) = 0 rt_sigprocmask(SIG_BLOCK, [CHLD], [CHLD WINCH], 8) = 0 pipe([3, 4]) = 0 clone(child_stack=0, flags=CLONE_CHILD_CLEARTID|CLONE_CHILD_SETTID|SIGCHLD, child_tidptr=0x7ff1c87739d0) = 49336 close(4) = 0 read(3, "", 1) = 0 close(3) = 0 rt_sigprocmask(SIG_UNBLOCK, [CHLD], [CHLD WINCH], 8) = 0 rt_sigprocmask(SIG_BLOCK, [CHLD], [WINCH], 8) = 0 rt_sigprocmask(SIG_BLOCK, [CHLD], [CHLD WINCH], 8) = 0 pipe([3, 4]) = 0 clone(child_stack=0, flags=CLONE_CHILD_CLEARTID|CLONE_CHILD_SETTID|SIGCHLD, child_tidptr=0x7ff1c87739d0) = 49338 close(4) = 0 read(3, "", 1) = 0 close(3) = 0 rt_sigprocmask(SIG_UNBLOCK, [CHLD], [CHLD WINCH], 8) = 0 rt_sigprocmask(SIG_BLOCK, [CHLD], [WINCH], 8) = 0 rt_sigprocmask(SIG_BLOCK, [CHLD], [CHLD WINCH], 8) = 0 pipe([3, 4]) = 0 clone(child_stack=0, flags=CLONE_CHILD_CLEARTID|CLONE_CHILD_SETTID|SIGCHLD, child_tidptr=0x7ff1c87739d0) = 49340 close(4) = 0 read(3, "", 1) = 0 --- SIGUSR1 {si_signo=SIGUSR1, si_code=SI_USER, si_pid=49325, si_uid=0} --- rt_sigprocmask(SIG_BLOCK, ~[RTMIN RT_1], [USR1 CHLD WINCH], 8) = 0 rt_sigprocmask(SIG_SETMASK, [USR1 CHLD WINCH], ~[KILL STOP RTMIN RT_1], 8) = 0 rt_sigprocmask(SIG_BLOCK, [CHLD], [USR1 CHLD WINCH], 8) = 0 write(1, ".", 1) = 1 rt_sigprocmask(SIG_BLOCK, [CHLD], [USR1 CHLD WINCH], 8) = 0 rt_sigprocmask(SIG_UNBLOCK, [CHLD], [USR1 CHLD WINCH], 8) = 0 rt_sigreturn({mask=[CHLD WINCH]}) = 0 close(3) = 0 rt_sigprocmask(SIG_UNBLOCK, [CHLD], [CHLD WINCH], 8) = 0 rt_sigprocmask(SIG_BLOCK, [CHLD], [WINCH], 8) = 0 rt_sigprocmask(SIG_UNBLOCK, [CHLD], [CHLD WINCH], 8) = 0 rt_sigprocmask(SIG_UNBLOCK, [WINCH], [WINCH], 8) = 0 rt_sigprocmask(SIG_BLOCK, [WINCH], [], 8) = 0 rt_sigprocmask(SIG_UNBLOCK, [WINCH], [WINCH], 8) = 0 rt_sigprocmask(SIG_BLOCK, [WINCH], [], 8) = 0 rt_sigprocmask(SIG_UNBLOCK, [WINCH], [WINCH], 8) = 0 rt_sigprocmask(SIG_BLOCK, [WINCH], [], 8) = 0 rt_sigprocmask(SIG_UNBLOCK, [WINCH], [WINCH], 8) = 0 rt_sigprocmask(SIG_BLOCK, [WINCH], [], 8) = 0 rt_sigprocmask(SIG_BLOCK, [CHLD], [WINCH], 8) = 0 rt_sigprocmask(SIG_BLOCK, [CHLD], [CHLD WINCH], 8) = 0 access("/bin/sleep", X_OK) = 0 stat("/bin/sleep", {st_mode=S_IFREG|0755, st_size=27008, ...}) = 0 rt_sigprocmask(SIG_BLOCK, [CHLD], [CHLD WINCH], 8) = 0 pipe([3, 4]) = 0 clone(child_stack=0, flags=CLONE_CHILD_CLEARTID|CLONE_CHILD_SETTID|SIGCHLD, child_tidptr=0x7ff1c87739d0) = 49343 close(4) = 0 read(3, "", 1) = 0 close(3) = 0 rt_sigprocmask(SIG_BLOCK, [CHLD], [CHLD WINCH], 8) = 0 rt_sigsuspend([INT], 8) = ? ERESTARTNOHAND (To be restarted if no handler) --- SIGUSR1 {si_signo=SIGUSR1, si_code=SI_USER, si_pid=49329, si_uid=0} --- rt_sigprocmask(SIG_BLOCK, ~[RTMIN RT_1], [INT USR1], 8) = 0 rt_sigprocmask(SIG_SETMASK, [INT USR1], ~[KILL STOP RTMIN RT_1], 8) = 0 rt_sigreturn({mask=[CHLD WINCH]}) = -1 EINTR (Interrupted system call) rt_sigprocmask(SIG_BLOCK, [CHLD], [CHLD WINCH], 8) = 0 rt_sigsuspend([INT], 8) = ? ERESTARTNOHAND (To be restarted if no handler) --- SIGUSR1 {si_signo=SIGUSR1, si_code=SI_USER, si_pid=49325, si_uid=0} --- --- SIGCHLD {si_signo=SIGCHLD, si_code=CLD_EXITED, si_pid=49325, si_uid=0, si_status=0, si_utime=0, si_stime=0} --- rt_sigprocmask(SIG_BLOCK, ~[RTMIN RT_1], [INT USR1 CHLD], 8) = 0 rt_sigprocmask(SIG_SETMASK, [INT USR1 CHLD], ~[KILL STOP RTMIN RT_1], 8) = 0 wait4(-1, [{WIFEXITED(s) && WEXITSTATUS(s) == 0}], WNOHANG|WSTOPPED|WCONTINUED, {ru_utime={0, 0}, ru_stime={0, 1000}, ...}) = 49325 getrusage(RUSAGE_CHILDREN, {ru_utime={0, 0}, ru_stime={0, 1000}, ...}) = 0 wait4(-1, 0x7fff0bbc397c, WNOHANG|WSTOPPED|WCONTINUED, 0x7fff0bbc39a0) = 0 rt_sigreturn({mask=[INT USR1]}) = 0 rt_sigprocmask(SIG_BLOCK, ~[RTMIN RT_1], [INT USR1], 8) = 0 rt_sigprocmask(SIG_SETMASK, [INT USR1], ~[KILL STOP RTMIN RT_1], 8) = 0 rt_sigreturn({mask=[CHLD WINCH]}) = -1 EINTR (Interrupted system call) rt_sigprocmask(SIG_BLOCK, [CHLD], [CHLD WINCH], 8) = 0 rt_sigsuspend([INT], 8) = ? ERESTARTNOHAND (To be restarted if no handler) --- SIGUSR1 {si_signo=SIGUSR1, si_code=SI_USER, si_pid=49323, si_uid=0} --- --- SIGCHLD {si_signo=SIGCHLD, si_code=CLD_EXITED, si_pid=49323, si_uid=0, si_status=0, si_utime=0, si_stime=0} --- rt_sigprocmask(SIG_BLOCK, ~[RTMIN RT_1], [INT USR1 CHLD], 8) = 0 rt_sigprocmask(SIG_SETMASK, [INT USR1 CHLD], ~[KILL STOP RTMIN RT_1], 8) = 0 wait4(-1, [{WIFEXITED(s) && WEXITSTATUS(s) == 0}], WNOHANG|WSTOPPED|WCONTINUED, {ru_utime={0, 0}, ru_stime={0, 0}, ...}) = 49323 getrusage(RUSAGE_CHILDREN, {ru_utime={0, 0}, ru_stime={0, 1000}, ...}) = 0 wait4(-1, 0x7fff0bbc397c, WNOHANG|WSTOPPED|WCONTINUED, 0x7fff0bbc39a0) = 0 rt_sigreturn({mask=[INT USR1]}) = 0 rt_sigprocmask(SIG_BLOCK, ~[RTMIN RT_1], [INT USR1], 8) = 0 rt_sigprocmask(SIG_SETMASK, [INT USR1], ~[KILL STOP RTMIN RT_1], 8) = 0 rt_sigreturn({mask=[CHLD WINCH]}) = -1 EINTR (Interrupted system call) rt_sigprocmask(SIG_BLOCK, [CHLD], [CHLD WINCH], 8) = 0 rt_sigsuspend([INT], 8) = ? ERESTARTNOHAND (To be restarted if no handler) --- SIGCHLD {si_signo=SIGCHLD, si_code=CLD_EXITED, si_pid=49343, si_uid=0, si_status=0, si_utime=0, si_stime=0} --- rt_sigprocmask(SIG_BLOCK, ~[RTMIN RT_1], [INT CHLD], 8) = 0 rt_sigprocmask(SIG_SETMASK, [INT CHLD], ~[KILL STOP RTMIN RT_1], 8) = 0 wait4(-1, [{WIFEXITED(s) && WEXITSTATUS(s) == 0}], WNOHANG|WSTOPPED|WCONTINUED, {ru_utime={0, 0}, ru_stime={0, 0}, ...}) = 49343 wait4(-1, 0x7fff0bbc3f3c, WNOHANG|WSTOPPED|WCONTINUED, 0x7fff0bbc3f60) = 0 rt_sigreturn({mask=[CHLD WINCH]}) = -1 EINTR (Interrupted system call) rt_sigprocmask(SIG_BLOCK, [CHLD], [CHLD WINCH], 8) = 0 rt_sigprocmask(SIG_BLOCK, [CHLD], [CHLD WINCH], 8) = 0 write(1, ".", 1) = 1 rt_sigprocmask(SIG_BLOCK, [CHLD], [CHLD WINCH], 8) = 0 rt_sigprocmask(SIG_UNBLOCK, [CHLD], [CHLD WINCH], 8) = 0 rt_sigprocmask(SIG_BLOCK, [CHLD], [WINCH], 8) = 0 write(1, ".", 1) = 1 rt_sigprocmask(SIG_BLOCK, [CHLD], [CHLD WINCH], 8) = 0 rt_sigprocmask(SIG_UNBLOCK, [CHLD], [CHLD WINCH], 8) = 0 rt_sigprocmask(SIG_BLOCK, [CHLD], [WINCH], 8) = 0 write(1, ".", 1) = 1 rt_sigprocmask(SIG_BLOCK, [CHLD], [CHLD WINCH], 8) = 0 --- SIGUSR1 {si_signo=SIGUSR1, si_code=SI_USER, si_pid=49340, si_uid=0} --- rt_sigprocmask(SIG_BLOCK, ~[RTMIN RT_1], [USR1 CHLD WINCH], 8) = 0 rt_sigprocmask(SIG_SETMASK, [USR1 CHLD WINCH], ~[KILL STOP RTMIN RT_1], 8) = 0 rt_sigreturn({mask=[CHLD WINCH]}) = 0 rt_sigprocmask(SIG_UNBLOCK, [CHLD], [CHLD WINCH], 8) = 0 rt_sigprocmask(SIG_UNBLOCK, [CHLD], [WINCH], 8) = 0 rt_sigprocmask(SIG_BLOCK, [CHLD], [WINCH], 8) = 0 rt_sigprocmask(SIG_UNBLOCK, [CHLD], [CHLD WINCH], 8) = 0 rt_sigprocmask(SIG_BLOCK, [CHLD], [WINCH], 8) = 0 rt_sigprocmask(SIG_BLOCK, [CHLD], [CHLD WINCH], 8) = 0 pipe([3, 4]) = 0 clone(child_stack=0, flags=CLONE_CHILD_CLEARTID|CLONE_CHILD_SETTID|SIGCHLD, child_tidptr=0x7ff1c87739d0) = 49347 close(4) = 0 read(3, 0x7fff0bbc4940, 1) = ? ERESTARTSYS (To be restarted if SA_RESTART is set) --- SIGUSR1 {si_signo=SIGUSR1, si_code=SI_USER, si_pid=49334, si_uid=0} --- rt_sigprocmask(SIG_BLOCK, ~[RTMIN RT_1], [USR1 CHLD WINCH], 8) = 0 rt_sigprocmask(SIG_SETMASK, [USR1 CHLD WINCH], ~[KILL STOP RTMIN RT_1], 8) = 0 rt_sigprocmask(SIG_BLOCK, [CHLD], [USR1 CHLD WINCH], 8) = 0 write(1, ".", 1) = 1 rt_sigprocmask(SIG_BLOCK, [CHLD], [USR1 CHLD WINCH], 8) = 0 rt_sigprocmask(SIG_UNBLOCK, [CHLD], [USR1 CHLD WINCH], 8) = 0 rt_sigreturn({mask=[CHLD WINCH]}) = -1 EINTR (Interrupted system call) --- SIGUSR1 {si_signo=SIGUSR1, si_code=SI_USER, si_pid=49336, si_uid=0} --- rt_sigprocmask(SIG_BLOCK, ~[RTMIN RT_1], [USR1 CHLD WINCH], 8) = 0 rt_sigprocmask(SIG_SETMASK, [USR1 CHLD WINCH], ~[KILL STOP RTMIN RT_1], 8) = 0 rt_sigprocmask(SIG_BLOCK, [CHLD], [USR1 CHLD WINCH], 8) = 0 write(1, ".", 1) = 1 rt_sigprocmask(SIG_BLOCK, [CHLD], [USR1 CHLD WINCH], 8) = 0 rt_sigprocmask(SIG_UNBLOCK, [CHLD], [USR1 CHLD WINCH], 8) = 0 rt_sigreturn({mask=[CHLD WINCH]}) = -1 EINTR (Interrupted system call) read(3, 0x7fff0bbc4940, 1) = ? ERESTARTSYS (To be restarted if SA_RESTART is set) --- SIGUSR1 {si_signo=SIGUSR1, si_code=SI_USER, si_pid=49329, si_uid=0} --- rt_sigprocmask(SIG_BLOCK, ~[RTMIN RT_1], [USR1 CHLD WINCH], 8) = 0 rt_sigprocmask(SIG_SETMASK, [USR1 CHLD WINCH], ~[KILL STOP RTMIN RT_1], 8) = 0 rt_sigprocmask(SIG_BLOCK, [CHLD], [USR1 CHLD WINCH], 8) = 0 write(1, ".", 1) = 1 rt_sigprocmask(SIG_BLOCK, [CHLD], [USR1 CHLD WINCH], 8) = 0 rt_sigprocmask(SIG_UNBLOCK, [CHLD], [USR1 CHLD WINCH], 8) = 0 --- SIGCHLD {si_signo=SIGCHLD, si_code=CLD_EXITED, si_pid=49329, si_uid=0, si_status=0, si_utime=0, si_stime=0} --- rt_sigprocmask(SIG_BLOCK, ~[RTMIN RT_1], [USR1 CHLD WINCH], 8) = 0 rt_sigprocmask(SIG_SETMASK, [USR1 CHLD WINCH], ~[KILL STOP RTMIN RT_1], 8) = 0 wait4(-1, [{WIFEXITED(s) && WEXITSTATUS(s) == 0}], WNOHANG|WSTOPPED|WCONTINUED, {ru_utime={0, 0}, ru_stime={0, 0}, ...}) = 49329 getrusage(RUSAGE_CHILDREN, {ru_utime={0, 0}, ru_stime={0, 1000}, ...}) = 0 wait4(-1, 0x7fff0bbc2efc, WNOHANG|WSTOPPED|WCONTINUED, 0x7fff0bbc2f20) = 0 rt_sigreturn({mask=[USR1 WINCH]}) = 0 rt_sigreturn({mask=[CHLD WINCH]}) = -1 EINTR (Interrupted system call) read(3, "", 1) = 0 close(3) = 0 --- SIGUSR1 {si_signo=SIGUSR1, si_code=SI_USER, si_pid=49338, si_uid=0} --- rt_sigprocmask(SIG_BLOCK, ~[RTMIN RT_1], [USR1 CHLD WINCH], 8) = 0 rt_sigprocmask(SIG_SETMASK, [USR1 CHLD WINCH], ~[KILL STOP RTMIN RT_1], 8) = 0 rt_sigprocmask(SIG_BLOCK, [CHLD], [USR1 CHLD WINCH], 8) = 0 write(1, ".", 1) = 1 rt_sigprocmask(SIG_BLOCK, [CHLD], [USR1 CHLD WINCH], 8) = 0 rt_sigprocmask(SIG_UNBLOCK, [CHLD], [USR1 CHLD WINCH], 8) = 0 --- SIGCHLD {si_signo=SIGCHLD, si_code=CLD_EXITED, si_pid=49338, si_uid=0, si_status=0, si_utime=0, si_stime=0} --- rt_sigprocmask(SIG_BLOCK, ~[RTMIN RT_1], [USR1 CHLD WINCH], 8) = 0 rt_sigprocmask(SIG_SETMASK, [USR1 CHLD WINCH], ~[KILL STOP RTMIN RT_1], 8) = 0 wait4(-1, [{WIFEXITED(s) && WEXITSTATUS(s) == 0}], WNOHANG|WSTOPPED|WCONTINUED, {ru_utime={0, 0}, ru_stime={0, 1000}, ...}) = 49338 getrusage(RUSAGE_CHILDREN, {ru_utime={0, 0}, ru_stime={0, 2000}, ...}) = 0 wait4(-1, [{WIFEXITED(s) && WEXITSTATUS(s) == 0}], WNOHANG|WSTOPPED|WCONTINUED, {ru_utime={0, 0}, ru_stime={0, 0}, ...}) = 49340 getrusage(RUSAGE_CHILDREN, {ru_utime={0, 0}, ru_stime={0, 2000}, ...}) = 0 wait4(-1, [{WIFEXITED(s) && WEXITSTATUS(s) == 0}], WNOHANG|WSTOPPED|WCONTINUED, {ru_utime={0, 0}, ru_stime={0, 0}, ...}) = 49347 getrusage(RUSAGE_CHILDREN, {ru_utime={0, 0}, ru_stime={0, 2000}, ...}) = 0 wait4(-1, 0x7fff0bbc2f3c, WNOHANG|WSTOPPED|WCONTINUED, 0x7fff0bbc2f60) = 0 rt_sigreturn({mask=[USR1 WINCH]}) = 0 --- SIGCHLD {si_signo=SIGCHLD, si_code=CLD_EXITED, si_pid=49347, si_uid=0, si_status=0, si_utime=0, si_stime=0} --- rt_sigprocmask(SIG_BLOCK, ~[RTMIN RT_1], [USR1 CHLD WINCH], 8) = 0 rt_sigprocmask(SIG_SETMASK, [USR1 CHLD WINCH], ~[KILL STOP RTMIN RT_1], 8) = 0 wait4(-1, [{WIFEXITED(s) && WEXITSTATUS(s) == 0}], WNOHANG|WSTOPPED|WCONTINUED, {ru_utime={0, 0}, ru_stime={0, 0}, ...}) = 49336 getrusage(RUSAGE_CHILDREN, {ru_utime={0, 0}, ru_stime={0, 2000}, ...}) = 0 wait4(-1, [{WIFEXITED(s) && WEXITSTATUS(s) == 0}], WNOHANG|WSTOPPED|WCONTINUED, {ru_utime={0, 0}, ru_stime={0, 0}, ...}) = 49334 getrusage(RUSAGE_CHILDREN, {ru_utime={0, 0}, ru_stime={0, 2000}, ...}) = 0 wait4(-1, [{WIFEXITED(s) && WEXITSTATUS(s) == 0}], WNOHANG|WSTOPPED|WCONTINUED, {ru_utime={0, 0}, ru_stime={0, 0}, ...}) = 49331 getrusage(RUSAGE_CHILDREN, {ru_utime={0, 0}, ru_stime={0, 2000}, ...}) = 0 wait4(-1, 0x7fff0bbc2f3c, WNOHANG|WSTOPPED|WCONTINUED, 0x7fff0bbc2f60) = -1 ECHILD (No child processes) rt_sigreturn({mask=[USR1 WINCH]}) = 0 --- SIGCHLD {si_signo=SIGCHLD, si_code=CLD_EXITED, si_pid=49334, si_uid=0, si_status=0, si_utime=0, si_stime=0} --- rt_sigprocmask(SIG_BLOCK, ~[RTMIN RT_1], [USR1 CHLD WINCH], 8) = 0 rt_sigprocmask(SIG_SETMASK, [USR1 CHLD WINCH], ~[KILL STOP RTMIN RT_1], 8) = 0 wait4(-1, 0x7fff0bbc2f3c, WNOHANG|WSTOPPED|WCONTINUED, 0x7fff0bbc2f60) = -1 ECHILD (No child processes) rt_sigreturn({mask=[USR1 WINCH]}) = 0 rt_sigreturn({mask=[CHLD WINCH]}) = 0 --- SIGUSR1 {si_signo=SIGUSR1, si_code=SI_USER, si_pid=49340, si_uid=0} --- rt_sigprocmask(SIG_BLOCK, ~[RTMIN RT_1], [USR1 CHLD WINCH], 8) = 0 rt_sigprocmask(SIG_SETMASK, [USR1 CHLD WINCH], ~[KILL STOP RTMIN RT_1], 8) = 0 rt_sigprocmask(SIG_BLOCK, [CHLD], [USR1 CHLD WINCH], 8) = 0 write(1, ".", 1) = 1 rt_sigprocmask(SIG_BLOCK, [CHLD], [USR1 CHLD WINCH], 8) = 0 rt_sigprocmask(SIG_UNBLOCK, [CHLD], [USR1 CHLD WINCH], 8) = 0 rt_sigreturn({mask=[CHLD WINCH]}) = 0 rt_sigprocmask(SIG_BLOCK, [CHLD], [CHLD WINCH], 8) = 0 rt_sigsuspend([INT], 8 ^ permalink raw reply [flat|nested] 41+ messages in thread
* Re: Deadlock when receiving kill-signal from child process 2015-08-04 21:52 ` Mathias Fredriksson @ 2015-08-05 0:05 ` Mathias Fredriksson 2015-08-05 6:53 ` Bart Schaefer 1 sibling, 0 replies; 41+ messages in thread From: Mathias Fredriksson @ 2015-08-05 0:05 UTC (permalink / raw) To: zsh-workers I can't seem to produce wanted gdb output of the frozen state. If i run through gdb with "continue&", when it finally freezes, gdb will only tell me that it is still running and trying to perform operations gives "Target is executing.". My gdb-foo is way too low to deal with this (unless someone would like to give me assistance in debugging it further). Since gdb was not much help, I have modified the code slightly in hopes of others being able to reproduce. With this modification I can produce a deadlock / freeze on every run. -- child() { sleep 0.00001 kill -USR1 $$ sleep 0.0001 kill -USR1 $$ } TRAPUSR1() { sleep 0.000001 print -n "." } for i in {1..10}; do child &! done sleep 0.0000001 sleep 0.000001 sleep 0.00001 sleep 0.0001 sleep 0.001 ^ permalink raw reply [flat|nested] 41+ messages in thread
* Re: Deadlock when receiving kill-signal from child process 2015-08-04 21:52 ` Mathias Fredriksson 2015-08-05 0:05 ` Mathias Fredriksson @ 2015-08-05 6:53 ` Bart Schaefer 2015-08-05 10:37 ` Mathias Fredriksson 1 sibling, 1 reply; 41+ messages in thread From: Bart Schaefer @ 2015-08-05 6:53 UTC (permalink / raw) To: zsh-workers On Aug 5, 12:52am, Mathias Fredriksson wrote: } } I have however managed to get a dump with strace on Gentoo Based on this strace plus a GDB stack trace Mathias sent me off-list, I think the problem may be here: 1415 zwaitjob(int job, int wait_cmd) 1416 { 1417 int q = queue_signal_level(); 1418 Job jn = jobtab + job; 1419 1420 dont_queue_signals(); 1421 child_block(); /* unblocked during signal_suspend() */ 1422 queue_traps(wait_cmd); ... 1440 while (!errflag && jn->stat && 1441 !(jn->stat & STAT_DONE) && 1442 !(interact && (jn->stat & STAT_STOPPED))) { 1443 signal_suspend(SIGCHLD, wait_cmd); I suspect what's happening is that the child represented by "job" exits during dont_queue_signals(), which is a macro that expands to a loop calling zhandler(), which will process TRAPUSR1 (or other traps). Somehow this results in jn->stat never being marked STAT_DONE. Perhaps this happens because the "thisjob" global gets temporarily changed in the TRAP* function? Anyway signal_suspend(SIGCHLD, wait_cmd) is then called when there are no children left, so we never receive another SIGCHLD to break out of the while-loop, and even if we do come out of signal_suspend() the while-loop goes around and we block again. I'm not sure what to do if this is in fact the problem, because it e.g. calling child_block() is before dont_queue_signals() has other problems. However, it's also possible that a child has exited even before its job table entry has been created. One way to find out if that has happened is this patch: diff --git a/Src/signals.c b/Src/signals.c index 3950ad1..d72c7d6 100644 --- a/Src/signals.c +++ b/Src/signals.c @@ -519,6 +519,7 @@ wait_for_processes(void) * will get added on to the next found process that * terminates. */ + zwarn("no job table entry for pid %d", pid); get_usage(); } /* Mathias, if you could apply that patch and try again to reproduce the deadlock, it might tell us something. -- Barton E. Schaefer ^ permalink raw reply [flat|nested] 41+ messages in thread
* Re: Deadlock when receiving kill-signal from child process 2015-08-05 6:53 ` Bart Schaefer @ 2015-08-05 10:37 ` Mathias Fredriksson 2015-08-05 15:52 ` Bart Schaefer 0 siblings, 1 reply; 41+ messages in thread From: Mathias Fredriksson @ 2015-08-05 10:37 UTC (permalink / raw) To: zsh-workers On Wed, Aug 5, 2015 at 9:53 AM, Bart Schaefer wrote: } } Mathias, if you could apply that patch and try again to reproduce the } deadlock, it might tell us something. Of course, here's the output (as I see it in the terminal) with the applied patch: TRAPUSR1:1: no job table entry for pid 61571 TRAPUSR1:1: no job table entry for pid 61570 .TRAPUSR1:1: no job table entry for pid 61575 .TRAPUSR1:1: no job table entry for pid 61573 ../deadlock.zsh:19: no job table entry for pid 61577 TRAPUSR1:1: no job table entry for pid 61581 .TRAPUSR1:1: no job table entry for pid 61595 TRAPUSR1:1: no job table entry for pid 61582 ../deadlock.zsh:20: no job table entry for pid 61585 ./deadlock.zsh:20: no job table entry for pid 61589 ./deadlock.zsh:20: no job table entry for pid 61590 Furthermore, here is the gdb output from the last script I posted and zsh built with --enable-zsh-debug: #0 0x00007fff8abfe72a in __sigsuspend () #1 0x0000000108fc05df in signal_suspend () #2 0x0000000108f97b05 in zwaitjob () #3 0x0000000108f97958 in waitjobs () #4 0x0000000108f7a90f in execpline () #5 0x0000000108f79c42 in execlist () #6 0x0000000108f79a6a in execode () #7 0x0000000108f920bb in loop () #8 0x0000000108f94d0c in zsh_main () #9 0x00007fff8610c5c9 in start () ^ permalink raw reply [flat|nested] 41+ messages in thread
* Re: Deadlock when receiving kill-signal from child process 2015-08-05 10:37 ` Mathias Fredriksson @ 2015-08-05 15:52 ` Bart Schaefer 2015-08-05 16:05 ` Mathias Fredriksson 0 siblings, 1 reply; 41+ messages in thread From: Bart Schaefer @ 2015-08-05 15:52 UTC (permalink / raw) To: zsh-workers On Aug 5, 1:37pm, Mathias Fredriksson wrote: } Subject: Re: Deadlock when receiving kill-signal from child process } } Of course, here's the output (as I see it in the terminal) with the } applied patch: } } TRAPUSR1:1: no job table entry for pid 61571 Aha. Well, we can't leave that zwarn() in there because there are legitimate cases where we fork without creating a job table entry, but none of those cases should have occurred with your test script. However, don't you delete it just yet from your test build. Instead, add this patch and see what you get. diff --git a/Src/exec.c b/Src/exec.c index 7612d43..29cc5cb 100644 --- a/Src/exec.c +++ b/Src/exec.c @@ -1456,6 +1456,14 @@ execpline(Estate state, wordcode slcode, int how, int last1) else if (slflags & WC_SUBLIST_NOT) last1 = 0; + /* If trap handlers are allowed to run here, they may start another + * external job in the middle of us starting this one, which can + * result in jobs being reaped before their job table entries have + * been initialized, which in turn leads to waiting forever for + * jobs that no longer exist. So don't do that. + */ + queue_signals(); + pj = thisjob; ipipe[0] = ipipe[1] = opipe[0] = opipe[1] = 0; child_block(); @@ -1468,6 +1476,7 @@ execpline(Estate state, wordcode slcode, int how, int last1) */ if ((thisjob = newjob = initjob()) == -1) { child_unblock(); + unqueue_signals(); return 1; } if (how & Z_TIMED) @@ -1523,6 +1532,7 @@ execpline(Estate state, wordcode slcode, int how, int last1) else spawnjob(); child_unblock(); + unqueue_signals(); /* Executing background code resets shell status */ return lastval = 0; } else { @@ -1580,7 +1590,7 @@ execpline(Estate state, wordcode slcode, int how, int last1) } if (!(jn->stat & STAT_LOCKED)) { updated = hasprocs(thisjob); - waitjobs(); + waitjobs(); /* deals with signal queue */ child_block(); } else updated = 0; @@ -1588,6 +1598,8 @@ execpline(Estate state, wordcode slcode, int how, int last1) list_pipe_job && hasprocs(list_pipe_job) && !(jobtab[list_pipe_job].stat & STAT_STOPPED)) { child_unblock(); + unqueue_signals(); + queue_signals(); child_block(); } if (list_pipe_child && @@ -1672,6 +1684,7 @@ execpline(Estate state, wordcode slcode, int how, int last1) break; } child_unblock(); + unqueue_signals(); if (list_pipe && (lastval & 0200) && pj >= 0 && (!(jn->stat & STAT_INUSE) || (jn->stat & STAT_DONE))) { -- Barton E. Schaefer ^ permalink raw reply [flat|nested] 41+ messages in thread
* Re: Deadlock when receiving kill-signal from child process 2015-08-05 15:52 ` Bart Schaefer @ 2015-08-05 16:05 ` Mathias Fredriksson 2015-08-05 18:52 ` Bart Schaefer 0 siblings, 1 reply; 41+ messages in thread From: Mathias Fredriksson @ 2015-08-05 16:05 UTC (permalink / raw) To: zsh-workers On Wed, Aug 5, 2015 at 6:52 PM, Bart Schaefer wrote: } } However, don't you delete it just yet from your test build. Instead, } add this patch and see what you get. The freezes are now much less frequent, but I still managed to get it to lock up with a slightly different gdb trace this time around. Output: ./deadlock.zsh:15: no job table entry for pid 6501 ./deadlock.zsh:15: no job table entry for pid 6500 ./deadlock.zsh:15: no job table entry for pid 6503 ./deadlock.zsh:15: no job table entry for pid 6505 ./deadlock.zsh:15: no job table entry for pid 6509 TRAPUSR1:1: no job table entry for pid 6507 ..... gdb: #0 0x00007fff8abf95da in syscall_thread_switch () #1 0x00007fff853a982d in _OSSpinLockLockSlow () #2 0x00007fff896e1635 in szone_force_lock () #3 0x00007fff896e15e6 in _malloc_fork_prepare () #4 0x00007fff82cb8097 in fork () #5 0x00000001036447d0 in zfork () #6 0x000000010364825d in execcmd () #7 0x00000001036432c0 in execpline () #8 0x000000010364286a in execlist () #9 0x0000000103642692 in execode () #10 0x0000000103646297 in runshfunc () #11 0x0000000103645d82 in doshfunc () #12 0x000000010368a8c7 in dotrapargs () #13 0x0000000103689a2a in handletrap () #14 0x0000000103689328 in zhandler () #15 <signal handler called> #16 0x00007fff896dad62 in tiny_free_list_add_ptr () #17 0x00007fff896d9e7f in szone_free_definite_size () #18 0x000000010365e89a in inputsetline () #19 0x000000010365e1e7 in ingetc () #20 0x000000010366425b in zshlex () #21 0x0000000103679980 in parse_event () #22 0x000000010365add4 in loop () #23 0x000000010365dc2c in zsh_main () #24 0x00007fff8610c5c9 in start () ^ permalink raw reply [flat|nested] 41+ messages in thread
* Re: Deadlock when receiving kill-signal from child process 2015-08-05 16:05 ` Mathias Fredriksson @ 2015-08-05 18:52 ` Bart Schaefer 2015-08-05 19:11 ` Mathias Fredriksson 0 siblings, 1 reply; 41+ messages in thread From: Bart Schaefer @ 2015-08-05 18:52 UTC (permalink / raw) To: zsh-workers On Aug 5, 7:05pm, Mathias Fredriksson wrote: } } The freezes are now much less frequent, but I still managed to get it } to lock up with a slightly different gdb trace this time around. Hm. I'm a little puzzled by the continued appearance of the "no job table entry" warning but this -- } #15 <signal handler called> } #16 0x00007fff896dad62 in tiny_free_list_add_ptr () } #17 0x00007fff896d9e7f in szone_free_definite_size () } #18 0x000000010365e89a in inputsetline () -- is another case where we're manipulating global state without blocking signal traps. diff --git a/Src/input.c b/Src/input.c index 1efabad..cabf942 100644 --- a/Src/input.c +++ b/Src/input.c @@ -377,6 +377,8 @@ inputline(void) static void inputsetline(char *str, int flags) { + queue_signals(); + if ((inbufflags & INP_FREE) && inbuf) { free(inbuf); } @@ -394,6 +396,8 @@ inputsetline(char *str, int flags) else inbufct = inbufleft; inbufflags = flags; + + unqueue_signals(); } /* ^ permalink raw reply [flat|nested] 41+ messages in thread
* Re: Deadlock when receiving kill-signal from child process 2015-08-05 18:52 ` Bart Schaefer @ 2015-08-05 19:11 ` Mathias Fredriksson 2015-08-05 20:20 ` Bart Schaefer 0 siblings, 1 reply; 41+ messages in thread From: Mathias Fredriksson @ 2015-08-05 19:11 UTC (permalink / raw) To: zsh-workers On Wed, Aug 5, 2015 at 9:52 PM, Bart Schaefer wrote: } } Hm. I'm a little puzzled by the continued appearance of the "no job } table entry" warning but this -- Is it not explainable by disowning the child process (child &!)? At least when I only do "child &" the error disappears. By applying your last patch (in addition to the previous ones) I have managed to produce two new stack traces, one where the last script is run as-is and one where I do not disown the child processes. child &! (disowned): #0 0x00007fff8abfe166 in __psynch_mutexwait () #1 0x00007fff8e4b578a in _pthread_mutex_lock () #2 0x00007fff82ce5750 in fputc () #3 0x000000010c4d4d95 in zputs () #4 0x000000010c4d4bfc in mb_niceformat () #5 0x000000010c4d428d in zwarning () #6 0x000000010c4d4436 in zwarn () #7 0x000000010c4c8632 in wait_for_processes () #8 0x000000010c4c82fe in zhandler () #9 <signal handler called> #10 0x00007fff8abfe72a in __sigsuspend () #11 0x000000010c4c84df in signal_suspend () #12 0x000000010c49fa05 in zwaitjob () #13 0x000000010c49f858 in waitjobs () #14 0x000000010c4825cc in execpline () #15 0x000000010c4817b2 in execlist () #16 0x000000010c4815da in execode () #17 0x000000010c4851df in runshfunc () #18 0x000000010c484cca in doshfunc () #19 0x000000010c4c98a7 in dotrapargs () #20 0x000000010c4c8a0a in handletrap () #21 0x000000010c4c8308 in zhandler () #22 <signal handler called> #23 0x00007fff853a9340 in OSAtomicCompareAndSwapPtrBarrier$VARIANT$mp () #24 0x00007fff8e4b5714 in _pthread_mutex_lock () #25 0x00007fff82ce43a3 in ferror () #26 0x000000010c499f56 in loop () #27 0x000000010c49cb74 in zsh_main () #28 0x00007fff8610c5c9 in start () child & (no more "no job table entry" errors): #0 0x00007fff8abf95da in syscall_thread_switch () #1 0x00007fff853a982d in _OSSpinLockLockSlow () #2 0x00007fff896e16d9 in szone_force_lock () #3 0x00007fff896e15e6 in _malloc_fork_prepare () #4 0x00007fff82cb8097 in fork () #5 0x0000000105079718 in zfork () #6 0x000000010507d1a5 in execcmd () #7 0x0000000105078208 in execpline () #8 0x00000001050777b2 in execlist () #9 0x00000001050775da in execode () #10 0x000000010507b1df in runshfunc () #11 0x000000010507acca in doshfunc () #12 0x00000001050bf8a7 in dotrapargs () #13 0x00000001050bea0a in handletrap () #14 0x00000001050be308 in zhandler () #15 <signal handler called> #16 0x00007fff896ddfc7 in small_free_list_add_ptr () #17 0x00007fff896d9ccf in szone_free_definite_size () #18 0x00000001050ae85c in init_parse () #19 0x00000001050ae965 in parse_event () #20 0x000000010508fd1c in loop () #21 0x0000000105092b74 in zsh_main () #22 0x00007fff8610c5c9 in start () ^ permalink raw reply [flat|nested] 41+ messages in thread
* Re: Deadlock when receiving kill-signal from child process 2015-08-05 19:11 ` Mathias Fredriksson @ 2015-08-05 20:20 ` Bart Schaefer 2015-08-05 21:49 ` Mathias Fredriksson 0 siblings, 1 reply; 41+ messages in thread From: Bart Schaefer @ 2015-08-05 20:20 UTC (permalink / raw) To: zsh-workers On Aug 5, 10:11pm, Mathias Fredriksson wrote: } Subject: Re: Deadlock when receiving kill-signal from child process } } On Wed, Aug 5, 2015 at 9:52 PM, Bart Schaefer wrote: } } } } Hm. I'm a little puzzled by the continued appearance of the "no job } } table entry" warning but this -- } } Is it not explainable by disowning the child process (child &!)? At } least when I only do "child &" the error disappears. That explains the ./deadlock.zsh:... warnings but I didn't think it explained the one that happened in TRAPUSR1. Probably not significant. } #0 0x00007fff8abfe166 in __psynch_mutexwait () } #1 0x00007fff8e4b578a in _pthread_mutex_lock () } #2 0x00007fff82ce5750 in fputc () } #9 <signal handler called> } #23 0x00007fff853a9340 in OSAtomicCompareAndSwapPtrBarrier$VARIANT$mp () } #24 0x00007fff8e4b5714 in _pthread_mutex_lock () } #25 0x00007fff82ce43a3 in ferror () Dang. Not sure there's much we can do about that one, that's the stdio library deadlocking internally on a mutex because a signal arrived. It'd be pretty ugly for us to try to wrap every stdio call with signal blocking. } #17 0x00007fff896d9ccf in szone_free_definite_size () } #18 0x00000001050ae85c in init_parse () Yet another one of these. We may have to resort to treating all signals the way we treat WINCH, that is, having them constantly queued except for specific moments when we unqueue them. diff --git a/Src/parse.c b/Src/parse.c index 09567fd..84ebf85 100644 --- a/Src/parse.c +++ b/Src/parse.c @@ -456,6 +456,8 @@ init_parse_status(void) void init_parse(void) { + queue_signals(); + if (ecbuf) zfree(ecbuf, eclen); ecbuf = (Wordcode) zalloc((eclen = EC_INIT_SIZE) * sizeof(wordcode)); @@ -466,6 +468,8 @@ init_parse(void) ecnfunc = 0; init_parse_status(); + + unqueue_signals(); } /* Build eprog. */ -- Barton E. Schaefer ^ permalink raw reply [flat|nested] 41+ messages in thread
* Re: Deadlock when receiving kill-signal from child process 2015-08-05 20:20 ` Bart Schaefer @ 2015-08-05 21:49 ` Mathias Fredriksson 2015-08-06 5:06 ` Bart Schaefer 0 siblings, 1 reply; 41+ messages in thread From: Mathias Fredriksson @ 2015-08-05 21:49 UTC (permalink / raw) To: zsh-workers On Wed, Aug 5, 2015 at 11:20 PM, Bart Schaefer wrote: } } Dang. Not sure there's much we can do about that one, that's the stdio } library deadlocking internally on a mutex because a signal arrived. } It'd be pretty ugly for us to try to wrap every stdio call with signal } blocking. Oh, interesting how this is only a problem on some systems. } } Yet another one of these. We may have to resort to treating all signals } the way we treat WINCH, that is, having them constantly queued except } for specific moments when we unqueue them. Ah, that explains why I have been able to work around this issue with WINCH. } } diff --git a/Src/parse.c b/Src/parse.c Still locks up, interesting though is that this patch allows Ctrl+C to exit the program even though it's frozen, the previous patch disabled Ctrl+C, the one before that enabled Ctrl+C and before that it didn't work either. Sorry for rambling, just trying to provide any additional information I can. forked child: #0 0x00007fff8abf95da in syscall_thread_switch () #1 0x00007fff853a982d in _OSSpinLockLockSlow () #2 0x00007fff896e16d9 in szone_force_lock () #3 0x00007fff896e15e6 in _malloc_fork_prepare () #4 0x00007fff82cb8097 in fork () #5 0x000000010b9f6638 in zfork () #6 0x000000010b9fa0c5 in execcmd () #7 0x000000010b9f5128 in execpline () #8 0x000000010b9f46d2 in execlist () #9 0x000000010b9f44fa in execode () #10 0x000000010b9f80ff in runshfunc () #11 0x000000010b9f7bea in doshfunc () #12 0x000000010ba3c867 in dotrapargs () #13 0x000000010ba3b9ca in handletrap () #14 0x000000010ba3b2c8 in zhandler () #15 <signal handler called> #16 0x00007fff896ddfc7 in small_free_list_add_ptr () #17 0x00007fff896d9ccf in szone_free_definite_size () #18 0x000000010ba2bc12 in bld_eprog () #19 0x000000010ba0cc3c in loop () #20 0x000000010ba0fa94 in zsh_main () #21 0x00007fff8610c5c9 in start () no fork: #0 0x00007fff8abf95da in syscall_thread_switch () #1 0x00007fff853a982d in _OSSpinLockLockSlow () #2 0x00007fff896d98d6 in szone_free_definite_size () #3 0x000000010663c351 in freejob () #4 0x000000010663bd9d in printjob () #5 0x000000010663b0f2 in update_job () #6 0x0000000106665593 in wait_for_processes () #7 0x00000001066652be in zhandler () #8 <signal handler called> #9 0x00007fff896d9e25 in szone_free_definite_size () #10 0x0000000106666885 in dotrapargs () #11 0x00000001066659ca in handletrap () #12 0x00000001066652c8 in zhandler () #13 0x000000010661fa29 in execpline () #14 0x000000010661e6d2 in execlist () #15 0x000000010661e4fa in execode () #16 0x0000000106636e43 in loop () #17 0x0000000106639a94 in zsh_main () #18 0x00007fff8610c5c9 in start () ^ permalink raw reply [flat|nested] 41+ messages in thread
* Re: Deadlock when receiving kill-signal from child process 2015-08-05 21:49 ` Mathias Fredriksson @ 2015-08-06 5:06 ` Bart Schaefer 2015-08-06 8:24 ` Mathias Fredriksson 0 siblings, 1 reply; 41+ messages in thread From: Bart Schaefer @ 2015-08-06 5:06 UTC (permalink / raw) To: zsh-workers I wrote: } Yet another one of these. We may have to resort to treating all signals } the way we treat WINCH, that is, having them constantly queued except } for specific moments when we unqueue them. I played around with this a bit by hacking loop() but the effect is that with the test script Mathais provided, most of the USR1 signals are just thrown away (they collapse into a single call to the trap handler). Not sure if that's actually the desired effect. On Aug 6, 12:49am, Mathias Fredriksson wrote: } } forked child: You mean disowned, I presume, since all children are by definition forked. } #18 0x000000010ba2bc12 in bld_eprog () Whack-a-mole continues. Does the behavior change if you setopt NO_TRAPS_ASYNC ?? } #10 0x0000000106666885 in dotrapargs () The below might not be good enough -- it looks as if doshfunc() may need to know internally about dont_queue_signals(), but other places that it is called explictly unwrap it, so let's try that first. Next question is how much are we slowing down the shell with all of this signal management. diff --git a/Src/parse.c b/Src/parse.c index 09567fd..1a74164 100644 --- a/Src/parse.c +++ b/Src/parse.c @@ -488,6 +492,8 @@ bld_eprog(int heap) Eprog ret; int l; + queue_signals(); + ecadd(WCB_END()); ret = heap ? (Eprog) zhalloc(sizeof(*ret)) : (Eprog) zalloc(sizeof(*ret)); @@ -511,6 +517,8 @@ bld_eprog(int heap) zfree(ecbuf, eclen); ecbuf = NULL; + unqueue_signals(); + return ret; } diff --git a/Src/signals.c b/Src/signals.c index 3950ad1..852f612 100644 --- a/Src/signals.c +++ b/Src/signals.c @@ -1219,6 +1219,10 @@ dotrapargs(int sig, int *sigtr, void *sigfn) if (*sigtr & ZSIG_FUNC) { int osc = sfcontext, old_incompfunc = incompfunc; HashNode hn = gettrapnode(sig, 0); + int q; + + queue_signals(); /* Any time we manage memory */ + q = queue_signal_level(); args = znewlinklist(); /* @@ -1244,11 +1248,14 @@ dotrapargs(int sig, int *sigtr, void *sigfn) sfcontext = SFC_SIGNAL; incompfunc = 0; + dont_queue_signals(); doshfunc((Shfunc)sigfn, args, 1); + restore_queue_signals(q); sfcontext = osc; incompfunc= old_incompfunc; freelinklist(args, (FreeFunc) NULL); zsfree(name); + unqueue_signals(); } else { trap_return = -2; /* not incremented, used at current level */ trap_state = TRAP_STATE_PRIMED; ^ permalink raw reply [flat|nested] 41+ messages in thread
* Re: Deadlock when receiving kill-signal from child process 2015-08-06 5:06 ` Bart Schaefer @ 2015-08-06 8:24 ` Mathias Fredriksson 2015-08-06 15:54 ` Bart Schaefer 0 siblings, 1 reply; 41+ messages in thread From: Mathias Fredriksson @ 2015-08-06 8:24 UTC (permalink / raw) To: zsh-workers On Thu, Aug 6, 2015 at 8:06 AM, Bart Schaefer wrote: } } I played around with this a bit by hacking loop() but the effect is } that with the test script Mathais provided, most of the USR1 signals } are just thrown away (they collapse into a single call to the trap } handler). Not sure if that's actually the desired effect. I would imagine some might rely on every signal being handled, e.g. keeping a count. } } You mean disowned, I presume, since all children are by definition forked. Yes, sorry for being unclear. } } Whack-a-mole continues. Does the behavior change if you } setopt NO_TRAPS_ASYNC } ?? Heh, that's exactly what this feels like. But I don't think it changes the behavior, this is pre-patch with NO_TRAPS_ASYNC set: #0 0x00007fff8abf95da in syscall_thread_switch () #1 0x00007fff853a982d in _OSSpinLockLockSlow () #2 0x00007fff896e16d9 in szone_force_lock () #3 0x00007fff896e15e6 in _malloc_fork_prepare () #4 0x00007fff82cb8097 in fork () #5 0x00000001074b166c in zfork () #6 0x00000001074b50f9 in execcmd () #7 0x00000001074b015c in execpline () #8 0x00000001074af706 in execlist () #9 0x00000001074af52e in execode () #10 0x00000001074b3133 in runshfunc () #11 0x00000001074b2c1e in doshfunc () #12 0x00000001074f788a in dotrapargs () #13 0x00000001074f69ed in handletrap () #14 0x00000001074f62fc in zhandler () #15 <signal handler called> #16 0x00007fff896ddfc7 in small_free_list_add_ptr () #17 0x00007fff896d9ccf in szone_free_definite_size () #18 0x00000001074e6c46 in bld_eprog () #19 0x00000001074c7c70 in loop () #20 0x00000001074caac8 in zsh_main () #21 0x00007fff8610c5c9 in start () } } Next question is how much are we slowing down the shell with all of this } signal management. By just casual observation I can't tell a difference. I guess proper benchmarks would be required. The following traces have the last patches applied (I did multiple runs to see if I could hit different states): #0 0x00007fff8abf95da in syscall_thread_switch () #1 0x00007fff853a982d in _OSSpinLockLockSlow () #2 0x00007fff896d771b in szone_malloc_should_clear () #3 0x00007fff896d7667 in malloc_zone_malloc () #4 0x00007fff896d6187 in malloc () #5 0x000000010df5deaf in zalloc () #6 0x000000010df7e2ca in ztrdup () #7 0x000000010df889b3 in mb_niceformat () #8 0x000000010df881cd in zwarning () #9 0x000000010df88376 in zwarn () #10 0x000000010df7c3da in wait_for_processes () #11 0x000000010df7c0a6 in zhandler () #12 <signal handler called> #13 0x00007fff896dad62 in tiny_free_list_add_ptr () #14 0x00007fff896d9e7f in szone_free_definite_size () #15 0x000000010df38e63 in runshfunc () #16 0x000000010df38936 in doshfunc () #17 0x000000010df7d70b in dotrapargs () #18 0x000000010df7c7b2 in handletrap () #19 0x000000010df7c0b0 in zhandler () #20 0x000000010df36775 in execpline () #21 0x000000010df3541e in execlist () #22 0x000000010df35246 in execode () #23 0x000000010df4db8f in loop () #24 0x000000010df507e0 in zsh_main () #25 0x00007fff8610c5c9 in start () -- #0 0x00007fff8abfe166 in __psynch_mutexwait () #1 0x00007fff8e4b578a in _pthread_mutex_lock () #2 0x00007fff82ce5750 in fputc () #3 0x000000010b17ccd5 in zputs () #4 0x000000010b17cb3c in mb_niceformat () #5 0x000000010b17c1cd in zwarning () #6 0x000000010b17c376 in zwarn () #7 0x000000010b1703da in wait_for_processes () #8 0x000000010b1700a6 in zhandler () #9 <signal handler called> #10 0x00007fff8abfe72a in __sigsuspend () #11 0x000000010b170287 in signal_suspend () #12 0x000000010b147671 in zwaitjob () #13 0x000000010b1474c4 in waitjobs () #14 0x000000010b12a238 in execpline () #15 0x000000010b12941e in execlist () #16 0x000000010b129246 in execode () #17 0x000000010b12ce4b in runshfunc () #18 0x000000010b12c936 in doshfunc () #19 0x000000010b17170b in dotrapargs () #20 0x000000010b1707b2 in handletrap () #21 0x000000010b1700b0 in zhandler () #22 <signal handler called> #23 0x00007fff8abfe166 in __psynch_mutexwait () #24 0x00007fff8e4b578a in _pthread_mutex_lock () #25 0x00007fff82ce5750 in fputc () #26 0x000000010b17ccd5 in zputs () #27 0x000000010b17cb3c in mb_niceformat () #28 0x000000010b17c1cd in zwarning () #29 0x000000010b17c376 in zwarn () #30 0x000000010b1703da in wait_for_processes () #31 0x000000010b1700a6 in zhandler () #32 <signal handler called> #33 0x00007fff853a9340 in OSAtomicCompareAndSwapPtrBarrier$VARIANT$mp () #34 0x00007fff8e4b5714 in _pthread_mutex_lock () #35 0x00007fff82ce43a3 in ferror () #36 0x000000010b141bc2 in loop () #37 0x000000010b1447e0 in zsh_main () #38 0x00007fff8610c5c9 in start () setopt NO_ASYNC_TRAPS: #0 0x00007fff8abf95da in syscall_thread_switch () #1 0x00007fff853a982d in _OSSpinLockLockSlow () #2 0x00007fff896d771b in szone_malloc_should_clear () #3 0x00007fff896d7667 in malloc_zone_malloc () #4 0x00007fff896d6187 in malloc () #5 0x00000001081e2eaf in zalloc () #6 0x00000001082032ca in ztrdup () #7 0x000000010820d9b3 in mb_niceformat () #8 0x000000010820d1cd in zwarning () #9 0x000000010820d376 in zwarn () #10 0x00000001082013da in wait_for_processes () #11 0x00000001082010a6 in zhandler () #12 <signal handler called> #13 0x00007fff896da116 in szone_free_definite_size () #14 0x00000001081bde63 in runshfunc () #15 0x00000001081bd936 in doshfunc () #16 0x000000010820270b in dotrapargs () #17 0x00000001082017b2 in handletrap () #18 0x00000001082029ec in unqueue_traps () #19 0x00000001081d872b in zwaitjob () #20 0x00000001081d84c4 in waitjobs () #21 0x00000001081bb238 in execpline () #22 0x00000001081ba41e in execlist () #23 0x00000001081ba246 in execode () #24 0x00000001081d2b8f in loop () #25 0x00000001081d57e0 in zsh_main () #26 0x00007fff8610c5c9 in start () -- #0 0x00007fff8abfe72a in __sigsuspend () #1 0x000000010af61287 in signal_suspend () #2 0x000000010af38671 in zwaitjob () #3 0x000000010af384c4 in waitjobs () #4 0x000000010af1b238 in execpline () #5 0x000000010af1a41e in execlist () #6 0x000000010af1a246 in execode () #7 0x000000010af1de4b in runshfunc () #8 0x000000010af1d936 in doshfunc () #9 0x000000010af6270b in dotrapargs () #10 0x000000010af617b2 in handletrap () #11 0x000000010af610b0 in zhandler () #12 <signal handler called> #13 0x00007fff82ce43a8 in ferror () #14 0x000000010af32bc2 in loop () #15 0x000000010af357e0 in zsh_main () #16 0x00007fff8610c5c9 in start () ^ permalink raw reply [flat|nested] 41+ messages in thread
* Re: Deadlock when receiving kill-signal from child process 2015-08-06 8:24 ` Mathias Fredriksson @ 2015-08-06 15:54 ` Bart Schaefer 2015-08-07 0:45 ` Mathias Fredriksson 0 siblings, 1 reply; 41+ messages in thread From: Bart Schaefer @ 2015-08-06 15:54 UTC (permalink / raw) To: zsh-workers On Aug 6, 11:24am, Mathias Fredriksson wrote: } Subject: Re: Deadlock when receiving kill-signal from child process } } On Thu, Aug 6, 2015 at 8:06 AM, Bart Schaefer wrote: } } } } I played around with this a bit by hacking loop() but the effect is } } that with the test script Mathais provided, most of the USR1 signals } } are just thrown away (they collapse into a single call to the trap } } handler). Not sure if that's actually the desired effect. } } I would imagine some might rely on every signal being handled, e.g. } keeping a count. Even without spending most of the time in queuing, *some* of the signals get dropped at the OS level. The only way I can get them all to be tallied is to remove the "sleep" from the trap function. } The following traces have the last patches applied (I did multiple } runs to see if I could hit different states): } } #15 0x000000010df38e63 in runshfunc () } #16 0x000000010df38936 in doshfunc () This is confirms my suspicion about doshfunc(). Sadly it's called all over the place, sometimes with signals explicitly un-queued and other times with no change to the surrounding context. } #0 0x00007fff8abfe166 in __psynch_mutexwait () } #1 0x00007fff8e4b578a in _pthread_mutex_lock () } #2 0x00007fff82ce5750 in fputc () } #9 <signal handler called> } #22 <signal handler called> } #32 <signal handler called> } #34 0x00007fff8e4b5714 in _pthread_mutex_lock () } #35 0x00007fff82ce43a3 in ferror () This is the stdio thing again. Anyone reading this familar enough with the POSIX or C standards to point to whether stdio is required to be signal-safe with pthreads? I.e., is this our bug or someone else's? (Not that zsh is using threads, but stdio is using pthread mutexes.) } setopt NO_ASYNC_TRAPS: NO_TRAPS_ASYNC ? Anyway, same two issues as above, just slightly different paths (no multiple signal handers in the stdio case, but one is enough). As with the previous dotrapargs() patch, I'm a little nervous about the dont_queue_signals() bits, but that's the only safe way to do the disabling part of signal queueing when the enabling part is not in local scope. diff --git a/Src/exec.c b/Src/exec.c index 7612d43..2886785 100644 --- a/Src/exec.c +++ b/Src/exec.c @@ -4820,11 +4833,9 @@ execshfunc(Shfunc shf, LinkList args) if ((osfc = sfcontext) == SFC_NONE) sfcontext = SFC_DIRECT; xtrerr = stderr; - unqueue_signals(); doshfunc(shf, args, 0); - queue_signals(); sfcontext = osfc; free(cmdstack); cmdstack = ocs; @@ -5039,6 +5050,8 @@ doshfunc(Shfunc shfunc, LinkList doshargs, int noreturnval) static int funcdepth; #endif + queue_signals(); /* Lots of memory and global state changes coming */ + pushheap(); oargv0 = NULL; @@ -5261,6 +5274,8 @@ doshfunc(Shfunc shfunc, LinkList doshargs, int noreturnval) } popheap(); + unqueue_signals(); + /* * Exit with a tidy up. * Only leave if we're at the end of the appropriate function --- @@ -5296,7 +5311,7 @@ doshfunc(Shfunc shfunc, LinkList doshargs, int noreturnval) mod_export void runshfunc(Eprog prog, FuncWrap wrap, char *name) { - int cont, ouu; + int cont, ouu, q = queue_signal_level(); char *ou; ou = zalloc(ouu = underscoreused); @@ -5305,7 +5320,9 @@ runshfunc(Eprog prog, FuncWrap wrap, char *name) while (wrap) { wrap->module->wrapper++; + dont_queue_signals(); cont = wrap->handler(prog, wrap->next, name); + restore_queue_signals(q); wrap->module->wrapper--; if (!wrap->module->wrapper && @@ -5320,7 +5337,9 @@ runshfunc(Eprog prog, FuncWrap wrap, char *name) wrap = wrap->next; } startparamscope(); + dont_queue_signals(); execode(prog, 1, 0, "shfunc"); + restore_queue_signals(q); if (ou) { setunderscore(ou); zfree(ou, ouu); ^ permalink raw reply [flat|nested] 41+ messages in thread
* Re: Deadlock when receiving kill-signal from child process 2015-08-06 15:54 ` Bart Schaefer @ 2015-08-07 0:45 ` Mathias Fredriksson 2015-08-07 5:39 ` Bart Schaefer 0 siblings, 1 reply; 41+ messages in thread From: Mathias Fredriksson @ 2015-08-07 0:45 UTC (permalink / raw) To: zsh-workers On Thu, Aug 6, 2015 at 6:54 PM, Bart Schaefer wrote: } } This is the stdio thing again. Anyone reading this familar enough with } the POSIX or C standards to point to whether stdio is required to be } signal-safe with pthreads? I.e., is this our bug or someone else's? Sadly I can't be of much assistance here, I believe you can't call pthread mutexes from a signal handler, but that isn't whats happening here? If I understand correctly a signal is received while a mutex lock is (being) aquired. } } NO_TRAPS_ASYNC ? Yes, my bad, typo in the email message, used the correct setopt. } } As with the previous dotrapargs() patch, I'm a little nervous about } the dont_queue_signals() bits, but that's the only safe way to do } the disabling part of signal queueing when the enabling part is not } in local scope. I'm not quite sure I understand what these changes do, but at least this last patch made it a lot harder for me to have zsh lock up. I had to leave my script running in a while true; do ...; done loop (eventually, 30sec-10min it would hit a lock). #0 0x00007fff8abfe72a in __sigsuspend () #1 0x0000000107b59287 in signal_suspend () #2 0x0000000107b30671 in zwaitjob () #3 0x0000000107b304c4 in waitjobs () #4 0x0000000107b130e8 in execpline () #5 0x0000000107b122ce in execlist () #6 0x0000000107b120f6 in execode () #7 0x0000000107b15ebf in runshfunc () #8 0x0000000107b157f4 in doshfunc () #9 0x0000000107b5a70b in dotrapargs () #10 0x0000000107b597b2 in handletrap () #11 0x0000000107b590b0 in zhandler () #12 <signal handler called> #13 0x00007fff82ce43a8 in ferror () #14 0x0000000107b2abc2 in loop () #15 0x0000000107b2d7e0 in zsh_main () #16 0x00007fff8610c5c9 in start () This just seems like the same mutex stuff again: #0 0x00007fff8abfe166 in __psynch_mutexwait () #1 0x00007fff8e4b578a in _pthread_mutex_lock () #2 0x00007fff82ce5750 in fputc () #3 0x0000000102c20cd5 in zputs () #4 0x0000000102c20b3c in mb_niceformat () #5 0x0000000102c201cd in zwarning () #6 0x0000000102c20376 in zwarn () #7 0x0000000102c143da in wait_for_processes () #8 0x0000000102c140a6 in zhandler () #9 <signal handler called> #10 0x00007fff8abfe72a in __sigsuspend () This also looks vaguely familiar but might as well post it: #0 0x00007fff8abf95da in syscall_thread_switch () #1 0x00007fff853a982d in _OSSpinLockLockSlow () #2 0x00007fff896d771b in szone_malloc_should_clear () #3 0x00007fff896d7667 in malloc_zone_malloc () #4 0x00007fff896d6187 in malloc () #5 0x0000000101ccdeaf in zalloc () #6 0x0000000101cee2ca in ztrdup () #7 0x0000000101cf89b3 in mb_niceformat () #8 0x0000000101cf81cd in zwarning () #9 0x0000000101cf8376 in zwarn () #10 0x0000000101cec3da in wait_for_processes () #11 0x0000000101cec0a6 in zhandler () #12 <signal handler called> #13 0x00007fff853aacd1 in _os_lock_spin_lock () #14 0x00007fff896d98d6 in szone_free_definite_size () #15 0x0000000101ca5874 in execlist () #16 0x0000000101ca50f6 in execode () #17 0x0000000101ca8ebf in runshfunc () #18 0x0000000101ca87f4 in doshfunc () #19 0x0000000101ced70b in dotrapargs () #20 0x0000000101cec7b2 in handletrap () #21 0x0000000101ced9ec in unqueue_traps () #22 0x0000000101cc372b in zwaitjob () #23 0x0000000101cc34c4 in waitjobs () #24 0x0000000101ca60e8 in execpline () #25 0x0000000101ca52ce in execlist () #26 0x0000000101ccaad0 in execwhile () #27 0x0000000101cac0d9 in execcmd () #28 0x0000000101ca5d24 in execpline () #29 0x0000000101ca52ce in execlist () #30 0x0000000101ca50f6 in execode () #31 0x0000000101cbdb8f in loop () #32 0x0000000101cc07e0 in zsh_main () #33 0x00007fff8610c5c9 in start () Bonus NO_TRAPS_ASYNC: #0 0x00007fff8abfe72a in __sigsuspend () #1 0x0000000107509287 in signal_suspend () #2 0x00000001074e0671 in zwaitjob () #3 0x00000001074e04c4 in waitjobs () #4 0x00000001074c30e8 in execpline () #5 0x00000001074c22ce in execlist () #6 0x00000001074c20f6 in execode () #7 0x00000001074c5ebf in runshfunc () #8 0x00000001074c57f4 in doshfunc () #9 0x000000010750a70b in dotrapargs () #10 0x00000001075097b2 in handletrap () #11 0x00000001075090b0 in zhandler () #12 <signal handler called> #13 0x00007fff8abfe97a in write$NOCANCEL () #14 0x00007fff82ceb9ed in _swrite () #15 0x00007fff82ce44a7 in __sflush () #16 0x00007fff82ce43f5 in fflush () #17 0x0000000107515376 in zwarn () #18 0x00000001075093da in wait_for_processes () #19 0x00000001075090a6 in zhandler () #20 <signal handler called> #21 0x00007fff8abffa12 in sigprocmask () ^ permalink raw reply [flat|nested] 41+ messages in thread
* Re: Deadlock when receiving kill-signal from child process 2015-08-07 0:45 ` Mathias Fredriksson @ 2015-08-07 5:39 ` Bart Schaefer 2015-08-09 13:53 ` Mathias Fredriksson 0 siblings, 1 reply; 41+ messages in thread From: Bart Schaefer @ 2015-08-07 5:39 UTC (permalink / raw) To: zsh-workers On Aug 7, 3:45am, Mathias Fredriksson wrote: } } Sadly I can't be of much assistance here, I believe you can't call } pthread mutexes from a signal handler If true, that would mean either (a) you can't use stdio functions from a signal handler, because this implementation of stdio is using pthread mutexes, or (b) stdio is not allowed to use pthread mutexes, so this implementation is broken. } but that isn't whats happening } here? If I understand correctly a signal is received while a mutex } lock is (being) aquired. Specifially ferror() is attempting to acquire a mutex lock when the signal arrives, and then the handler calls fputc() which tries to acquire the same lock, and: clunk. } I'm not quite sure I understand what these changes do queue_signals() increments a counter that is tested in the signal handler. If the counter is nonzero, the handler does nothing but make note in a static array that the signal was received. If too many signals arrive before there is an opportunity to empty the array, the excess are simply dropped. (The default is to be able to queue 128 signals before starting to lose some -- if you're expecting the shell to handle massive numbers of signals arriving in quick succession, you're using the wrong tool for your job. Further, this is another reason I'm reluctant to adopt the WINCH approach for signals in general.) dont_queue_signals() forces the counter to zero and calls all the shell function handlers for the signals in the static array, in the order the signals were recorded. restore_queue_signals() sets the counter back to some previous state (obtained from queue_signal_level()). unqueue_signals() decrements the counter and calls all the shell functions if (when) it reaches zero. Using the counter means that you can have arbitrarily deep nesting of queue_signals(). Using dont_queue_signals() implies that it is known to be safe to run the handlers at that time, because it unwinds all those levels of nesting at once. So anytime I find myself using dont_queue_signals() I worry that there is a calling scope reason avoid signal handlers. On the other hand, if it's safe to run shell code at all (e.g., runshfunc()), it should also be safe to run signal traps. } but at least } this last patch made it a lot harder for me to have zsh lock up. I had } to leave my script running in a while true; do ...; done loop } (eventually, 30sec-10min it would hit a lock). } } #0 0x00007fff8abfe72a in __sigsuspend () } #1 0x0000000107b59287 in signal_suspend () } #2 0x0000000107b30671 in zwaitjob () Sigh. That looks like another case of waiting for a child that does not exist. Unfortunately this time the call stack beyond here does not hint at where that job was started. Might need another strace that corresponds to this backtrace. } This just seems like the same mutex stuff again: } } #0 0x00007fff8abfe166 in __psynch_mutexwait () } #1 0x00007fff8e4b578a in _pthread_mutex_lock () } #2 0x00007fff82ce5750 in fputc () } #3 0x0000000102c20cd5 in zputs () } #4 0x0000000102c20b3c in mb_niceformat () } #5 0x0000000102c201cd in zwarning () } #6 0x0000000102c20376 in zwarn () } #7 0x0000000102c143da in wait_for_processes () } #8 0x0000000102c140a6 in zhandler () } #9 <signal handler called> } #10 0x00007fff8abfe72a in __sigsuspend () The stack must go further than this? What called __sigsuspend() ? } This also looks vaguely familiar but might as well post it: } } #0 0x00007fff8abf95da in syscall_thread_switch () } #1 0x00007fff853a982d in _OSSpinLockLockSlow () } #2 0x00007fff896d771b in szone_malloc_should_clear () Yeah, this is a signal arriving during memory allocation. Looks like it came from here: } #14 0x00007fff896d98d6 in szone_free_definite_size () } #15 0x0000000101ca5874 in execlist () So we definitely need queue_signals() somewhere down in the guts of execlist(). Which means rejiggering some of the stuff from previous patches, so I think I'd better back up and send a new patch against the git master. What next concerns me is being sure that signals are unqueued often enough that interrupts still work, etc. } Bonus NO_TRAPS_ASYNC: } } #0 0x00007fff8abfe72a in __sigsuspend () } #1 0x0000000107509287 in signal_suspend () } #11 0x00000001075090b0 in zhandler () } #12 <signal handler called> } #13 0x00007fff8abfe97a in write$NOCANCEL () } #14 0x00007fff82ceb9ed in _swrite () } #15 0x00007fff82ce44a7 in __sflush () } #16 0x00007fff82ce43f5 in fflush () } #17 0x0000000107515376 in zwarn () } #18 0x00000001075093da in wait_for_processes () } #19 0x00000001075090a6 in zhandler () } #20 <signal handler called> } #21 0x00007fff8abffa12 in sigprocmask () This trace must also go further? The part shown is calling a handler while during fflush() in a previous handler, but the trace doesn't go back far enough to see where the first handler was called. ^ permalink raw reply [flat|nested] 41+ messages in thread
* Re: Deadlock when receiving kill-signal from child process 2015-08-07 5:39 ` Bart Schaefer @ 2015-08-09 13:53 ` Mathias Fredriksson 2015-08-09 23:42 ` Bart Schaefer 2015-08-10 19:34 ` Bart Schaefer 0 siblings, 2 replies; 41+ messages in thread From: Mathias Fredriksson @ 2015-08-09 13:53 UTC (permalink / raw) To: zsh-workers First off, great work on the last patch (zsh-workers 36022) Bart! I've been testing now with the latest git master and applied said patch on top. At first I thought there were absolutely no more deadlocks, but I managed to repeatedly produce one (when _not_ disowning the child processes). I'm wondering if I'm not getting the complete picture though since there are some "in ?? ()" also in there (I did build with debugging enabled though). My configure options for reference: --enable-cap --enable-multibyte --enable-maildir-support --with-tcsetpgrp --enable-zsh-debug --enable-zsh-mem-debug --enable-zsh-mem-warning --enable-zsh-secure-free --enable-zsh-hash-debug Trace: #0 0x00007fff8abf95da in syscall_thread_switch () #1 0x00007fff853a982d in _OSSpinLockLockSlow () #2 0x00007fff896e1635 in szone_force_lock () #3 0x00007fff896e15e6 in _malloc_fork_prepare () #4 0x00007fff82cb8097 in fork () #5 0x0000000105d3f960 in get_match_ret () #6 0x0000000105d45463 in savehistfile () #7 0x0000000105d42b4f in iaddtoline () #8 0x0000000105d3d69f in gmatchcmp () #9 0x0000000105d3c6ce in qualisdev () #10 0x0000000105d3bff5 in zglob () #11 0x0000000105d423e8 in histstrcmp () #12 0x0000000105d41db3 in printreswdnode () #13 0x0000000105dba726 in ?? () #14 0x0000000105dbac89 in ?? () #15 0x0000000105db91ef in ?? () #16 0x0000000105db8839 in ?? () #17 <signal handler called> #18 0x00007fff896db4fe in tiny_free_list_remove_ptr () #19 0x00007fff896d9b2e in szone_free_definite_size () #20 0x0000000105d82ef6 in getredirs () #21 0x0000000105d70231 in patmatch () #22 0x0000000105d6fd7b in patmatch () #23 0x0000000105d6f8d7 in pattryrefs () #24 0x0000000105d6e105 in patcompile () #25 0x0000000105db8d7d in ?? () #26 0x0000000105db85bf in ?? () #27 0x0000000105d3cf36 in scanner () #28 0x0000000105d7bf51 in paramsubst () #29 0x0000000105d47389 in chrealpath () #30 0x0000000105d42b4f in iaddtoline () #31 0x0000000105d3d69f in gmatchcmp () #32 0x0000000105d3c6ce in qualisdev () #33 0x0000000105d7ce45 in paramsubst () #34 0x0000000105d47389 in chrealpath () #35 0x0000000105d42b4f in iaddtoline () #36 0x0000000105d3d69f in gmatchcmp () #37 0x0000000105d3c6ce in qualisdev () #38 0x0000000105d3bff5 in zglob () #39 0x0000000105d66d6a in histcharssetfn () #40 0x0000000105d6b0f2 in par_cond_2 () #41 0x0000000105d1e9b2 in _mh_execute_header () #42 0x00007fff8610c5c9 in start () On Fri, Aug 7, 2015 at 8:39 AM, Bart Schaefer wrote: } } Specifially ferror() is attempting to acquire a mutex lock when the } signal arrives, and then the handler calls fputc() which tries to } acquire the same lock, and: clunk. Aha, ok. } } So anytime I find myself using dont_queue_signals() I worry that there } is a calling scope reason avoid signal handlers. On the other hand, } if it's safe to run shell code at all (e.g., runshfunc()), it should } also be safe to run signal traps. Thanks for the thorough walkthrough, I understand it a bit better now! } } The stack must go further than this? What called __sigsuspend() ? Actually that is all that I got out from gdb, I'll try to dig deeper somehow (if it's possible) next time it happens. } } This trace must also go further? The part shown is calling a handler } while during fflush() in a previous handler, but the trace doesn't } go back far enough to see where the first handler was called. Same as previous, this was all that I got out from gdb. ^ permalink raw reply [flat|nested] 41+ messages in thread
* Re: Deadlock when receiving kill-signal from child process 2015-08-09 13:53 ` Mathias Fredriksson @ 2015-08-09 23:42 ` Bart Schaefer 2015-08-10 0:02 ` Mikael Magnusson 2015-08-10 0:29 ` Bart Schaefer 2015-08-10 19:34 ` Bart Schaefer 1 sibling, 2 replies; 41+ messages in thread From: Bart Schaefer @ 2015-08-09 23:42 UTC (permalink / raw) To: zsh-workers On Aug 9, 4:53pm, Mathias Fredriksson wrote: } Subject: Re: Deadlock when receiving kill-signal from child process } } I'm wondering if I'm not getting the complete picture } though since there are some "in ?? ()" also in there (I did build with } debugging enabled though). Did you "make install" before running this? If so, *don't* -- run the binary straight out of the build tree. If you "make install" the symbol table gets stripped even if you've compiled with debugging, which gives you the incomplete stack traces you've been seeing. In this case I think that's actually causing a misleading backtrace, because: } #17 <signal handler called> } #18 0x00007fff896db4fe in tiny_free_list_remove_ptr () } #19 0x00007fff896d9b2e in szone_free_definite_size () } #20 0x0000000105d82ef6 in getredirs () There is already a queue_signals() around getredirs() so it should not be calling a signal handler here, or at least the handler should not be doing anything interesting. Also this part doesn't make sense: } #0 0x00007fff8abf95da in syscall_thread_switch () } #1 0x00007fff853a982d in _OSSpinLockLockSlow () } #2 0x00007fff896e1635 in szone_force_lock () } #3 0x00007fff896e15e6 in _malloc_fork_prepare () } #4 0x00007fff82cb8097 in fork () } #5 0x0000000105d3f960 in get_match_ret () } #6 0x0000000105d45463 in savehistfile () There's no call to get_match_ret() from savehistfile(), and it's pretty unlikely that savehistfile is called at all, so this stack looks trashed to me. (My other guess would be you're using the new binary with an old core file, but theoretically you're not reading a core file at all). Also here: } #36 0x0000000105d3d69f in gmatchcmp () } #37 0x0000000105d3c6ce in qualisdev () qualisdev() doesn't call anything. Stack definitely hosed. Nevertheless, it looks like glob.c needs to protect some places where it manipulates global state. ^ permalink raw reply [flat|nested] 41+ messages in thread
* Re: Deadlock when receiving kill-signal from child process 2015-08-09 23:42 ` Bart Schaefer @ 2015-08-10 0:02 ` Mikael Magnusson 2015-08-10 0:16 ` Mathias Fredriksson 2015-08-10 0:36 ` Bart Schaefer 2015-08-10 0:29 ` Bart Schaefer 1 sibling, 2 replies; 41+ messages in thread From: Mikael Magnusson @ 2015-08-10 0:02 UTC (permalink / raw) To: Bart Schaefer; +Cc: zsh workers On Mon, Aug 10, 2015 at 1:42 AM, Bart Schaefer <schaefer@brasslantern.com> wrote: > On Aug 9, 4:53pm, Mathias Fredriksson wrote: > } Subject: Re: Deadlock when receiving kill-signal from child process > } > } I'm wondering if I'm not getting the complete picture > } though since there are some "in ?? ()" also in there (I did build with > } debugging enabled though). > > Did you "make install" before running this? If so, *don't* -- run the > binary straight out of the build tree. If you "make install" the symbol > table gets stripped even if you've compiled with debugging, which gives > you the incomplete stack traces you've been seeing. I don't think this is the case, there's a separate install-strip target for that. I've always done make install and ran gdb on the resulting install successfully. There's also a caveat with running the in-tree binary: all modules loaded will still be from $PREFIX, not the build directory. -- Mikael Magnusson ^ permalink raw reply [flat|nested] 41+ messages in thread
* Re: Deadlock when receiving kill-signal from child process 2015-08-10 0:02 ` Mikael Magnusson @ 2015-08-10 0:16 ` Mathias Fredriksson 2015-08-10 1:47 ` Bart Schaefer 2015-08-10 0:36 ` Bart Schaefer 1 sibling, 1 reply; 41+ messages in thread From: Mathias Fredriksson @ 2015-08-10 0:16 UTC (permalink / raw) To: zsh-workers On Mon, Aug 10, 2015 at 3:02 AM, Mikael Magnusson wrote: } I don't think this is the case, there's a separate install-strip } target for that. I've always done make install and ran gdb on the } resulting install successfully. There's also a caveat with running the } in-tree binary: all modules loaded will still be from $PREFIX, not the } build directory. I'm thinking this might be correct, at least doing a "make clean && make" and running from Src/zsh did not give any more meaningful output: #0 0x00007fff8abf95da in syscall_thread_switch () #1 0x00007fff853a982d in _OSSpinLockLockSlow () #2 0x00007fff896d771b in szone_malloc_should_clear () #3 0x00007fff896d7667 in malloc_zone_malloc () #4 0x00007fff896d6187 in malloc () #5 0x000000010393334a in zglob () #6 0x000000010393350e in zglob () #7 0x00000001039b26ba in ?? () #8 0x00000001039b2de9 in ?? () #9 0x00000001039b134f in ?? () #10 0x00000001039b0999 in ?? () #11 <signal handler called> #12 0x00007fff896dad6d in tiny_free_list_add_ptr () #13 0x00007fff896d9e7f in szone_free_definite_size () #14 0x000000010397b096 in taddstr () #15 0x0000000103968451 in patmatch () #16 0x0000000103967f9b in patmatch () #17 0x0000000103967af7 in patmatch () #18 0x0000000103966325 in patcompile () #19 0x00000001039b0edd in ?? () #20 0x00000001039b071f in ?? () #21 0x00000001039355e6 in gmatchcmp () #22 0x0000000103974171 in paramsubst () #23 0x000000010393fa39 in casemodify () #24 0x000000010393b1ff in hend () #25 0x0000000103935d4f in bracechardots () #26 0x0000000103934d7e in scanner () #27 0x0000000103975065 in paramsubst () #28 0x000000010393fa39 in casemodify () #29 0x000000010393b1ff in hend () #30 0x0000000103935d4f in bracechardots () #31 0x0000000103934d7e in scanner () #32 0x00000001039346a5 in qualisblk () #33 0x000000010395ef8a in zputenv () #34 0x0000000103963312 in par_cond_triple () #35 0x0000000103917062 in _mh_execute_header () #36 0x00007fff8610c5c9 in start () #0 0x00007fff8abf95da in syscall_thread_switch () #1 0x00007fff853a982d in _OSSpinLockLockSlow () #2 0x00007fff896e1635 in szone_force_lock () #3 0x00007fff896e15e6 in _malloc_fork_prepare () #4 0x00007fff82cb8097 in fork () #5 0x000000010ee06010 in insert () #6 0x000000010ee0bb13 in histreduceblanks () #7 0x000000010ee091ff in hend () #8 0x000000010ee03d4f in bracechardots () #9 0x000000010ee02d7e in scanner () #10 0x000000010ee026a5 in qualisblk () #11 0x000000010ee08a98 in iaddtoline () #12 0x000000010ee08463 in addhistnode () #13 0x000000010ee80886 in ?? () #14 0x000000010ee80de9 in ?? () #15 0x000000010ee7f34f in ?? () #16 0x000000010ee7e999 in ?? () #17 <signal handler called> #18 0x00007fff896db4fe in tiny_free_list_remove_ptr () #19 0x00007fff896d9b2e in szone_free_definite_size () #20 0x000000010ee49096 in taddstr () #21 0x000000010ee36451 in patmatch () #22 0x000000010ee35f9b in patmatch () #23 0x000000010ee35af7 in patmatch () #24 0x000000010ee34325 in patcompile () #25 0x000000010ee7eedd in ?? () #26 0x000000010ee7e71f in ?? () #27 0x000000010ee035e6 in gmatchcmp () #28 0x000000010ee42171 in paramsubst () #29 0x000000010ee0da39 in casemodify () #30 0x000000010ee091ff in hend () #31 0x000000010ee03d4f in bracechardots () #32 0x000000010ee02d7e in scanner () #33 0x000000010ee43065 in paramsubst () #34 0x000000010ee0da39 in casemodify () #35 0x000000010ee091ff in hend () #36 0x000000010ee03d4f in bracechardots () #37 0x000000010ee02d7e in scanner () #38 0x000000010ee026a5 in qualisblk () #39 0x000000010ee2cf8a in zputenv () #40 0x000000010ee31312 in par_cond_triple () #41 0x000000010ede5062 in _mh_execute_header () #42 0x00007fff8610c5c9 in start () ^ permalink raw reply [flat|nested] 41+ messages in thread
* Re: Deadlock when receiving kill-signal from child process 2015-08-10 0:16 ` Mathias Fredriksson @ 2015-08-10 1:47 ` Bart Schaefer 2015-08-10 2:02 ` Mikael Magnusson 0 siblings, 1 reply; 41+ messages in thread From: Bart Schaefer @ 2015-08-10 1:47 UTC (permalink / raw) To: zsh-workers On Aug 10, 3:16am, Mathias Fredriksson wrote: } } I'm thinking this might be correct, at least doing a "make clean && } make" and running from Src/zsh did not give any more meaningful } output: On what platform are you building this, and is there anything in your environment that might be causing optimization flags to be passed to your C compiler? Because this looks like optimized stack traces, and configuring with --enable-zsh-debug is supposed to disable optimization, so if that's not working we may need to update config.ac. ^ permalink raw reply [flat|nested] 41+ messages in thread
* Re: Deadlock when receiving kill-signal from child process 2015-08-10 1:47 ` Bart Schaefer @ 2015-08-10 2:02 ` Mikael Magnusson 2015-08-10 15:59 ` Bart Schaefer 0 siblings, 1 reply; 41+ messages in thread From: Mikael Magnusson @ 2015-08-10 2:02 UTC (permalink / raw) To: Bart Schaefer; +Cc: zsh workers On Mon, Aug 10, 2015 at 3:47 AM, Bart Schaefer <schaefer@brasslantern.com> wrote: > On Aug 10, 3:16am, Mathias Fredriksson wrote: > } > } I'm thinking this might be correct, at least doing a "make clean && > } make" and running from Src/zsh did not give any more meaningful > } output: > > On what platform are you building this, and is there anything in your > environment that might be causing optimization flags to be passed to > your C compiler? > > Because this looks like optimized stack traces, and configuring with > --enable-zsh-debug is supposed to disable optimization, so if that's > not working we may need to update config.ac. I think --enable-zsh-debug only sets the DEBUG define, and nothing more. If you want to debug you should put appropriate things in CFLAGS before running configure depending on your compiler. I use -march=native -pipe -gdwarf-4 -fvar-tracking-assignments -g3 -Og -Og needs relatively recent gcc, if you don't have it, use -O0 or -O1 instead. -- Mikael Magnusson ^ permalink raw reply [flat|nested] 41+ messages in thread
* Re: Deadlock when receiving kill-signal from child process 2015-08-10 2:02 ` Mikael Magnusson @ 2015-08-10 15:59 ` Bart Schaefer 2015-08-10 17:30 ` Mathias Fredriksson 0 siblings, 1 reply; 41+ messages in thread From: Bart Schaefer @ 2015-08-10 15:59 UTC (permalink / raw) To: zsh workers On Aug 10, 4:02am, Mikael Magnusson wrote: } Subject: Re: Deadlock when receiving kill-signal from child process } } I think --enable-zsh-debug only sets the DEBUG define, and nothing } more. My generated configure script contains: if test -n "$auto_cflags" && test ."$ansi2knr" != .yes; then if test "${enable_zsh_debug}" = yes; then if test -n "$GCC"; then CFLAGS="$CFLAGS -Wall -Wmissing-prototypes -ggdb" else CFLAGS="$CFLAGS -g" fi else if test -n "$GCC"; then CFLAGS="$CFLAGS -Wall -Wmissing-prototypes -O2" else CFLAGS="$CFLAGS -O" fi fi fi So apparently on Mathias's platform, passing -g plus not passing -O is not sufficient to actually enable debugging symbols. ^ permalink raw reply [flat|nested] 41+ messages in thread
* Re: Deadlock when receiving kill-signal from child process 2015-08-10 15:59 ` Bart Schaefer @ 2015-08-10 17:30 ` Mathias Fredriksson 0 siblings, 0 replies; 41+ messages in thread From: Mathias Fredriksson @ 2015-08-10 17:30 UTC (permalink / raw) To: zsh-workers On Mon, Aug 10, 2015 at 6:59 PM, Bart Schaefer wrote: } } So apparently on Mathias's platform, passing -g plus not passing -O is } not sufficient to actually enable debugging symbols. For me "-Wall -Wmissing-prototypes -ggdb" are selected as CFLAGS by configure. I have tried to play around with the optimization flag (-O), but I'm seeing weird results. With -O0 I get the same kind of output as before With -O1 and -O2: #0 0x00007fff8abf95da in syscall_thread_switch () #1 0x00007fff853a982d in _OSSpinLockLockSlow () #2 0x00007fff896e1635 in szone_force_lock () #3 0x00007fff896e15e6 in _malloc_fork_prepare () #4 0x00007fff82cb8097 in fork () #5 0x0000000103e15f6d in parsecmd () #6 0x0000000103e199a3 in execcmd () #7 0x0000000103e148db in execpline () #8 0x0000000103e13cfe in execlist () #9 0x0000000103e13b02 in execlist () #10 0x0000000103e17d3c in execcmd () #11 0x0000000103e1767e in execrestore () #12 0x0000000103e6037d in paramsubst () #13 0x0000000103e5f5e8 in paramsubst () #14 <signal handler called> Cannot access memory at address 0x90 With just -O: #0 0x00007fff8abf95da in syscall_thread_switch () #1 0x00007fff853a982d in _OSSpinLockLockSlow () #2 0x00007fff896e1635 in szone_force_lock () #3 0x00007fff896e15e6 in _malloc_fork_prepare () #4 0x00007fff82cb8097 in fork () #5 0x0000000104edac5a in doshfunc () #6 0x0000000104eded31 in execcmd () #7 0x0000000104ed94f4 in getoutput () #8 0x0000000104ed88db in execpline () #9 0x0000000104ed86d2 in execpline () #10 0x0000000104edcbf4 in execcmd () #11 0x0000000104edc54c in execcmd () #12 0x0000000104f34ba2 in dowatch () #13 0x0000000104f33c27 in lchdir () #14 0x0000000104f3349c in addunprintable () #15 <signal handler called> Cannot access memory at address 0x90 ^ permalink raw reply [flat|nested] 41+ messages in thread
* Re: Deadlock when receiving kill-signal from child process 2015-08-10 0:02 ` Mikael Magnusson 2015-08-10 0:16 ` Mathias Fredriksson @ 2015-08-10 0:36 ` Bart Schaefer 1 sibling, 0 replies; 41+ messages in thread From: Bart Schaefer @ 2015-08-10 0:36 UTC (permalink / raw) To: zsh workers On Aug 10, 2:02am, Mikael Magnusson wrote: } } > Did you "make install" before running this? If so, *don't* -- run the } > binary straight out of the build tree. If you "make install" the symbol } > table gets stripped } I don't think this is the case, there's a separate install-strip } target for that. I've always done make install and ran gdb on the } resulting install successfully. Hrm. Well, there's SOME reason why his backtraces only have the function names (and sometimes only some of those) and none of the call arguments. ^ permalink raw reply [flat|nested] 41+ messages in thread
* Re: Deadlock when receiving kill-signal from child process 2015-08-09 23:42 ` Bart Schaefer 2015-08-10 0:02 ` Mikael Magnusson @ 2015-08-10 0:29 ` Bart Schaefer 1 sibling, 0 replies; 41+ messages in thread From: Bart Schaefer @ 2015-08-10 0:29 UTC (permalink / raw) To: zsh-workers On Aug 9, 4:42pm, Bart Schaefer wrote: } } Nevertheless, it looks like glob.c needs to protect some places where } it manipulates global state. I couldn't really find anything definitive -- all the memory management routines (halloc, zhalloc, zfree, etc.) already do signal queuing, so we only get into trouble with e.g. stdio using the library malloc/free directly. The hunks in patcompile() below are paranoia because the static globals patcode, patsize, et al. are being frobbed -- but even with this I get worried that a signal trap that uses pattern matching called in the midst of some other pattern matching operation could leave those in an inconsistent state, because they're not saved/restored like globbing state in zglob(). Similarly if you were in the middle of a pattern that wanted to set the MATCH / MBEGIN / MEND / match / mbegin / mend parameters and then a trap handler also did so, it sure looks to me as if the state of those parameters becomes indeterminate. Patch below follows on to 36022 but doesn't overlap with it in any way. diff --git a/Src/glob.c b/Src/glob.c index eff34a2..f82c3bd 100644 --- a/Src/glob.c +++ b/Src/glob.c @@ -216,22 +216,26 @@ static struct globdata curglobdata; #define save_globstate(N) \ do { \ + queue_signals(); \ memcpy(&(N), &curglobdata, sizeof(struct globdata)); \ (N).gd_pathpos = pathpos; \ (N).gd_pathbuf = pathbuf; \ (N).gd_glob_pre = glob_pre; \ (N).gd_glob_suf = glob_suf; \ pathbuf = NULL; \ + unqueue_signals(); \ } while (0) #define restore_globstate(N) \ do { \ + queue_signals(); \ zfree(pathbuf, pathbufsz); \ memcpy(&curglobdata, &(N), sizeof(struct globdata)); \ pathpos = (N).gd_pathpos; \ pathbuf = (N).gd_pathbuf; \ glob_pre = (N).gd_glob_pre; \ glob_suf = (N).gd_glob_suf; \ + unqueue_signals(); \ } while (0) /* pathname component in filename patterns */ diff --git a/Src/pattern.c b/Src/pattern.c index 8fa1a72..7d38988 100644 --- a/Src/pattern.c +++ b/Src/pattern.c @@ -520,6 +520,8 @@ patcompile(char *exp, int inflags, char **endexp) char *lng, *strp = NULL; Patprog p; + queue_signals(); + startoff = sizeof(struct patprog); /* Ensure alignment of start of program string */ startoff = (startoff + sizeof(union upat) - 1) & ~(sizeof(union upat) - 1); @@ -582,8 +584,10 @@ patcompile(char *exp, int inflags, char **endexp) if (!strp || (*strp && *strp != '/')) { /* No, do normal compilation. */ strp = NULL; - if (patcompswitch(0, &flags) == 0) + if (patcompswitch(0, &flags) == 0) { + unqueue_signals(); return NULL; + } } else { /* * Yes, copy the string, and skip compilation altogether. @@ -715,6 +719,8 @@ patcompile(char *exp, int inflags, char **endexp) if (endexp) *endexp = patparse; + + unqueue_signals(); return p; } -- Barton E. Schaefer ^ permalink raw reply [flat|nested] 41+ messages in thread
* Re: Deadlock when receiving kill-signal from child process 2015-08-09 13:53 ` Mathias Fredriksson 2015-08-09 23:42 ` Bart Schaefer @ 2015-08-10 19:34 ` Bart Schaefer 2015-08-10 21:17 ` Mathias Fredriksson 1 sibling, 1 reply; 41+ messages in thread From: Bart Schaefer @ 2015-08-10 19:34 UTC (permalink / raw) To: zsh-workers On Aug 9, 4:53pm, Mathias Fredriksson wrote: } } At first I thought there were absolutely no more deadlocks, but I } managed to repeatedly produce one (when _not_ disowning the child } processes). Reviewing the code again has led me to realize / recall that although we consistently use our signal-safe wrappers around malloc(), the similar wrapper around free() is enabled only when the configuration has included --enable-zsh-mem. Further, we're inconsistent about using the signal-safe wrapper for realloc() [a better one gets compiled in with --enable-zsh-mem]. The last few stack traces you've sent [except for the most recent one mentioning fork()] indicate clashes between realloc() and free(), even though other parts of the stack look wonky. Even with --enable-zsh-mem the realloc() wrapper sometimes calls malloc() unsafely, though that wouldn't be hard to fix. A quick grep indicates 34 realloc() and 224 free() scattered around the code. Probably many of them are already within queue_signals(). The patch below fixes four of them that your stack traces seem to point to as particular culprits. It's probably not worth it to try to pre-emptively change all the others. If you are still able to create deadlocks after the below, I'd also ask you to try configuring with --enable-zsh-mem and see if that gets rid of any remaining deadlocks. It'd also be interesting to benchmark a few versions of zsh including the latest from git, on things like how long **/* takes in a big tree, how long "make check" takes to run, etc., both with and without using --enable-zsh-mem. Any volunteers? diff --git a/Src/glob.c b/Src/glob.c index f82c3bd..3af4690 100644 --- a/Src/glob.c +++ b/Src/glob.c @@ -257,7 +257,7 @@ addpath(char *s, int l) { DPUTS(!pathbuf, "BUG: pathbuf not initialised"); while (pathpos + l + 1 >= pathbufsz) - pathbuf = realloc(pathbuf, pathbufsz *= 2); + pathbuf = zrealloc(pathbuf, pathbufsz *= 2); while (l--) pathbuf[pathpos++] = *s++; pathbuf[pathpos++] = '/'; diff --git a/Src/text.c b/Src/text.c index cf73004..3978a26 100644 --- a/Src/text.c +++ b/Src/text.c @@ -77,7 +77,7 @@ taddpending(char *str1, char *str2) */ if (tpending) { int oldlen = strlen(tpending); - tpending = realloc(tpending, len + oldlen); + tpending = zrealloc(tpending, len + oldlen); sprintf(tpending + oldlen, "%s%s", str1, str2); } else { tpending = (char *)zalloc(len); @@ -110,7 +110,7 @@ taddchr(int c) tptr--; return; } - tbuf = realloc(tbuf, tsiz *= 2); + tbuf = zrealloc(tbuf, tsiz *= 2); tlim = tbuf + tsiz; tptr = tbuf + tsiz / 2; } @@ -130,7 +130,7 @@ taddstr(char *s) if (!tbuf) return; - tbuf = realloc(tbuf, tsiz *= 2); + tbuf = zrealloc(tbuf, tsiz *= 2); tlim = tbuf + tsiz; tptr = tbuf + x; } -- Barton E. Schaefer ^ permalink raw reply [flat|nested] 41+ messages in thread
* Re: Deadlock when receiving kill-signal from child process 2015-08-10 19:34 ` Bart Schaefer @ 2015-08-10 21:17 ` Mathias Fredriksson 2015-08-10 22:53 ` Mathias Fredriksson 0 siblings, 1 reply; 41+ messages in thread From: Mathias Fredriksson @ 2015-08-10 21:17 UTC (permalink / raw) To: zsh-workers On Mon, Aug 10, 2015 at 10:34 PM, Bart Schaefer wrote: } } A quick grep indicates 34 realloc() and 224 free() scattered around } the code. Probably many of them are already within queue_signals(). } The patch below fixes four of them that your stack traces seem to } point to as particular culprits. It's probably not worth it to try } to pre-emptively change all the others. That sounds reasonable to me. } } If you are still able to create deadlocks after the below, I'd also } ask you to try configuring with --enable-zsh-mem and see if that gets } rid of any remaining deadlocks. I had one skill, Bart, to produce deadlocks. And now you've taken that away from me! On a more serious note, I have not been able to produce any deadlocks after 36084! I also did not get around to test with --enable-zsh-mem since it is working just fine. I also tested building zsh without debugging, no problems there either. Thanks for sticking through with this, and good job on finding (hopefully) all the edge cases :)! ^ permalink raw reply [flat|nested] 41+ messages in thread
* Re: Deadlock when receiving kill-signal from child process 2015-08-10 21:17 ` Mathias Fredriksson @ 2015-08-10 22:53 ` Mathias Fredriksson 2015-08-11 0:53 ` Bart Schaefer 2015-08-11 4:06 ` Running commands in a zpty worker Bart Schaefer 0 siblings, 2 replies; 41+ messages in thread From: Mathias Fredriksson @ 2015-08-10 22:53 UTC (permalink / raw) To: zsh-workers On Tue, Aug 11, 2015 at 12:17 AM, Mathias Fredriksson wrote: } ... On a more serious note, I have not been able to produce } any deadlocks after 36084! I also did not get around to test with } --enable-zsh-mem since it is working just fine. I also tested building } zsh without debugging, no problems there either. Well, scratch that. I went back to my original use case where I'm running commands in a zpty worker and notifying the original zsh pid that the work is done (previously through WINCH, now tested with USR1). There are usually two of these commands that are started at precmd and usually finish either before or shortly after the prompt is rendered. Now if I hold enter at and empty prompt, I can reproduce this deadlock very quickly. #0 0x00007fff8abfe72a in __sigsuspend () #1 0x00000001065013e9 in signal_suspend () #2 0x00000001064d8035 in zwaitjob () #3 0x00000001064d7e80 in waitjobs () #4 0x00000001064b9388 in execpline () #5 0x00000001064b86fb in execlist () #6 0x00000001064df9fc in execif () #7 0x00000001064bf4ce in execcmd () #8 0x00000001064b8fdd in execpline () #9 0x00000001064b8440 in execlist () #10 0x00000001064df9fc in execif () #11 0x00000001064bf4ce in execcmd () #12 0x00000001064b8fdd in execpline () #13 0x00000001064b8440 in execlist () #14 0x00000001064b8266 in execode () #15 0x00000001064bc092 in runshfunc () #16 0x00000001064bbabf in doshfunc () #17 0x00000001064c1fc1 in execshfunc () #18 0x00000001064bfc2b in execcmd () #19 0x00000001064b8fdd in execpline () #20 0x00000001064b8440 in execlist () #21 0x00000001064b8266 in execode () #22 0x00000001064bc092 in runshfunc () #23 0x00000001064bbabf in doshfunc () #24 0x000000010650ff96 in callhookfunc () #25 0x000000010651020f in preprompt () #26 0x00000001064d203e in loop () #27 0x00000001064d501b in zsh_main () #28 0x00007fff8610c5c9 in start () If I try to compile with --enable-zsh-mem I'm flooded with a bunch of these messages (until zsh eventually segfaults): 3: mem.c:1575: MEM: allocation error at brk. 138: mem.c:1514: BUG: attempt to free storage at invalid address 175: mem.c:1514: BUG: attempt to free storage at invalid address ... 8: mem.c:1514: BUG: attempt to free storage at invalid address 8: mem.c:1514: BUG: attempt to free storage at invalid address 12: mem.c:1281: MEM: allocation error at sbrk, size 20480. ^ permalink raw reply [flat|nested] 41+ messages in thread
* Re: Deadlock when receiving kill-signal from child process 2015-08-10 22:53 ` Mathias Fredriksson @ 2015-08-11 0:53 ` Bart Schaefer 2015-08-11 12:17 ` Mathias Fredriksson 2015-08-11 4:06 ` Running commands in a zpty worker Bart Schaefer 1 sibling, 1 reply; 41+ messages in thread From: Bart Schaefer @ 2015-08-11 0:53 UTC (permalink / raw) To: zsh-workers On Aug 11, 1:53am, Mathias Fredriksson wrote: } } Well, scratch that. I went back to my original use case where I'm } running commands in a zpty worker and notifying the original zsh pid } that the work is done (previously through WINCH, now tested with } USR1). There are usually two of these commands that are started at } precmd and usually finish either before or shortly after the prompt is } rendered. Now if I hold enter at and empty prompt, I can reproduce } this deadlock very quickly. Interesting. I deliberately excluded preprompt() from the signal queue in my init.c:loop() edit. Try this: diff --git a/Src/init.c b/Src/init.c index f2021f0..22db4b3 100644 --- a/Src/init.c +++ b/Src/init.c @@ -127,9 +127,7 @@ loop(int toplevel, int justonce) * no matter what. */ errflag = 0; - unqueue_signals(); preprompt(); - queue_signals(); if (stophist != 3) hbegin(1); else ^ permalink raw reply [flat|nested] 41+ messages in thread
* Re: Deadlock when receiving kill-signal from child process 2015-08-11 0:53 ` Bart Schaefer @ 2015-08-11 12:17 ` Mathias Fredriksson 2015-08-11 14:38 ` Mathias Fredriksson 2015-08-11 15:07 ` Bart Schaefer 0 siblings, 2 replies; 41+ messages in thread From: Mathias Fredriksson @ 2015-08-11 12:17 UTC (permalink / raw) To: zsh-workers On Tue, Aug 11, 2015 at 3:53 AM, Bart Schaefer wrote: > On Aug 11, 1:53am, Mathias Fredriksson wrote: > > Interesting. I deliberately excluded preprompt() from the signal queue > in my init.c:loop() edit. Try this: Ah, that would explain why it happened again. Unfortunately, that patch seems insufficient: #0 0x00007fff8abfe72a in __sigsuspend () #1 0x00000001013bc3e9 in signal_suspend () #2 0x0000000101392fc1 in zwaitjob () #3 0x0000000101392e0c in waitjobs () #4 0x0000000101374314 in execpline () #5 0x0000000101373687 in execlist () #6 0x000000010139a988 in execif () #7 0x000000010137a45a in execcmd () #8 0x0000000101373f69 in execpline () #9 0x00000001013733cc in execlist () #10 0x000000010139a988 in execif () #11 0x000000010137a45a in execcmd () #12 0x0000000101373f69 in execpline () #13 0x00000001013733cc in execlist () #14 0x00000001013731f2 in execode () #15 0x000000010137701e in runshfunc () #16 0x0000000101376a4b in doshfunc () #17 0x000000010137cf4d in execshfunc () #18 0x000000010137abb7 in execcmd () #19 0x0000000101373f69 in execpline () #20 0x00000001013733cc in execlist () #21 0x00000001013731f2 in execode () #22 0x000000010137701e in runshfunc () #23 0x0000000101376a4b in doshfunc () #24 0x00000001013caf96 in callhookfunc () #25 0x00000001013cb20f in preprompt () #26 0x000000010138cfca in loop () #27 0x000000010138ffa7 in zsh_main () #28 0x00007fff8610c5c9 in start () ^ permalink raw reply [flat|nested] 41+ messages in thread
* Re: Deadlock when receiving kill-signal from child process 2015-08-11 12:17 ` Mathias Fredriksson @ 2015-08-11 14:38 ` Mathias Fredriksson 2015-08-11 15:07 ` Bart Schaefer 1 sibling, 0 replies; 41+ messages in thread From: Mathias Fredriksson @ 2015-08-11 14:38 UTC (permalink / raw) To: zsh-workers On Tue, Aug 11, 2015 at 3:17 PM, Mathias Fredriksson wrote: > Ah, that would explain why it happened again. Unfortunately, that > patch seems insufficient: Actually I had unsuccessfully applied the last patch here, really sorry about that! Doesn't change the fact that it still freezes (pretty identically) though: #0 0x00007fff8abfe72a in __sigsuspend () #1 0x000000010284a429 in signal_suspend () #2 0x0000000102821001 in zwaitjob () #3 0x0000000102820e4c in waitjobs () #4 0x000000010280240c in execpline () #5 0x000000010280177f in execlist () #6 0x00000001028289c8 in execif () #7 0x0000000102808552 in execcmd () #8 0x0000000102802061 in execpline () #9 0x00000001028014c4 in execlist () #10 0x00000001028289c8 in execif () #11 0x0000000102808552 in execcmd () #12 0x0000000102802061 in execpline () #13 0x00000001028014c4 in execlist () #14 0x00000001028012ea in execode () #15 0x0000000102805116 in runshfunc () #16 0x0000000102804b43 in doshfunc () #17 0x000000010280b045 in execshfunc () #18 0x0000000102808caf in execcmd () #19 0x0000000102802061 in execpline () #20 0x00000001028014c4 in execlist () #21 0x00000001028012ea in execode () #22 0x0000000102805116 in runshfunc () #23 0x0000000102804b43 in doshfunc () #24 0x0000000102858fd6 in callhookfunc () #25 0x000000010285924f in preprompt () #26 0x000000010281b02e in loop () #27 0x000000010281dfe7 in zsh_main () #28 0x00007fff8610c5c9 in start () ^ permalink raw reply [flat|nested] 41+ messages in thread
* Re: Deadlock when receiving kill-signal from child process 2015-08-11 12:17 ` Mathias Fredriksson 2015-08-11 14:38 ` Mathias Fredriksson @ 2015-08-11 15:07 ` Bart Schaefer 2015-08-11 15:22 ` Mathias Fredriksson 1 sibling, 1 reply; 41+ messages in thread From: Bart Schaefer @ 2015-08-11 15:07 UTC (permalink / raw) To: zsh-workers On Aug 11, 3:17pm, Mathias Fredriksson wrote: } } #0 0x00007fff8abfe72a in __sigsuspend () } #1 0x00000001013bc3e9 in signal_suspend () } #2 0x0000000101392fc1 in zwaitjob () } #3 0x0000000101392e0c in waitjobs () } #4 0x0000000101374314 in execpline () This looks like we're waiting for a non-existent job again. Last time it was the strace output that pointed to the culprit, because here the call stack has most likely grown and shrunk several times before the blocking waitjobs() is finally called. execpline() already does queue_signals() around its only waitjobs(), and zwaitjob() runs the signal queue before checking the status of jobs, so the following is a bit of a shot in the dark, rearranging the order in which SIGCHILD and the queues are managed. I think it's probably better to do it in this order anyway, I was undecided about it when I initially made the patches. diff --git a/Src/exec.c b/Src/exec.c index a635c18..45f1c66 100644 --- a/Src/exec.c +++ b/Src/exec.c @@ -1607,8 +1607,8 @@ execpline(Estate state, wordcode slcode, int how, int last1) !(jobtab[list_pipe_job].stat & STAT_STOPPED)) { int q = queue_signal_level(); child_unblock(); - dont_queue_signals(); child_block(); + dont_queue_signals(); restore_queue_signals(q); } if (list_pipe_child && diff --git a/Src/jobs.c b/Src/jobs.c index 9333488..ed647b8 100644 --- a/Src/jobs.c +++ b/Src/jobs.c @@ -1420,9 +1420,9 @@ zwaitjob(int job, int wait_cmd) int q = queue_signal_level(); Job jn = jobtab + job; - dont_queue_signals(); child_block(); /* unblocked during signal_suspend() */ queue_traps(wait_cmd); + dont_queue_signals(); if (jn->procs || jn->auxprocs) { /* if any forks were done */ jn->stat |= STAT_LOCKED; if (jn->stat & STAT_CHANGED) @@ -1478,9 +1478,9 @@ zwaitjob(int job, int wait_cmd) pipestats[0] = lastval; numpipestats = 1; } + restore_queue_signals(q); unqueue_traps(); child_unblock(); - restore_queue_signals(q); return 0; } -- Barton E. Schaefer ^ permalink raw reply [flat|nested] 41+ messages in thread
* Re: Deadlock when receiving kill-signal from child process 2015-08-11 15:07 ` Bart Schaefer @ 2015-08-11 15:22 ` Mathias Fredriksson 0 siblings, 0 replies; 41+ messages in thread From: Mathias Fredriksson @ 2015-08-11 15:22 UTC (permalink / raw) To: zsh-workers On Tue, Aug 11, 2015 at 6:07 PM, Bart Schaefer wrote: > > This looks like we're waiting for a non-existent job again. Last time > it was the strace output that pointed to the culprit, because here the > call stack has most likely grown and shrunk several times before the > blocking waitjobs() is finally called. > > execpline() already does queue_signals() around its only waitjobs(), > and zwaitjob() runs the signal queue before checking the status of > jobs, so the following is a bit of a shot in the dark, rearranging > the order in which SIGCHILD and the queues are managed. I think it's > probably better to do it in this order anyway, I was undecided about > it when I initially made the patches. That seems to have done it, can't reproduce anymore! ^ permalink raw reply [flat|nested] 41+ messages in thread
* Running commands in a zpty worker 2015-08-10 22:53 ` Mathias Fredriksson 2015-08-11 0:53 ` Bart Schaefer @ 2015-08-11 4:06 ` Bart Schaefer 2015-08-11 13:14 ` Mathias Fredriksson 1 sibling, 1 reply; 41+ messages in thread From: Bart Schaefer @ 2015-08-11 4:06 UTC (permalink / raw) To: zsh-workers On Aug 11, 1:53am, Mathias Fredriksson wrote: } } I went back to my original use case where I'm running commands in a } zpty worker and notifying the original zsh pid that the work is done } (previously through WINCH, now tested with USR1). Incidentally you might try using ZLE handler functions for this instead of signals. You'd need a FIFO for the zpty command to write to and the ZLE handler to listen on. Which is really kind of silly given that there's already a descriptor. With this patch you can do e.g. typeset -A ptys watcher() { local line; zpty -r $ptys[$1] line; etc with $line } zpty firstPTY some command ... ptys[$REPLY]=firstPTY zle -F $REPLY watcher Just be careful to remove the handler before the slave side of the pty is closed (e.g., worker exits) or you may end up with a runaway handler. diff --git a/Doc/Zsh/mod_zpty.yo b/Doc/Zsh/mod_zpty.yo index 340f983..44b375a 100644 --- a/Doc/Zsh/mod_zpty.yo +++ b/Doc/Zsh/mod_zpty.yo @@ -18,6 +18,15 @@ characters are echoed. With the tt(-b) option, input to and output from the pseudo-terminal are made non-blocking. + +The shell parameter tt(REPLY) is set to the file descriptor assigned to +the master side of the pseudo-terminal. This allows the terminal to be +monitored with ZLE descriptor handlers (see ifzman(zmanref(zshzle))\ +ifnzman(noderef(Zle Builtins))) or manipulated with tt(sysread) and +tt(syswrite) (see ifzman(THE ZSH/SYSTEM MODULE in zmanref(zshmodules))\ +ifnzman(noderef(The zsh/system Module))). em(Warning): Use of tt(sysread) +and tt(syswrite) is em(not) recommended, use tt(zpty -r) and tt(zpty -w) +unless you know exactly what you are doing. ) item(tt(zpty) tt(-d) [ var(name) ... ])( The second form, with the tt(-d) option, is used to delete commands diff --git a/Src/Modules/zpty.c b/Src/Modules/zpty.c index 7b6130c..12e42b5 100644 --- a/Src/Modules/zpty.c +++ b/Src/Modules/zpty.c @@ -463,6 +463,8 @@ newptycmd(char *nam, char *pname, char **args, int echo, int nblock) #endif errno == EINTR)); + setiparam("REPLY", master); + return 0; } ^ permalink raw reply [flat|nested] 41+ messages in thread
* Re: Running commands in a zpty worker 2015-08-11 4:06 ` Running commands in a zpty worker Bart Schaefer @ 2015-08-11 13:14 ` Mathias Fredriksson 2015-08-11 14:35 ` Mathias Fredriksson 2015-08-11 14:37 ` Bart Schaefer 0 siblings, 2 replies; 41+ messages in thread From: Mathias Fredriksson @ 2015-08-11 13:14 UTC (permalink / raw) To: zsh-workers On Tue, Aug 11, 2015 at 7:06 AM, Bart Schaefer wrote: > > Incidentally you might try using ZLE handler functions for this instead > of signals. You'd need a FIFO for the zpty command to write to and the > ZLE handler to listen on. Oh, that is really cool! Thanks for the patch, it works great. > Just be careful to remove the handler before the slave side of the pty > is closed (e.g., worker exits) or you may end up with a runaway handler. Any tips on how I should go about doing this, can it be done with zle -D? ^ permalink raw reply [flat|nested] 41+ messages in thread
* Re: Running commands in a zpty worker 2015-08-11 13:14 ` Mathias Fredriksson @ 2015-08-11 14:35 ` Mathias Fredriksson 2015-08-11 14:37 ` Bart Schaefer 1 sibling, 0 replies; 41+ messages in thread From: Mathias Fredriksson @ 2015-08-11 14:35 UTC (permalink / raw) To: zsh-workers On Tue, Aug 11, 2015 at 4:14 PM, Mathias Fredriksson wrote: > > Any tips on how I should go about doing this, can it be done with zle -D? Ok, so a closer look at the documentation revealed that I can just do this with zle -F $REPLY. Since not passing a handler removes any that are present. Thanks again, it's precisely what I originally was looking for. ^ permalink raw reply [flat|nested] 41+ messages in thread
* Re: Running commands in a zpty worker 2015-08-11 13:14 ` Mathias Fredriksson 2015-08-11 14:35 ` Mathias Fredriksson @ 2015-08-11 14:37 ` Bart Schaefer 1 sibling, 0 replies; 41+ messages in thread From: Bart Schaefer @ 2015-08-11 14:37 UTC (permalink / raw) To: zsh-workers On Aug 11, 4:14pm, Mathias Fredriksson wrote: } } > Just be careful to remove the handler before the slave side of the pty } > is closed (e.g., worker exits) or you may end up with a runaway handler. } } Any tips on how I should go about doing this, can it be done with zle -D? The doc: If no HANDLER is given, but an FD is present, any handler for that FD is removed. If there is none, an error message is printed and status 1 is returned. You can even do this from inside the handler function itself with zle -F $1 assuming that the handler has detected that the FD is no longer useful. ^ permalink raw reply [flat|nested] 41+ messages in thread
end of thread, other threads:[~2015-08-11 15:23 UTC | newest] Thread overview: 41+ messages (download: mbox.gz / follow: Atom feed) -- links below jump to the message on this page -- 2015-08-03 11:25 Deadlock when receiving kill-signal from child process Mathias Fredriksson 2015-08-03 15:52 ` Bart Schaefer 2015-08-03 20:36 ` Mathias Fredriksson 2015-08-03 20:58 ` Bart Schaefer 2015-08-04 21:52 ` Mathias Fredriksson 2015-08-05 0:05 ` Mathias Fredriksson 2015-08-05 6:53 ` Bart Schaefer 2015-08-05 10:37 ` Mathias Fredriksson 2015-08-05 15:52 ` Bart Schaefer 2015-08-05 16:05 ` Mathias Fredriksson 2015-08-05 18:52 ` Bart Schaefer 2015-08-05 19:11 ` Mathias Fredriksson 2015-08-05 20:20 ` Bart Schaefer 2015-08-05 21:49 ` Mathias Fredriksson 2015-08-06 5:06 ` Bart Schaefer 2015-08-06 8:24 ` Mathias Fredriksson 2015-08-06 15:54 ` Bart Schaefer 2015-08-07 0:45 ` Mathias Fredriksson 2015-08-07 5:39 ` Bart Schaefer 2015-08-09 13:53 ` Mathias Fredriksson 2015-08-09 23:42 ` Bart Schaefer 2015-08-10 0:02 ` Mikael Magnusson 2015-08-10 0:16 ` Mathias Fredriksson 2015-08-10 1:47 ` Bart Schaefer 2015-08-10 2:02 ` Mikael Magnusson 2015-08-10 15:59 ` Bart Schaefer 2015-08-10 17:30 ` Mathias Fredriksson 2015-08-10 0:36 ` Bart Schaefer 2015-08-10 0:29 ` Bart Schaefer 2015-08-10 19:34 ` Bart Schaefer 2015-08-10 21:17 ` Mathias Fredriksson 2015-08-10 22:53 ` Mathias Fredriksson 2015-08-11 0:53 ` Bart Schaefer 2015-08-11 12:17 ` Mathias Fredriksson 2015-08-11 14:38 ` Mathias Fredriksson 2015-08-11 15:07 ` Bart Schaefer 2015-08-11 15:22 ` Mathias Fredriksson 2015-08-11 4:06 ` Running commands in a zpty worker Bart Schaefer 2015-08-11 13:14 ` Mathias Fredriksson 2015-08-11 14:35 ` Mathias Fredriksson 2015-08-11 14:37 ` Bart Schaefer
Code repositories for project(s) associated with this public inbox https://git.vuxu.org/mirror/zsh/ This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox; as well as URLs for NNTP newsgroup(s).