Crash with nathelper

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

Crash with nathelper

John Kiniston
I've just started playing with TLS and turned on nathelper and I'm seeing crashes.

What information do I need to collect for a bug report and to hopefully diagnose this issue?

Nov 20 16:32:35 sip2 /usr/sbin/opensips[867]: ERROR:nathelper:nh_timer: sip msg_send failed
Nov 20 16:32:35 sip2 /usr/sbin/opensips[860]: CRITICAL:core:sig_usr: segfault in process pid: 860, id: 15
Nov 20 16:32:35 sip2 kernel: opensips[860]: segfault at 7feaffffffff ip 00007fead73a0324 sp 00007ffd39239110 error 4 in nathelper.so[7fead739b000+12000]
Nov 20 16:32:35 sip2 abrt-hook-ccpp: Can't open 'core.860' at '/': Permission denied
Nov 20 16:32:35 sip2 abrt-hook-ccpp: Process 860 (opensips) of user 996 killed by SIGSEGV - dumping core
Nov 20 16:32:35 sip2 /usr/sbin/opensips[868]: CRITICAL:core:handle_tcp_worker: dead tcp worker 1 (EOF received), pid 860
Nov 20 16:32:35 sip2 /usr/sbin/opensips[868]: CRITICAL:core:handle_worker: dead child 15 (EOF received), pid 860
Nov 20 16:32:35 sip2 /usr/sbin/opensips[840]: INFO:core:handle_sigs: child process 860 exited by a signal 11
Nov 20 16:32:35 sip2 /usr/sbin/opensips[840]: INFO:core:handle_sigs: core was generated
Nov 20 16:32:35 sip2 /usr/sbin/opensips[840]: INFO:core:handle_sigs: terminating due to SIGCHLD
Nov 20 16:32:35 sip2 /usr/sbin/opensips[846]: INFO:core:sig_usr: signal 15 received
Nov 20 16:32:35 sip2 /usr/sbin/opensips[847]: INFO:core:sig_usr: signal 15 received
Nov 20 16:32:35 sip2 /usr/sbin/opensips[848]: INFO:core:sig_usr: signal 15 received
Nov 20 16:32:35 sip2 /usr/sbin/opensips[849]: INFO:core:sig_usr: signal 15 received
Nov 20 16:32:35 sip2 /usr/sbin/opensips[850]: INFO:core:sig_usr: signal 15 received
Nov 20 16:32:35 sip2 /usr/sbin/opensips[840]: INFO:core:shutdown_opensips: process 1(846) [HTTPD 192.168.84.176:8888] terminated, still waiting for 21 more
Nov 20 16:32:35 sip2 /usr/sbin/opensips[840]: INFO:core:shutdown_opensips: process 2(847) [event-route handler] terminated, still waiting for 20 more
Nov 20 16:32:35 sip2 /usr/sbin/opensips[840]: INFO:core:shutdown_opensips: process 3(848) [MI FIFO] terminated, still waiting for 19 more
Nov 20 16:32:35 sip2 /usr/sbin/opensips[840]: INFO:core:shutdown_opensips: process 4(849) [time_keeper] terminated, still waiting for 18 more
Nov 20 16:32:35 sip2 /usr/sbin/opensips[840]: INFO:core:shutdown_opensips: process 5(850) [timer] terminated, still waiting for 17 more
Nov 20 16:32:35 sip2 /usr/sbin/opensips[840]: INFO:core:shutdown_opensips: process 6(851) [SIP receiver udp:67.212.192.99:5060 ] terminated, still waiting for 16 more
Nov 20 16:32:35 sip2 /usr/sbin/opensips[840]: INFO:core:shutdown_opensips: process 7(852) [SIP receiver udp:67.212.192.99:5060 ] terminated, still waiting for 15 more
Nov 20 16:32:35 sip2 /usr/sbin/opensips[840]: INFO:core:shutdown_opensips: process 8(853) [SIP receiver udp:67.212.192.99:5060 ] terminated, still waiting for 14 more
Nov 20 16:32:35 sip2 /usr/sbin/opensips[840]: INFO:core:shutdown_opensips: process 9(854) [SIP receiver udp:67.212.192.99:5060 ] terminated, still waiting for 13 more
Nov 20 16:32:35 sip2 /usr/sbin/opensips[840]: INFO:core:shutdown_opensips: process 10(855) [SIP receiver udp:67.212.192.99:3478 ] terminated, still waiting for 12 more
Nov 20 16:32:35 sip2 /usr/sbin/opensips[840]: INFO:core:shutdown_opensips: process 11(856) [SIP receiver udp:67.212.192.99:3478 ] terminated, still waiting for 11 more
Nov 20 16:32:35 sip2 /usr/sbin/opensips[840]: INFO:core:shutdown_opensips: process 12(857) [SIP receiver udp:67.212.192.99:3478 ] terminated, still waiting for 10 more
Nov 20 16:32:35 sip2 /usr/sbin/opensips[840]: INFO:core:shutdown_opensips: process 13(858) [SIP receiver udp:67.212.192.99:3478 ] terminated, still waiting for 9 more
Nov 20 16:32:35 sip2 /usr/sbin/opensips[840]: INFO:core:shutdown_opensips: process 14(859) [TCP receiver] terminated, still waiting for 8 more
Nov 20 16:32:35 sip2 /usr/sbin/opensips[840]: INFO:core:shutdown_opensips: process 16(861) [TCP receiver] terminated, still waiting for 7 more
Nov 20 16:32:35 sip2 /usr/sbin/opensips[840]: INFO:core:shutdown_opensips: process 17(862) [TCP receiver] terminated, still waiting for 6 more
Nov 20 16:32:35 sip2 /usr/sbin/opensips[840]: INFO:core:shutdown_opensips: process 18(863) [TCP receiver] terminated, still waiting for 5 more
Nov 20 16:32:35 sip2 /usr/sbin/opensips[840]: INFO:core:shutdown_opensips: process 19(864) [TCP receiver] terminated, still waiting for 4 more
Nov 20 16:32:35 sip2 /usr/sbin/opensips[840]: INFO:core:shutdown_opensips: process 20(865) [TCP receiver] terminated, still waiting for 3 more
Nov 20 16:32:35 sip2 /usr/sbin/opensips[840]: INFO:core:shutdown_opensips: process 21(866) [TCP receiver] terminated, still waiting for 2 more
Nov 20 16:32:35 sip2 /usr/sbin/opensips[840]: INFO:core:shutdown_opensips: process 22(867) [Timer handler] terminated, still waiting for 1 more
Nov 20 16:32:35 sip2 /usr/sbin/opensips[840]: INFO:core:shutdown_opensips: process 23(868) [TCP main] terminated, still waiting for 0 more
Nov 20 16:32:35 sip2 /usr/sbin/opensips[840]: INFO:core:cleanup: cleanup
Nov 20 16:32:35 sip2 /usr/sbin/opensips[840]: NOTICE:event_route:destroy: destroy module ...
Nov 20 16:32:35 sip2 /usr/sbin/opensips[840]: INFO:pike:pike_exit: destroying...
Nov 20 16:32:36 sip2 systemd: opensips.service: main process exited, code=exited, status=139/n/a
Nov 20 16:32:36 sip2 systemd: opensips.service: control process exited, code=exited status=1
Nov 20 16:32:36 sip2 pkill: pkill: pidfile not valid
Nov 20 16:32:36 sip2 pkill: Try `pkill --help' for more information.
Nov 20 16:32:36 sip2 systemd: Unit opensips.service entered failed state.
Nov 20 16:32:36 sip2 systemd: opensips.service failed.
Nov 20 16:32:36 sip2 abrt-server: Duplicate: core backtrace
Nov 20 16:32:36 sip2 abrt-server: DUP_OF_DIR: /var/spool/abrt/ccpp-2018-11-20-14:29:38-26330
Nov 20 16:32:36 sip2 abrt-server: Deleting problem directory ccpp-2018-11-20-16:32:35-860 (dup of ccpp-2018-11-20-14:29:38-26330)
Nov 20 16:32:36 sip2 systemd: opensips.service holdoff time over, scheduling restart.
Nov 20 16:32:36 sip2 dbus[678]: [system] Activating service name='org.freedesktop.problems' (using servicehelper)
Nov 20 16:32:36 sip2 systemd: Starting OpenSIPS is a very fast and flexible SIP (RFC3261) server...
Nov 20 16:32:36 sip2 dbus[678]: [system] Activated service 'org.freedesktop.problems' failed: Failed to execute program /lib64/dbus-1/dbus-daemon-launch-helper: Success
Nov 20 16:32:36 sip2 dbus[678]: [system] Activating service name='org.freedesktop.problems' (using servicehelper)
Nov 20 16:32:36 sip2 dbus[678]: [system] Activated service 'org.freedesktop.problems' failed: Failed to execute program /lib64/dbus-1/dbus-daemon-launch-hel

--
A human being should be able to change a diaper, plan an invasion, butcher a hog, conn a ship, design a building, write a sonnet, balance accounts, build a wall, set a bone, comfort the dying, take orders, give orders, cooperate, act alone, solve equations, analyze a new problem, pitch manure, program a computer, cook a tasty meal, fight efficiently, die gallantly. Specialization is for insects.
---Heinlein

_______________________________________________
Users mailing list
[hidden email]
http://lists.opensips.org/cgi-bin/mailman/listinfo/users
Reply | Threaded
Open this post in threaded view
|

Re: Crash with nathelper

Răzvan Crainea-2
Hi, John!

Please send us the output of `opensips -V`.

Best regards,
Răzvan

On 11/21/18 1:34 AM, John Kiniston wrote:

> I've just started playing with TLS and turned on nathelper and I'm
> seeing crashes.
>
> What information do I need to collect for a bug report and to hopefully
> diagnose this issue?
>
> Nov 20 16:32:35 sip2 /usr/sbin/opensips[867]: ERROR:nathelper:nh_timer:
> sip msg_send failed
> Nov 20 16:32:35 sip2 /usr/sbin/opensips[860]: CRITICAL:core:sig_usr:
> segfault in process pid: 860, id: 15
> Nov 20 16:32:35 sip2 kernel: opensips[860]: segfault at 7feaffffffff ip
> 00007fead73a0324 sp 00007ffd39239110 error 4 in
> nathelper.so[7fead739b000+12000]
> Nov 20 16:32:35 sip2 abrt-hook-ccpp: Can't open 'core.860' at '/':
> Permission denied
> Nov 20 16:32:35 sip2 abrt-hook-ccpp: Process 860 (opensips) of user 996
> killed by SIGSEGV - dumping core
> Nov 20 16:32:35 sip2 /usr/sbin/opensips[868]:
> CRITICAL:core:handle_tcp_worker: dead tcp worker 1 (EOF received), pid 860
> Nov 20 16:32:35 sip2 /usr/sbin/opensips[868]:
> CRITICAL:core:handle_worker: dead child 15 (EOF received), pid 860
> Nov 20 16:32:35 sip2 /usr/sbin/opensips[840]: INFO:core:handle_sigs:
> child process 860 exited by a signal 11
> Nov 20 16:32:35 sip2 /usr/sbin/opensips[840]: INFO:core:handle_sigs:
> core was generated
> Nov 20 16:32:35 sip2 /usr/sbin/opensips[840]: INFO:core:handle_sigs:
> terminating due to SIGCHLD
> Nov 20 16:32:35 sip2 /usr/sbin/opensips[846]: INFO:core:sig_usr: signal
> 15 received
> Nov 20 16:32:35 sip2 /usr/sbin/opensips[847]: INFO:core:sig_usr: signal
> 15 received
> Nov 20 16:32:35 sip2 /usr/sbin/opensips[848]: INFO:core:sig_usr: signal
> 15 received
> Nov 20 16:32:35 sip2 /usr/sbin/opensips[849]: INFO:core:sig_usr: signal
> 15 received
> Nov 20 16:32:35 sip2 /usr/sbin/opensips[850]: INFO:core:sig_usr: signal
> 15 received
> Nov 20 16:32:35 sip2 /usr/sbin/opensips[840]:
> INFO:core:shutdown_opensips: process 1(846) [HTTPD 192.168.84.176:8888
> <http://192.168.84.176:8888>] terminated, still waiting for 21 more
> Nov 20 16:32:35 sip2 /usr/sbin/opensips[840]:
> INFO:core:shutdown_opensips: process 2(847) [event-route handler]
> terminated, still waiting for 20 more
> Nov 20 16:32:35 sip2 /usr/sbin/opensips[840]:
> INFO:core:shutdown_opensips: process 3(848) [MI FIFO] terminated, still
> waiting for 19 more
> Nov 20 16:32:35 sip2 /usr/sbin/opensips[840]:
> INFO:core:shutdown_opensips: process 4(849) [time_keeper] terminated,
> still waiting for 18 more
> Nov 20 16:32:35 sip2 /usr/sbin/opensips[840]:
> INFO:core:shutdown_opensips: process 5(850) [timer] terminated, still
> waiting for 17 more
> Nov 20 16:32:35 sip2 /usr/sbin/opensips[840]:
> INFO:core:shutdown_opensips: process 6(851) [SIP receiver
> udp:67.212.192.99:5060 <http://67.212.192.99:5060> ] terminated, still
> waiting for 16 more
> Nov 20 16:32:35 sip2 /usr/sbin/opensips[840]:
> INFO:core:shutdown_opensips: process 7(852) [SIP receiver
> udp:67.212.192.99:5060 <http://67.212.192.99:5060> ] terminated, still
> waiting for 15 more
> Nov 20 16:32:35 sip2 /usr/sbin/opensips[840]:
> INFO:core:shutdown_opensips: process 8(853) [SIP receiver
> udp:67.212.192.99:5060 <http://67.212.192.99:5060> ] terminated, still
> waiting for 14 more
> Nov 20 16:32:35 sip2 /usr/sbin/opensips[840]:
> INFO:core:shutdown_opensips: process 9(854) [SIP receiver
> udp:67.212.192.99:5060 <http://67.212.192.99:5060> ] terminated, still
> waiting for 13 more
> Nov 20 16:32:35 sip2 /usr/sbin/opensips[840]:
> INFO:core:shutdown_opensips: process 10(855) [SIP receiver
> udp:67.212.192.99:3478 <http://67.212.192.99:3478> ] terminated, still
> waiting for 12 more
> Nov 20 16:32:35 sip2 /usr/sbin/opensips[840]:
> INFO:core:shutdown_opensips: process 11(856) [SIP receiver
> udp:67.212.192.99:3478 <http://67.212.192.99:3478> ] terminated, still
> waiting for 11 more
> Nov 20 16:32:35 sip2 /usr/sbin/opensips[840]:
> INFO:core:shutdown_opensips: process 12(857) [SIP receiver
> udp:67.212.192.99:3478 <http://67.212.192.99:3478> ] terminated, still
> waiting for 10 more
> Nov 20 16:32:35 sip2 /usr/sbin/opensips[840]:
> INFO:core:shutdown_opensips: process 13(858) [SIP receiver
> udp:67.212.192.99:3478 <http://67.212.192.99:3478> ] terminated, still
> waiting for 9 more
> Nov 20 16:32:35 sip2 /usr/sbin/opensips[840]:
> INFO:core:shutdown_opensips: process 14(859) [TCP receiver] terminated,
> still waiting for 8 more
> Nov 20 16:32:35 sip2 /usr/sbin/opensips[840]:
> INFO:core:shutdown_opensips: process 16(861) [TCP receiver] terminated,
> still waiting for 7 more
> Nov 20 16:32:35 sip2 /usr/sbin/opensips[840]:
> INFO:core:shutdown_opensips: process 17(862) [TCP receiver] terminated,
> still waiting for 6 more
> Nov 20 16:32:35 sip2 /usr/sbin/opensips[840]:
> INFO:core:shutdown_opensips: process 18(863) [TCP receiver] terminated,
> still waiting for 5 more
> Nov 20 16:32:35 sip2 /usr/sbin/opensips[840]:
> INFO:core:shutdown_opensips: process 19(864) [TCP receiver] terminated,
> still waiting for 4 more
> Nov 20 16:32:35 sip2 /usr/sbin/opensips[840]:
> INFO:core:shutdown_opensips: process 20(865) [TCP receiver] terminated,
> still waiting for 3 more
> Nov 20 16:32:35 sip2 /usr/sbin/opensips[840]:
> INFO:core:shutdown_opensips: process 21(866) [TCP receiver] terminated,
> still waiting for 2 more
> Nov 20 16:32:35 sip2 /usr/sbin/opensips[840]:
> INFO:core:shutdown_opensips: process 22(867) [Timer handler] terminated,
> still waiting for 1 more
> Nov 20 16:32:35 sip2 /usr/sbin/opensips[840]:
> INFO:core:shutdown_opensips: process 23(868) [TCP main] terminated,
> still waiting for 0 more
> Nov 20 16:32:35 sip2 /usr/sbin/opensips[840]: INFO:core:cleanup: cleanup
> Nov 20 16:32:35 sip2 /usr/sbin/opensips[840]:
> NOTICE:event_route:destroy: destroy module ...
> Nov 20 16:32:35 sip2 /usr/sbin/opensips[840]: INFO:pike:pike_exit:
> destroying...
> Nov 20 16:32:36 sip2 systemd: opensips.service: main process exited,
> code=exited, status=139/n/a
> Nov 20 16:32:36 sip2 systemd: opensips.service: control process exited,
> code=exited status=1
> Nov 20 16:32:36 sip2 pkill: pkill: pidfile not valid
> Nov 20 16:32:36 sip2 pkill: Try `pkill --help' for more information.
> Nov 20 16:32:36 sip2 systemd: Unit opensips.service entered failed state.
> Nov 20 16:32:36 sip2 systemd: opensips.service failed.
> Nov 20 16:32:36 sip2 abrt-server: Duplicate: core backtrace
> Nov 20 16:32:36 sip2 abrt-server: DUP_OF_DIR:
> /var/spool/abrt/ccpp-2018-11-20-14:29:38-26330
> Nov 20 16:32:36 sip2 abrt-server: Deleting problem directory
> ccpp-2018-11-20-16:32:35-860 (dup of ccpp-2018-11-20-14:29:38-26330)
> Nov 20 16:32:36 sip2 systemd: opensips.service holdoff time over,
> scheduling restart.
> Nov 20 16:32:36 sip2 dbus[678]: [system] Activating service
> name='org.freedesktop.problems' (using servicehelper)
> Nov 20 16:32:36 sip2 systemd: Starting OpenSIPS is a very fast and
> flexible SIP (RFC3261) server...
> Nov 20 16:32:36 sip2 dbus[678]: [system] Activated service
> 'org.freedesktop.problems' failed: Failed to execute program
> /lib64/dbus-1/dbus-daemon-launch-helper: Success
> Nov 20 16:32:36 sip2 dbus[678]: [system] Activating service
> name='org.freedesktop.problems' (using servicehelper)
> Nov 20 16:32:36 sip2 dbus[678]: [system] Activated service
> 'org.freedesktop.problems' failed: Failed to execute program
> /lib64/dbus-1/dbus-daemon-launch-hel
>
> --
> A human being should be able to change a diaper, plan an invasion,
> butcher a hog, conn a ship, design a building, write a sonnet, balance
> accounts, build a wall, set a bone, comfort the dying, take orders, give
> orders, cooperate, act alone, solve equations, analyze a new problem,
> pitch manure, program a computer, cook a tasty meal, fight efficiently,
> die gallantly. Specialization is for insects.
> ---Heinlein
>
> _______________________________________________
> Users mailing list
> [hidden email]
> http://lists.opensips.org/cgi-bin/mailman/listinfo/users
>

--
Răzvan Crainea
OpenSIPS Core Developer
   http://www.opensips-solutions.com

_______________________________________________
Users mailing list
[hidden email]
http://lists.opensips.org/cgi-bin/mailman/listinfo/users
Reply | Threaded
Open this post in threaded view
|

Re: Crash with nathelper

John Kiniston
version: opensips 2.4.3 (x86_64/linux)
flags: STATS: On, DISABLE_NAGLE, USE_MCAST, SHM_MMAP, PKG_MALLOC, F_MALLOC, FAST_LOCK-ADAPTIVE_WAIT
ADAPTIVE_WAIT_LOOPS=1024, MAX_RECV_BUFFER_SIZE 262144, MAX_LISTEN 16, MAX_URI_SIZE 1024, BUF_SIZE 65535
poll method support: poll, epoll, sigio_rt, select.
main.c compiled on 01:38:42 Nov  9 2018 with gcc 4.8.5


On Wed, Nov 21, 2018 at 2:19 AM Răzvan Crainea <[hidden email]> wrote:
Hi, John!

Please send us the output of `opensips -V`.

Best regards,
Răzvan

On 11/21/18 1:34 AM, John Kiniston wrote:
> I've just started playing with TLS and turned on nathelper and I'm
> seeing crashes.
>


_______________________________________________
Users mailing list
[hidden email]
http://lists.opensips.org/cgi-bin/mailman/listinfo/users
Reply | Threaded
Open this post in threaded view
|

Re: Crash with nathelper

Răzvan Crainea-2
Hi, John!

I see that you don't have permissions to write a corefile. Can you set
the working directory (-w parameter) to a path that is writeable, to get
a proper core file that we can examine further.

Best regards,
Răzvan

On 11/26/18 5:19 PM, John Kiniston wrote:

> version: opensips 2.4.3 (x86_64/linux)
> flags: STATS: On, DISABLE_NAGLE, USE_MCAST, SHM_MMAP, PKG_MALLOC,
> F_MALLOC, FAST_LOCK-ADAPTIVE_WAIT
> ADAPTIVE_WAIT_LOOPS=1024, MAX_RECV_BUFFER_SIZE 262144, MAX_LISTEN 16,
> MAX_URI_SIZE 1024, BUF_SIZE 65535
> poll method support: poll, epoll, sigio_rt, select.
> main.c compiled on 01:38:42 Nov  9 2018 with gcc 4.8.5
>
>
> On Wed, Nov 21, 2018 at 2:19 AM Răzvan Crainea <[hidden email]
> <mailto:[hidden email]>> wrote:
>
>     Hi, John!
>
>     Please send us the output of `opensips -V`.
>
>     Best regards,
>     Răzvan
>
>     On 11/21/18 1:34 AM, John Kiniston wrote:
>      > I've just started playing with TLS and turned on nathelper and I'm
>      > seeing crashes.
>      >
>
>
>
> _______________________________________________
> Users mailing list
> [hidden email]
> http://lists.opensips.org/cgi-bin/mailman/listinfo/users
>

--
Răzvan Crainea
OpenSIPS Core Developer
   http://www.opensips-solutions.com

_______________________________________________
Users mailing list
[hidden email]
http://lists.opensips.org/cgi-bin/mailman/listinfo/users