[dev.icinga.com #11639] Crash in IdoMysqlConnection::ExecuteMultipleQueries

[icinga-migration]

This issue has been migrated from Redmine: https://dev.icinga.com/issues/11639

Created by mzac on 2016-04-20 17:06:55 +00:00

Assignee: gbeutner
Status: Resolved (closed on 2016-04-21 07:20:05 +00:00)
Target Version: 2.4.7
Last Update: 2016-04-21 13:08:37 +00:00 (in Redmine)

Icinga Version: 2.4.5
Backport?: Not yet backported
Include in Changelog: 1

---

Getting a crash on Redhat 6 running Icinga2 2.4.5

Hopefully I got all the good info here:

Program received signal SIGSEGV, Segmentation fault.
[Switching to Thread 0x7ffff4b56700 (LWP 32000)]
0x00007ffff5450c36 in icinga::IdoMysqlConnection::ExecuteMultipleQueries(std::vector > const&) () from /usr/lib64/icinga2/libdb_ido_mysql.so
Missing separate debuginfos, use: debuginfo-install icinga2-bin-2.4.5-1.el6.x86_64
(gdb) generate-core-file
Saved corefile core.30508
(gdb) bt

#0  0x00007ffff5450c36 in icinga::IdoMysqlConnection::ExecuteMultipleQueries(std::vector > const&) () from /usr/lib64/icinga2/libdb_ido_mysql.so
#1  0x00007ffff51e020b in boost::signals2::detail::signal_impl > const&), boost::signals2::optional_last_value, int, std::less, boost::function > const&)>, boost::function > const&)>, boost::signals2::mutex>::operator()(std::vector > const&) ()

from /usr/lib64/icinga2/libdb_ido.so

#2  0x00007ffff51ab4d2 in icinga::DbEvents::AddNotificationHistory(boost::intrusive_ptr const&, boost::intrusive_ptr const&, std::set, std::less >, std::allocator > > const&, icinga::NotificationType, boost::intrusive_ptr const&, icinga::String const&, icinga::String const&) () from /usr/lib64/icinga2/libdb_ido.so
#3  0x00007ffff6549a12 in boost::signals2::detail::signal_impl const&, boost::intrusive_ptr const&, std::set, std::less >, std::allocator > > const&, icinga::NotificationType const&, boost::intrusive_ptr const&, icinga::String const&, icinga::String const&), boost::signals2::optional_last_value, int, std::less, boost::function const&, boost::intrusive_ptr const&, std::set, std::less >, std::allocator > > const&, icinga::NotificationType const&, boost::intrusive_ptr const&, icinga::String const&, icinga::String const&)>, boost::function const&, boost::intrusive_ptr const&, std::set, std::less >, std::allocator > > const&, icinga::NotificationType const&, boost::intrusive_ptr const&, icinga::String const&, icinga::String const&)>, boost::signals2::mutex>::operator()(boost::intrusive_ptr const&, boost::intrusive_ptr const&, std::set, std::less >, std::allocator > > const&, icinga::NotificationType const&, boost::intrusive_ptr const&, icinga::String const&, icinga::String const&) ()

from /usr/lib64/icinga2/libicinga.so

#4  0x00007ffff64ca2fe in icinga::Notification::BeginExecuteNotification(icinga::NotificationType, boost::intrusive_ptr const&, bool, icinga::String const&, icinga::String const&) () from /usr/lib64/icinga2/libicinga.so
#5  0x00007ffff4caac14 in icinga::NotificationComponent::NotificationTimerHandler() () from /usr/lib64/icinga2/libnotification.so
#6  0x00007ffff7d957fb in boost::signals2::detail::signal_impl const&), boost::signals2::optional_last_value, int, std::less, boost::function const&)>, boost::function const&)>, boost::signals2::mutex>::operator()(boost::intrusive_ptr const&) () from /usr/lib64/icinga2/libbase.so
#7  0x00007ffff7d44c14 in icinga::Timer::Call() () from /usr/lib64/icinga2/libbase.so
#8  0x00007ffff7d41afc in icinga::ThreadPool::WorkerThread::ThreadProc(icinga::ThreadPool::Queue&) () from /usr/lib64/icinga2/libbase.so
#9  0x000000388ae0c5c3 in boost::(anonymous namespace)::thread_proxy (param=)

at libs/thread/src/pthread/thread.cpp:165

#10 0x0000003885207aa1 in start_thread () from /lib64/libpthread.so.0
#11 0x0000003884ee893d in clone () from /lib64/libc.so.6

(gdb) thread apply all bt full

Thread 42 (Thread 0x7ffff476c700 (LWP 517)):

#0  0x0000003884ef809e in __lll_lock_wait_private () from /lib64/libc.so.6

No symbol table info available.

#1  0x0000003884e7ce9f in _L_lock_4464 () from /lib64/libc.so.6

No symbol table info available.

#2  0x0000003884e7810c in arena_get2 () from /lib64/libc.so.6

No symbol table info available.

#3  0x0000003884e7ab0e in malloc () from /lib64/libc.so.6

No symbol table info available.

#4  0x000000388ae11b0a in boost::detail::get_once_per_thread_epoch () at libs/thread/src/pthread/once.cpp:65

data =

#5  0x000000388ae0e248 in boost::call_once (flag=...,

f=0x388ae0bce0 <boost::detail::(anonymous namespace)::create_current_thread_tls_key()>) at boost/thread/pthread/once.hpp:84
uninitialized_flag = 0
being_initialized = 1
epoch = 18446744073709551614
this_thread_epoch =

#6  0x000000388ae0bd17 in boost::detail::set_current_thread_data (new_data=0x7fffd40026a0) at libs/thread/src/pthread/thread.cpp:147

No locals.

#7  0x000000388ae0c5b8 in boost::(anonymous namespace)::thread_proxy (param=)

at libs/thread/src/pthread/thread.cpp:160
thread_info = {px = 0x7fffd40026a0, pn = {pi_ = 0x7fffd4001d20}}
lock =

#8  0x0000003885207aa1 in start_thread () from /lib64/libpthread.so.0

No symbol table info available.

#9  0x0000003884ee893d in clone () from /lib64/libc.so.6

No symbol table info available.

Thread 41 (Thread 0x7ffff490d700 (LWP 515)):

#0  0x000000388520e334 in __lll_lock_wait () from /lib64/libpthread.so.0

No symbol table info available.

#1  0x00000038852095d8 in _L_lock_854 () from /lib64/libpthread.so.0

No symbol table info available.

#2  0x00000038852094a7 in pthread_mutex_lock () from /lib64/libpthread.so.0

No symbol table info available.

#3  0x00007ffff7d5c758 in boost::unique_lock::lock() () from /usr/lib64/icinga2/libbase.so

No symbol table info available.

#4  0x00007ffff7d1a1d0 in icinga::WorkQueue::Enqueue(boost::function const&, icinga::WorkQueuePriority, bool) ()

from /usr/lib64/icinga2/libbase.so
No symbol table info available.

#5  0x00007ffff7391500 in icinga::ApiListener::RelayMessage(boost::intrusive_ptr const&, boost::intrusive_ptr const&, boost::intrusive_ptr const&, bool) () from /usr/lib64/icinga2/libremote.so

No symbol table info available.

#6  0x00007ffff64630d9 in icinga::ClusterEvents::NextCheckChangedHandler(boost::intrusive_ptr const&, boost::intrusive_ptr const&) () from /usr/lib64/icinga2/libicinga.so

--Type to continue, or q to quit--
No symbol table info available.

#7  0x00007ffff64f64c4 in boost::detail::function::void_function_invoker2 const&, boost::intrusive_ptr const&), void, boost::intrusive_ptr const&, icinga::Value const&>::invoke(boost::detail::function::function_buffer&, boost::intrusive_ptr const&, icinga::Value const&) ()

from /usr/lib64/icinga2/libicinga.so
No symbol table info available.

#8  0x00007ffff654395a in boost::signals2::detail::signal_impl const&, icinga::Value const&), boost::signals2::optional_last_value, int, std::less, boost::function const&, icinga::Value const&)>, boost::function const&, icinga::Value const&)>, boost::signals2::mutex>::operator()(boost::intrusive_ptr const&, icinga::Value const&) ()

from /usr/lib64/icinga2/libicinga.so
No symbol table info available.

#9  0x00007ffff64bb5cf in icinga::ObjectImpl::NotifyNextCheck(icinga::Value const&) ()

from /usr/lib64/icinga2/libicinga.so
No symbol table info available.

#10 0x00007ffff64765d4 in icinga::Checkable::UpdateNextCheck(boost::intrusive_ptr const&) ()

from /usr/lib64/icinga2/libicinga.so
No symbol table info available.

#11 0x00007ffff64d12cf in icinga::Checkable::ExecuteCheck() () from /usr/lib64/icinga2/libicinga.so

No symbol table info available.

#12 0x00007ffff5c34a3f in icinga::CheckerComponent::ExecuteCheckHelper(boost::intrusive_ptr const&) ()

from /usr/lib64/icinga2/libchecker.so
No symbol table info available.

#13 0x00007ffff7d41afc in icinga::ThreadPool::WorkerThread::ThreadProc(icinga::ThreadPool::Queue&) () from /usr/lib64/icinga2/libbase.so

No symbol table info available.

#14 0x000000388ae0c5c3 in boost::(anonymous namespace)::thread_proxy (param=)

at libs/thread/src/pthread/thread.cpp:165
thread_info = {px = 0x7fffd4002250, pn = {pi_ = 0x7fffd4001cc0}}
lock =

#15 0x0000003885207aa1 in start_thread () from /lib64/libpthread.so.0

No symbol table info available.

#16 0x0000003884ee893d in clone () from /lib64/libc.so.6

No symbol table info available.

Thread 40 (Thread 0x7ffff494e700 (LWP 311)):

#0  0x000000388520e334 in __lll_lock_wait () from /lib64/libpthread.so.0

No symbol table info available.

#1  0x00000038852095d8 in _L_lock_854 () from /lib64/libpthread.so.0

No symbol table info available.

#2  0x00000038852094a7 in pthread_mutex_lock () from /lib64/libpthread.so.0

No symbol table info available.

#3  0x00007ffff7d5c758 in boost::unique_lock::lock() () from /usr/lib64/icinga2/libbase.so

No symbol table info available.

#4  0x00007ffff7d1a1d0 in icinga::WorkQueue::Enqueue(boost::function const&, icinga::WorkQueuePriority, bool) ()

from /usr/lib64/icinga2/libbase.so
No symbol table info available.
--Type to continue, or q to quit--

#5  0x00007ffff7391500 in icinga::ApiListener::RelayMessage(boost::intrusive_ptr const&, boost::intrusive_ptr const&, boost::intrusive_ptr const&, bool) () from /usr/lib64/icinga2/libremote.so

No symbol table info available.

#6  0x00007ffff64630d9 in icinga::ClusterEvents::NextCheckChangedHandler(boost::intrusive_ptr const&, boost::intrusive_ptr const&) () from /usr/lib64/icinga2/libicinga.so

No symbol table info available.

#7  0x00007ffff64f64c4 in boost::detail::function::void_function_invoker2 const&, boost::intrusive_ptr const&), void, boost::intrusive_ptr const&, icinga::Value const&>::invoke(boost::detail::function::function_buffer&, boost::intrusive_ptr const&, icinga::Value const&) ()

from /usr/lib64/icinga2/libicinga.so
No symbol table info available.

#8  0x00007ffff654395a in boost::signals2::detail::signal_impl const&, icinga::Value const&), boost::signals2::optional_last_value, int, std::less, boost::function const&, icinga::Value const&)>, boost::function const&, icinga::Value const&)>, boost::signals2::mutex>::operator()(boost::intrusive_ptr const&, icinga::Value const&) ()

from /usr/lib64/icinga2/libicinga.so
No symbol table info available.

#9  0x00007ffff64bb5cf in icinga::ObjectImpl::NotifyNextCheck(icinga::Value const&) ()

from /usr/lib64/icinga2/libicinga.so
No symbol table info available.

#10 0x00007ffff64765d4 in icinga::Checkable::UpdateNextCheck(boost::intrusive_ptr const&) ()

from /usr/lib64/icinga2/libicinga.so
No symbol table info available.

#11 0x00007ffff64d12cf in icinga::Checkable::ExecuteCheck() () from /usr/lib64/icinga2/libicinga.so

No symbol table info available.

#12 0x00007ffff5c34a3f in icinga::CheckerComponent::ExecuteCheckHelper(boost::intrusive_ptr const&) ()

from /usr/lib64/icinga2/libchecker.so
No symbol table info available.

#13 0x00007ffff7d41afc in icinga::ThreadPool::WorkerThread::ThreadProc(icinga::ThreadPool::Queue&) () from /usr/lib64/icinga2/libbase.so

No symbol table info available.

#14 0x000000388ae0c5c3 in boost::(anonymous namespace)::thread_proxy (param=)

at libs/thread/src/pthread/thread.cpp:165
thread_info = {px = 0x7fffd4001e00, pn = {pi_ = 0x7fffd4000cc0}}
lock =

#15 0x0000003885207aa1 in start_thread () from /lib64/libpthread.so.0

No symbol table info available.

#16 0x0000003884ee893d in clone () from /lib64/libc.so.6

No symbol table info available.

Thread 39 (Thread 0x7ffff4bd8700 (LWP 310)):

#0  0x0000003884ef80cf in __lll_unlock_wake_private () from /lib64/libc.so.6

No symbol table info available.

#1  0x0000003884e7cc40 in _L_unlock_127 () from /lib64/libc.so.6

No symbol table info available.

#2  0x0000003884e75974 in ptmalloc_unlock_all () from /lib64/libc.so.6

No symbol table info available.
--Type to continue, or q to quit--

#3  0x0000003884eacce6 in fork () from /lib64/libc.so.6

No symbol table info available.

#4  0x00007ffff7d2adb4 in icinga::Process::Run(boost::function const&) ()

from /usr/lib64/icinga2/libbase.so
No symbol table info available.

#5  0x00007ffff649944f in icinga::PluginUtility::ExecuteCommand(boost::intrusive_ptr const&, boost::intrusive_ptr const&, boost::intrusive_ptr const&, std::vector >, std::allocator > > > const&, boost::intrusive_ptr const&, bool, boost::function const&) ()

from /usr/lib64/icinga2/libicinga.so
No symbol table info available.

#6  0x00007ffff5e681a2 in icinga::PluginCheckTask::ScriptFunc(boost::intrusive_ptr const&, boost::intrusive_ptr const&, boost::intrusive_ptr const&, bool) () from /usr/lib64/icinga2/libmethods.so

No symbol table info available.

#7  0x00007ffff5e72a06 in icinga::Value icinga::FunctionWrapperV const&, boost::intrusive_ptr const&, boost::intrusive_ptr const&, bool>(void (*)(boost::intrusive_ptr const&, boost::intrusive_ptr const&, boost::intrusive_ptr const&, bool), std::vector > const&) () from /usr/lib64/icinga2/libmethods.so

No symbol table info available.

#8  0x00007ffff5e6f2dd in boost::detail::function::function_obj_invoker1 const&, boost::intrusive_ptr const&, boost::intrusive_ptr const&, bool), std::vector > const&), boost::_bi::list2 const&, boost::intrusive_ptr const&, boost::intrusive_ptr const&, bool)>, boost::arg<1> > >, icinga::Value, std::vector > const&>::invoke(boost::detail::function::function_buffer&, std::vector > const&) () from /usr/lib64/icinga2/libmethods.so

No symbol table info available.

#9  0x00007ffff7cf69ad in icinga::Function::Invoke(std::vector > const&) ()

from /usr/lib64/icinga2/libbase.so
No symbol table info available.

#10 0x00007ffff647983f in icinga::CheckCommand::Execute(boost::intrusive_ptr const&, boost::intrusive_ptr const&, boost::intrusive_ptr const&, bool) () from /usr/lib64/icinga2/libicinga.so

No symbol table info available.

#11 0x00007ffff64d1c7e in icinga::Checkable::ExecuteCheck() () from /usr/lib64/icinga2/libicinga.so

No symbol table info available.

#12 0x00007ffff5c34a3f in icinga::CheckerComponent::ExecuteCheckHelper(boost::intrusive_ptr const&) ()

from /usr/lib64/icinga2/libchecker.so
No symbol table info available.

#13 0x00007ffff7d41afc in icinga::ThreadPool::WorkerThread::ThreadProc(icinga::ThreadPool::Queue&) () from /usr/lib64/icinga2/libbase.so

No symbol table info available.

#14 0x000000388ae0c5c3 in boost::(anonymous namespace)::thread_proxy (param=)

at libs/thread/src/pthread/thread.cpp:165
thread_info = {px = 0x7fffd4001ab0, pn = {pi_ = 0x7fffd4001c90}}
lock =

#15 0x0000003885207aa1 in start_thread () from /lib64/libpthread.so.0

No symbol table info available.

#16 0x0000003884ee893d in clone () from /lib64/libc.so.6

--Type to continue, or q to quit--
No symbol table info available.

Thread 38 (Thread 0x7ffff4b97700 (LWP 32001)):

#0  0x000000388520e334 in __lll_lock_wait () from /lib64/libpthread.so.0

No symbol table info available.

#1  0x00000038852095d8 in _L_lock_854 () from /lib64/libpthread.so.0

No symbol table info available.

#2  0x00000038852094a7 in pthread_mutex_lock () from /lib64/libpthread.so.0

No symbol table info available.

#3  0x00007ffff7d5c758 in boost::unique_lock::lock() () from /usr/lib64/icinga2/libbase.so

No symbol table info available.

#4  0x00007ffff7d1a1d0 in icinga::WorkQueue::Enqueue(boost::function const&, icinga::WorkQueuePriority, bool) ()

from /usr/lib64/icinga2/libbase.so
No symbol table info available.

#5  0x00007ffff7391500 in icinga::ApiListener::RelayMessage(boost::intrusive_ptr const&, boost::intrusive_ptr const&, boost::intrusive_ptr const&, bool) () from /usr/lib64/icinga2/libremote.so

No symbol table info available.

#6  0x00007ffff64630d9 in icinga::ClusterEvents::NextCheckChangedHandler(boost::intrusive_ptr const&, boost::intrusive_ptr const&) () from /usr/lib64/icinga2/libicinga.so

No symbol table info available.

#7  0x00007ffff64f64c4 in boost::detail::function::void_function_invoker2 const&, boost::intrusive_ptr const&), void, boost::intrusive_ptr const&, icinga::Value const&>::invoke(boost::detail::function::function_buffer&, boost::intrusive_ptr const&, icinga::Value const&) ()

from /usr/lib64/icinga2/libicinga.so
No symbol table info available.

#8  0x00007ffff654395a in boost::signals2::detail::signal_impl const&, icinga::Value const&), boost::signals2::optional_last_value, int, std::less, boost::function const&, icinga::Value const&)>, boost::function const&, icinga::Value const&)>, boost::signals2::mutex>::operator()(boost::intrusive_ptr const&, icinga::Value const&) ()

from /usr/lib64/icinga2/libicinga.so
No symbol table info available.

#9  0x00007ffff64bb5cf in icinga::ObjectImpl::NotifyNextCheck(icinga::Value const&) ()

from /usr/lib64/icinga2/libicinga.so
No symbol table info available.

#10 0x00007ffff64765d4 in icinga::Checkable::UpdateNextCheck(boost::intrusive_ptr const&) ()

from /usr/lib64/icinga2/libicinga.so
No symbol table info available.

#11 0x00007ffff64d12cf in icinga::Checkable::ExecuteCheck() () from /usr/lib64/icinga2/libicinga.so

No symbol table info available.

#12 0x00007ffff5c34a3f in icinga::CheckerComponent::ExecuteCheckHelper(boost::intrusive_ptr const&) ()

from /usr/lib64/icinga2/libchecker.so
No symbol table info available.

#13 0x00007ffff7d41afc in icinga::ThreadPool::WorkerThread::ThreadProc(icinga::ThreadPool::Queue&) () from /usr/lib64/icinga2/libbase.so

No symbol table info available.

#14 0x000000388ae0c5c3 in boost::(anonymous namespace)::thread_proxy (param=)

at libs/thread/src/pthread/thread.cpp:165
--Type to continue, or q to quit--
thread_info = {px = 0x7fffd40018b0, pn = {pi_ = 0x7fffd4000d40}}
lock =

#15 0x0000003885207aa1 in start_thread () from /lib64/libpthread.so.0

No symbol table info available.

#16 0x0000003884ee893d in clone () from /lib64/libc.so.6

No symbol table info available.

Thread 37 (Thread 0x7ffff4b56700 (LWP 32000)):

#0  0x00007ffff5450c36 in icinga::IdoMysqlConnection::ExecuteMultipleQueries(std::vector > const&) () from /usr/lib64/icinga2/libdb_ido_mysql.so

No symbol table info available.

#1  0x00007ffff51e020b in boost::signals2::detail::signal_impl > const&), boost::signals2::optional_last_value, int, std::less, boost::function > const&)>, boost::function > const&)>, boost::signals2::mutex>::operator()(std::vector > const&) ()

from /usr/lib64/icinga2/libdb_ido.so
No symbol table info available.

#2  0x00007ffff51ab4d2 in icinga::DbEvents::AddNotificationHistory(boost::intrusive_ptr const&, boost::intrusive_ptr const&, std::set, std::less >, std::allocator > > const&, icinga::NotificationType, boost::intrusive_ptr const&, icinga::String const&, icinga::String const&) () from /usr/lib64/icinga2/libdb_ido.so

No symbol table info available.

#3  0x00007ffff6549a12 in boost::signals2::detail::signal_impl const&, boost::intrusive_ptr const&, std::set, std::less >, std::allocator > > const&, icinga::NotificationType const&, boost::intrusive_ptr const&, icinga::String const&, icinga::String const&), boost::signals2::optional_last_value, int, std::less, boost::function const&, boost::intrusive_ptr const&, std::set, std::less >, std::allocator > > const&, icinga::NotificationType const&, boost::intrusive_ptr const&, icinga::String const&, icinga::String const&)>, boost::function const&, boost::intrusive_ptr const&, std::set, std::less >, std::allocator > > const&, icinga::NotificationType const&, boost::intrusive_ptr const&, icinga::String const&, icinga::String const&)>, boost::signals2::mutex>::operator()(boost::intrusive_ptr const&, boost::intrusive_ptr const&, std::set, std::less >, std::allocator > > const&, icinga::NotificationType const&, boost::intrusive_ptr const&, icinga::String const&, icinga::String const&) ()

from /usr/lib64/icinga2/libicinga.so
No symbol table info available.

#4  0x00007ffff64ca2fe in icinga::Notification::BeginExecuteNotification(icinga::NotificationType, boost::intrusive_ptr const&, bool, icinga::String const&, icinga::String const&) () from /usr/lib64/icinga2/libicinga.so

No symbol table info available.

#5  0x00007ffff4caac14 in icinga::NotificationComponent::NotificationTimerHandler() () from /usr/lib64/icinga2/libnotification.so

No symbol table info available.

#6  0x00007ffff7d957fb in boost::signals2::detail::signal_impl const&), boost::signals2::optional_last_value, int, std::less, boost::function const&)>, boost::function const&)>, boost::signals2::mutex>::operator()(boost::intrusive_ptr const&) () from /usr/lib64/icinga2/libbase.so

--Type to continue, or q to quit--
No symbol table info available.

#7  0x00007ffff7d44c14 in icinga::Timer::Call() () from /usr/lib64/icinga2/libbase.so

No symbol table info available.

#8  0x00007ffff7d41afc in icinga::ThreadPool::WorkerThread::ThreadProc(icinga::ThreadPool::Queue&) () from /usr/lib64/icinga2/libbase.so

No symbol table info available.

#9  0x000000388ae0c5c3 in boost::(anonymous namespace)::thread_proxy (param=)

at libs/thread/src/pthread/thread.cpp:165
thread_info = {px = 0x7fffd40016d0, pn = {pi_ = 0x7fffd4000ce0}}
lock =

#10 0x0000003885207aa1 in start_thread () from /lib64/libpthread.so.0

No symbol table info available.

#11 0x0000003884ee893d in clone () from /lib64/libc.so.6

No symbol table info available.

Thread 36 (Thread 0x7ffff4b15700 (LWP 31696)):

#0  0x000000388520ba5e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0

No symbol table info available.

#1  0x00007ffff7d6812d in bool boost::condition_variable::timed_wait >(boost::unique_lock&, boost::date_time::subsecond_duration const&) ()

from /usr/lib64/icinga2/libbase.so
No symbol table info available.

#2  0x00007ffff7d34ef3 in icinga::Timer::TimerThreadProc() () from /usr/lib64/icinga2/libbase.so

No symbol table info available.

#3  0x000000388ae0c5c3 in boost::(anonymous namespace)::thread_proxy (param=)

at libs/thread/src/pthread/thread.cpp:165
thread_info = {px = 0x2fa25a0, pn = {pi_ = 0x344f290}}
lock =

#4  0x0000003885207aa1 in start_thread () from /lib64/libpthread.so.0

No symbol table info available.

#5  0x0000003884ee893d in clone () from /lib64/libc.so.6

No symbol table info available.

Thread 35 (Thread 0x7fffa3fff700 (LWP 30988)):

#0  0x0000003884edf113 in poll () from /lib64/libc.so.6

No symbol table info available.

#1  0x00007ffff7d26c2f in icinga::Process::IOThreadProc(int) () from /usr/lib64/icinga2/libbase.so

No symbol table info available.

#2  0x000000388ae0c5c3 in boost::(anonymous namespace)::thread_proxy (param=)

at libs/thread/src/pthread/thread.cpp:165
thread_info = {px = 0x7fffe8002730, pn = {pi_ = 0x7fffe8001570}}
lock =

#3  0x0000003885207aa1 in start_thread () from /lib64/libpthread.so.0

No symbol table info available.

#4  0x0000003884ee893d in clone () from /lib64/libc.so.6

No symbol table info available.

--Type to continue, or q to quit--
Thread 34 (Thread 0x7ffff498f700 (LWP 30987)):

#0  0x0000003884edf113 in poll () from /lib64/libc.so.6

No symbol table info available.

#1  0x00007ffff7d26c2f in icinga::Process::IOThreadProc(int) () from /usr/lib64/icinga2/libbase.so

No symbol table info available.

#2  0x000000388ae0c5c3 in boost::(anonymous namespace)::thread_proxy (param=)

at libs/thread/src/pthread/thread.cpp:165
thread_info = {px = 0x7fffe80022f0, pn = {pi_ = 0x7fffe8001940}}
lock =

#3  0x0000003885207aa1 in start_thread () from /lib64/libpthread.so.0

No symbol table info available.

#4  0x0000003884ee893d in clone () from /lib64/libc.so.6

No symbol table info available.

Thread 33 (Thread 0x7ffff49d0700 (LWP 30986)):

#0  0x0000003884edf113 in poll () from /lib64/libc.so.6

No symbol table info available.

#1  0x00007ffff7d26c2f in icinga::Process::IOThreadProc(int) () from /usr/lib64/icinga2/libbase.so

No symbol table info available.

#2  0x000000388ae0c5c3 in boost::(anonymous namespace)::thread_proxy (param=)

at libs/thread/src/pthread/thread.cpp:165
thread_info = {px = 0x7fffe8001eb0, pn = {pi_ = 0x7fffe8000c80}}
lock =

#3  0x0000003885207aa1 in start_thread () from /lib64/libpthread.so.0

No symbol table info available.

#4  0x0000003884ee893d in clone () from /lib64/libc.so.6

No symbol table info available.

Thread 32 (Thread 0x7ffff4a11700 (LWP 30985)):

#0  0x0000003884ef809e in __lll_lock_wait_private () from /lib64/libc.so.6

No symbol table info available.

#1  0x0000003884e7d664 in _L_lock_13309 () from /lib64/libc.so.6

No symbol table info available.

#2  0x0000003884e7c55f in malloc_atfork () from /lib64/libc.so.6

No symbol table info available.

#3  0x00000038882bd0bd in operator new(unsigned long) () from /usr/lib64/libstdc++.so.6

No symbol table info available.

#4  0x000000388829c3c9 in std::basic_string, std::allocator >::_Rep::_S_create(unsigned long, unsigned long, std::allocator const&) () from /usr/lib64/libstdc++.so.6

No symbol table info available.

#5  0x000000388829d19b in std::basic_string, std::allocator >::_Rep::_M_clone(std::allocator const&, unsigned long) () from /usr/lib64/libstdc++.so.6

No symbol table info available.

#6  0x000000388829d5ec in std::basic_string, std::allocator >::reserve(unsigned long) ()

from /usr/lib64/libstdc**.so.6
No symbol table info available.
--Type to continue, or q to quit--

#7  0x00000038882978f1 in std::basic_stringbuf, std::allocator >::overflow(int) ()

from /usr/lib64/libstdc**.so.6
No symbol table info available.

#8  0x000000388829bab5 in std::basic_streambuf >::xsputn(char const*, long) () from /usr/lib64/libstdc++.so.6

No symbol table info available.

#9  0x0000003888292d4d in std::basic_ostream >::write(char const*, long) () from /usr/lib64/libstdc++.so.6

No symbol table info available.

#10 0x00007ffff7d25ca4 in icinga::Process::DoEvents() () from /usr/lib64/icinga2/libbase.so

No symbol table info available.

#11 0x00007ffff7d26d91 in icinga::Process::IOThreadProc(int) () from /usr/lib64/icinga2/libbase.so

No symbol table info available.

#12 0x000000388ae0c5c3 in boost::(anonymous namespace)::thread_proxy (param=)

at libs/thread/src/pthread/thread.cpp:165
thread_info = {px = 0x7fffe8001650, pn = {pi_ = 0x7fffe8000ca0}}
lock =

#13 0x0000003885207aa1 in start_thread () from /lib64/libpthread.so.0

No symbol table info available.

#14 0x0000003884ee893d in clone () from /lib64/libc.so.6

No symbol table info available.

Thread 31 (Thread 0x7ffff4a52700 (LWP 30980)):

#0  0x000000388520e334 in __lll_lock_wait () from /lib64/libpthread.so.0

No symbol table info available.

#1  0x00000038852095d8 in _L_lock_854 () from /lib64/libpthread.so.0

No symbol table info available.

#2  0x00000038852094a7 in pthread_mutex_lock () from /lib64/libpthread.so.0

No symbol table info available.

#3  0x00007ffff7d5c758 in boost::unique_lock::lock() () from /usr/lib64/icinga2/libbase.so

No symbol table info available.

#4  0x00007ffff7d1bde5 in icinga::WorkQueue::WorkerThreadProc() () from /usr/lib64/icinga2/libbase.so

No symbol table info available.

#5  0x000000388ae0c5c3 in boost::(anonymous namespace)::thread_proxy (param=)

at libs/thread/src/pthread/thread.cpp:165
thread_info = {px = 0x7fffd216ee70, pn = {pi_ = 0x7fffd09afe20}}
lock =

#6  0x0000003885207aa1 in start_thread () from /lib64/libpthread.so.0

No symbol table info available.

#7  0x0000003884ee893d in clone () from /lib64/libc.so.6

No symbol table info available.

Thread 29 (Thread 0x7fffb3fff700 (LWP 30978)):

#0  0x0000003884ef809e in __lll_lock_wait_private () from /lib64/libc.so.6

No symbol table info available.

#1  0x0000003884e7d664 in _L_lock_13309 () from /lib64/libc.so.6

No symbol table info available.

#2  0x0000003884e7c55f in malloc_atfork () from /lib64/libc.so.6

--Type to continue, or q to quit--
No symbol table info available.

#3  0x00000038882bd0bd in operator new(unsigned long) () from /usr/lib64/libstdc++.so.6

No symbol table info available.

#4  0x000000388829c3c9 in std::basic_string, std::allocator >::_Rep::_S_create(unsigned long, unsigned long, std::allocator const&) () from /usr/lib64/libstdc++.so.6

No symbol table info available.

#5  0x000000388829cde5 in ?? () from /usr/lib64/libstdc++.so.6

No symbol table info available.

#6  0x000000388829cf33 in std::basic_string, std::allocator >::basic_string(char const*, std::allocator const&) () from /usr/lib64/libstdc++.so.6

No symbol table info available.

#7  0x00007ffff51acc51 in icinga::HostDbObject::OnConfigUpdate() () from /usr/lib64/icinga2/libdb_ido.so

No symbol table info available.

#8  0x00007ffff51a525c in icinga::DbObject::SendConfigUpdate() () from /usr/lib64/icinga2/libdb_ido.so

No symbol table info available.

#9  0x00007ffff545a785 in icinga::IdoMysqlConnection::Reconnect() () from /usr/lib64/icinga2/libdb_ido_mysql.so

No symbol table info available.

#10 0x00007ffff7d1bd32 in icinga::WorkQueue::WorkerThreadProc() () from /usr/lib64/icinga2/libbase.so

No symbol table info available.

#11 0x000000388ae0c5c3 in boost::(anonymous namespace)::thread_proxy (param=)

at libs/thread/src/pthread/thread.cpp:165
thread_info = {px = 0x7fffe0000c20, pn = {pi_ = 0x7fffe0000e00}}
lock =

#12 0x0000003885207aa1 in start_thread () from /lib64/libpthread.so.0

No symbol table info available.

#13 0x0000003884ee893d in clone () from /lib64/libc.so.6

No symbol table info available.

Thread 28 (Thread 0x7ffff4a93700 (LWP 30975)):

#0  0x000000388520eb2d in accept () from /lib64/libpthread.so.0

No symbol table info available.

#1  0x00007ffff7d03ab7 in icinga::Socket::Accept() () from /usr/lib64/icinga2/libbase.so

No symbol table info available.

#2  0x00007ffff739084d in icinga::ApiListener::ListenerThreadProc(boost::intrusive_ptr const&) ()

from /usr/lib64/icinga2/libremote.so
No symbol table info available.

#3  0x00007ffff73edb14 in boost::detail::thread_data const&>, boost::_bi::list2, boost::_bi::value > > > >::run() () from /usr/lib64/icinga2/libremote.so

No symbol table info available.

#4  0x000000388ae0c5c3 in boost::(anonymous namespace)::thread_proxy (param=)

at libs/thread/src/pthread/thread.cpp:165
thread_info = {px = 0x7fffca2c31f0, pn = {pi_ = 0x7fffc8abcf50}}
lock =

#5  0x0000003885207aa1 in start_thread () from /lib64/libpthread.so.0

No symbol table info available.
--Type to continue, or q to quit--

#6  0x0000003884ee893d in clone () from /lib64/libc.so.6

No symbol table info available.

Thread 27 (Thread 0x7ffff4ad4700 (LWP 30974)):

#0  0x0000003884edf113 in poll () from /lib64/libc.so.6

No symbol table info available.

#1  0x00007ffff7d03d5e in icinga::Socket::Poll(bool, bool, timeval*) () from /usr/lib64/icinga2/libbase.so

No symbol table info available.

#2  0x00007ffff59a6e76 in icinga::ExternalCommandListener::CommandPipeThread(icinga::String const&) ()

from /usr/lib64/icinga2/libcompat.so
No symbol table info available.

#3  0x000000388ae0c5c3 in boost::(anonymous namespace)::thread_proxy (param=)

at libs/thread/src/pthread/thread.cpp:165
thread_info = {px = 0x7fffc6124470, pn = {pi_ = 0x7fffc4248900}}
lock =

#4  0x0000003885207aa1 in start_thread () from /lib64/libpthread.so.0

No symbol table info available.

#5  0x0000003884ee893d in clone () from /lib64/libc.so.6

No symbol table info available.

Thread 26 (Thread 0x7ffff4c19700 (LWP 30973)):

#0  0x000000388520e334 in __lll_lock_wait () from /lib64/libpthread.so.0

No symbol table info available.

#1  0x00000038852095d8 in _L_lock_854 () from /lib64/libpthread.so.0

No symbol table info available.

#2  0x00000038852094a7 in pthread_mutex_lock () from /lib64/libpthread.so.0

No symbol table info available.

#3  0x00007ffff7d5c758 in boost::unique_lock::lock() () from /usr/lib64/icinga2/libbase.so

No symbol table info available.

#4  0x00007ffff7d1a1d0 in icinga::WorkQueue::Enqueue(boost::function const&, icinga::WorkQueuePriority, bool) ()

from /usr/lib64/icinga2/libbase.so
No symbol table info available.

#5  0x00007ffff7391500 in icinga::ApiListener::RelayMessage(boost::intrusive_ptr const&, boost::intrusive_ptr const&, boost::intrusive_ptr const&, bool) () from /usr/lib64/icinga2/libremote.so

No symbol table info available.

#6  0x00007ffff64630d9 in icinga::ClusterEvents::NextCheckChangedHandler(boost::intrusive_ptr const&, boost::intrusive_ptr const&) () from /usr/lib64/icinga2/libicinga.so

No symbol table info available.

#7  0x00007ffff64f64c4 in boost::detail::function::void_function_invoker2 const&, boost::intrusive_ptr const&), void, boost::intrusive_ptr const&, icinga::Value const&>::invoke(boost::detail::function::function_buffer&, boost::intrusive_ptr const&, icinga::Value const&) ()

from /usr/lib64/icinga2/libicinga.so
No symbol table info available.

#8  0x00007ffff654395a in boost::signals2::detail::signal_impl const&, icinga::Value const&), boost::signals2::optional_last_value, int, std::less, boost::function const&, icinga::Value const&)>, boost::function const&, icinga---Type  to continue, or q  to quit---

::Value const&)>, boost::signals2::mutex>::operator()(boost::intrusive_ptricinga::Checkable const&, icinga::Value const&) ()
from /usr/lib64/icinga2/libicinga.so
No symbol table info available.

#9  0x00007ffff64bb5cf in icinga::ObjectImpl::NotifyNextCheck(icinga::Value const&) ()

from /usr/lib64/icinga2/libicinga.so
No symbol table info available.

#10 0x00007ffff64765d4 in icinga::Checkable::UpdateNextCheck(boost::intrusive_ptr const&) ()

from /usr/lib64/icinga2/libicinga.so
No symbol table info available.

#11 0x00007ffff5c33d7d in icinga::CheckerComponent::CheckThreadProc() () from /usr/lib64/icinga2/libchecker.so

No symbol table info available.

#12 0x000000388ae0c5c3 in boost::(anonymous namespace)::thread_proxy (param=)

at libs/thread/src/pthread/thread.cpp:165
thread_info = {px = 0x7fffbe375e90, pn = {pi_ = 0x7fffbc9c2ba0}}
lock =

#13 0x0000003885207aa1 in start_thread () from /lib64/libpthread.so.0

No symbol table info available.

#14 0x0000003884ee893d in clone () from /lib64/libc.so.6

No symbol table info available.

Thread 13 (Thread 0x7fffdffff700 (LWP 30526)):

#0  0x000000388520ba5e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0

No symbol table info available.

#1  0x00007ffff7d6812d in bool boost::condition_variable::timed_wait >(boost::unique_lock&, boost::date_time::subsecond_duration const&) ()

from /usr/lib64/icinga2/libbase.so
No symbol table info available.

#2  0x00007ffff7d34ef3 in icinga::Timer::TimerThreadProc() () from /usr/lib64/icinga2/libbase.so

No symbol table info available.

#3  0x000000388ae0c5c3 in boost::(anonymous namespace)::thread_proxy (param=)

at libs/thread/src/pthread/thread.cpp:165
thread_info = {px = 0x636100, pn = {pi_ = 0x6362d0}}
lock =

#4  0x0000003885207aa1 in start_thread () from /lib64/libpthread.so.0

No symbol table info available.

#5  0x0000003884ee893d in clone () from /lib64/libc.so.6

No symbol table info available.

Thread 12 (Thread 0x7ffff6a31700 (LWP 30525)):

#0  0x000000388520ba5e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0

No symbol table info available.

#1  0x00007ffff7d6812d in bool boost::condition_variable::timed_wait >(boost::unique_lock&, boost::date_time::subsecond_duration const&) ()

from /usr/lib64/icinga2/libbase.so
No symbol table info available.

#2  0x00007ffff7d0b807 in icinga::ThreadPool::ManagerThreadProc() () from /usr/lib64/icinga2/libbase.so

--Type to continue, or q to quit--
No symbol table info available.

#3  0x000000388ae0c5c3 in boost::(anonymous namespace)::thread_proxy (param=)

at libs/thread/src/pthread/thread.cpp:165
thread_info = {px = 0x635c90, pn = {pi_ = 0x635e70}}
lock =

#4  0x0000003885207aa1 in start_thread () from /lib64/libpthread.so.0

No symbol table info available.

#5  0x0000003884ee893d in clone () from /lib64/libc.so.6

No symbol table info available.

Thread 11 (Thread 0x7fffeffff700 (LWP 30524)):

#0  0x0000003884ef809e in __lll_lock_wait_private () from /lib64/libc.so.6

No symbol table info available.

#1  0x0000003884e7d664 in _L_lock_13309 () from /lib64/libc.so.6

No symbol table info available.

#2  0x0000003884e7c55f in malloc_atfork () from /lib64/libc.so.6

No symbol table info available.

#3  0x00000038882bd0bd in operator new(unsigned long) () from /usr/lib64/libstdc++.so.6

No symbol table info available.

#4  0x00007ffff64f685b in std::_Rb_tree, boost::intrusive_ptr, std::_Identity >, std::less >, std::allocator > >::_M_copy(std::_Rb_tree_node > const*, std::_Rb_tree_node >*) () from /usr/lib64/icinga2/libicinga.so

No symbol table info available.

#5  0x00007ffff64f69dd in std::_Rb_tree, boost::intrusive_ptr, std::_Identity >, std::less >, std::allocator > >::_Rb_tree(std::_Rb_tree, boost::intrusive_ptr, std::_Identity >, std::less >, std::allocator > > const&) () from /usr/lib64/icinga2/libicinga.so

No symbol table info available.

#6  0x00007ffff644feb2 in icinga::Checkable::GetParents() const () from /usr/lib64/icinga2/libicinga.so

No symbol table info available.

#7  0x00007ffff6458b7a in icinga::Checkable::IsReachable(icinga::DependencyType, boost::intrusive_ptr*, int) const ()

from /usr/lib64/icinga2/libicinga.so
No symbol table info available.

#8  0x00007ffff6458f62 in icinga::CompatUtility::GetCheckableIsReachable(boost::intrusive_ptr const&) ()

from /usr/lib64/icinga2/libicinga.so
No symbol table info available.

#9  0x00007ffff59adc2c in icinga::StatusDataWriter::DumpCheckableStatusAttrs(std::basic_ostream >&, boost::intrusive_ptr const&) () from /usr/lib64/icinga2/libcompat.so

No symbol table info available.

#10 0x00007ffff59b038a in icinga::StatusDataWriter::DumpHostStatus(std::basic_ostream >&, boost::intrusive_ptr const&) () from /usr/lib64/icinga2/libcompat.so

No symbol table info available.

#11 0x00007ffff59b4580 in icinga::StatusDataWriter::StatusTimerHandler() () from /usr/lib64/icinga2/libcompat.so

No symbol table info available.
--Type to continue, or q to quit--

#12 0x00007ffff7d957fb in boost::signals2::detail::signal_impl const&), boost::signals2::optional_last_value, int, std::less, boost::function const&)>, boost::function const&)>, boost::signals2::mutex>::operator()(boost::intrusive_ptr const&) () from /usr/lib64/icinga2/libbase.so

No symbol table info available.

#13 0x00007ffff7d44c14 in icinga::Timer::Call() () from /usr/lib64/icinga2/libbase.so

No symbol table info available.

#14 0x00007ffff7d41afc in icinga::ThreadPool::WorkerThread::ThreadProc(icinga::ThreadPool::Queue&) () from /usr/lib64/icinga2/libbase.so

No symbol table info available.

#15 0x000000388ae0c5c3 in boost::(anonymous namespace)::thread_proxy (param=)

at libs/thread/src/pthread/thread.cpp:165
thread_info = {px = 0x635800, pn = {pi_ = 0x6359e0}}
lock =

#16 0x0000003885207aa1 in start_thread () from /lib64/libpthread.so.0

No symbol table info available.

#17 0x0000003884ee893d in clone () from /lib64/libc.so.6

No symbol table info available.

Thread 10 (Thread 0x7fffe7fff700 (LWP 30523)):

#0  0x0000003884ef809e in __lll_lock_wait_private () from /lib64/libc.so.6

No symbol table info available.

#1  0x0000003884e7cc25 in _L_lock_90 () from /lib64/libc.so.6

No symbol table info available.

#2  0x0000003884e758e6 in ptmalloc_lock_all () from /lib64/libc.so.6

No symbol table info available.

#3  0x0000003884eacb05 in fork () from /lib64/libc.so.6

No symbol table info available.

#4  0x00007ffff7d2adb4 in icinga::Process::Run(boost::function const&) ()

from /usr/lib64/icinga2/libbase.so
No symbol table info available.

#5  0x00007ffff649944f in icinga::PluginUtility::ExecuteCommand(boost::intrusive_ptr const&, boost::intrusive_ptr const&, boost::intrusive_ptr const&, std::vector >, std::allocator > > > const&, boost::intrusive_ptr const&, bool, boost::function const&) ()

from /usr/lib64/icinga2/libicinga.so
No symbol table info available.

#6  0x00007ffff5e681a2 in icinga::PluginCheckTask::ScriptFunc(boost::intrusive_ptr const&, boost::intrusive_ptr const&, boost::intrusive_ptr const&, bool) () from /usr/lib64/icinga2/libmethods.so

No symbol table info available.

#7  0x00007ffff5e72a06 in icinga::Value icinga::FunctionWrapperV const&, boost::intrusive_ptr const&, boost::intrusive_ptr const&, bool>(void (*)(boost::intrusive_ptr const&, boost::intrusive_ptr const&, boost::intrusive_ptr const&, bool), std::vector > const&) () from /usr/lib64/icinga2/libmethods.so

No symbol table info available.

#8  0x00007ffff5e6f2dd in boost::detail::function::function_obj_invoker1 const&, boost::intrusive_ptr const&, boost::intrusive_ptr const---Type  to continue, or q  to quit---

&, bool), std::vector<icinga::Value, std::allocatoricinga::Value > const&), boost::_bi::list2<boost::_bi::value<void (*)(boost::intrusive_ptricinga::Checkable const&, boost::intrusive_ptricinga::CheckResult const&, boost::intrusive_ptricinga::Dictionary const&, bool)>, boost::arg<1> > >, icinga::Value, std::vector<icinga::Value, std::allocatoricinga::Value > const&>::invoke(boost::detail::function::function_buffer&, std::vector<icinga::Value, std::allocatoricinga::Value > const&) () from /usr/lib64/icinga2/libmethods.so
No symbol table info available.

#9  0x00007ffff7cf69ad in icinga::Function::Invoke(std::vector > const&) ()

from /usr/lib64/icinga2/libbase.so
No symbol table info available.

#10 0x00007ffff647983f in icinga::CheckCommand::Execute(boost::intrusive_ptr const&, boost::intrusive_ptr const&, boost::intrusive_ptr const&, bool) () from /usr/lib64/icinga2/libicinga.so

No symbol table info available.

#11 0x00007ffff64d1c7e in icinga::Checkable::ExecuteCheck() () from /usr/lib64/icinga2/libicinga.so

No symbol table info available.

#12 0x00007ffff5c34a3f in icinga::CheckerComponent::ExecuteCheckHelper(boost::intrusive_ptr const&) ()

from /usr/lib64/icinga2/libchecker.so
No symbol table info available.

#13 0x00007ffff7d41afc in icinga::ThreadPool::WorkerThread::ThreadProc(icinga::ThreadPool::Queue&) () from /usr/lib64/icinga2/libbase.so

No symbol table info available.

#14 0x000000388ae0c5c3 in boost::(anonymous namespace)::thread_proxy (param=)

at libs/thread/src/pthread/thread.cpp:165
thread_info = {px = 0x635350, pn = {pi_ = 0x635530}}
lock =

#15 0x0000003885207aa1 in start_thread () from /lib64/libpthread.so.0

No symbol table info available.

#16 0x0000003884ee893d in clone () from /lib64/libc.so.6

No symbol table info available.

Thread 9 (Thread 0x7ffff6a72700 (LWP 30522)):

#0  0x000000388829d29f in std::basic_string, std::allocator >::basic_string(std::basic_string, std::allocator > const&) () from /usr/lib64/libstdc++.so.6

No symbol table info available.

#1  0x00007ffff6407b40 in icinga::ObjectImpl::GetCheckCommandRaw() const () from /usr/lib64/icinga2/libicinga.so

No symbol table info available.

#2  0x00007ffff64183a8 in icinga::ObjectImpl::NavigateCheckCommandRaw() const () from /usr/lib64/icinga2/libicinga.so

No symbol table info available.

#3  0x00007ffff641ee55 in icinga::Checkable::GetCheckCommand() const () from /usr/lib64/icinga2/libicinga.so

No symbol table info available.

#4  0x00007ffff64d1c45 in icinga::Checkable::ExecuteCheck() () from /usr/lib64/icinga2/libicinga.so

No symbol table info available.

#5  0x00007ffff5c34a3f in icinga::CheckerComponent::ExecuteCheckHelper(boost::intrusive_ptr const&) ()

from /usr/lib64/icinga2/libchecker.so
No symbol table info available.

#6  0x00007ffff7d41afc in icinga::ThreadPool::WorkerThread::ThreadProc(icinga::ThreadPool::Queue&) () from /usr/lib64/icinga2/libbase.so

No symbol table info available.

#7  0x000000388ae0c5c3 in boost::(anonymous namespace)::thread_proxy (param=)

at libs/thread/src/pthread/thread.cpp:165
--Type to continue, or q to quit--
thread_info = {px = 0x634ea0, pn = {pi_ = 0x635080}}
lock =

#8  0x0000003885207aa1 in start_thread () from /lib64/libpthread.so.0

No symbol table info available.

#9  0x0000003884ee893d in clone () from /lib64/libc.so.6

No symbol table info available.

Thread 8 (Thread 0x7ffff6ab3700 (LWP 30521)):

#0  0x0000003884ef809e in __lll_lock_wait_private () from /lib64/libc.so.6

No symbol table info available.

#1  0x0000003884e7cc25 in _L_lock_90 () from /lib64/libc.so.6

No symbol table info available.

#2  0x0000003884e758e6 in ptmalloc_lock_all () from /lib64/libc.so.6

No symbol table info available.

#3  0x0000003884eacb05 in fork () from /lib64/libc.so.6

No symbol table info available.

#4  0x00007ffff7d2adb4 in icinga::Process::Run(boost::function const&) ()

from /usr/lib64/icinga2/libbase.so
No symbol table info available.

#5  0x00007ffff649944f in icinga::PluginUtility::ExecuteCommand(boost::intrusive_ptr const&, boost::intrusive_ptr const&, boost::intrusive_ptr const&, std::vector >, std::allocator > > > const&, boost::intrusive_ptr const&, bool, boost::function const&) ()

from /usr/lib64/icinga2/libicinga.so
No symbol table info available.

#6  0x00007ffff5e681a2 in icinga::PluginCheckTask::ScriptFunc(boost::intrusive_ptr const&, boost::intrusive_ptr const&, boost::intrusive_ptr const&, bool) () from /usr/lib64/icinga2/libmethods.so

No symbol table info available.

#7  0x00007ffff5e72a06 in icinga::Value icinga::FunctionWrapperV const&, boost::intrusive_ptr const&, boost::intrusive_ptr const&, bool>(void (*)(boost::intrusive_ptr const&, boost::intrusive_ptr const&, boost::intrusive_ptr const&, bool), std::vector > const&) () from /usr/lib64/icinga2/libmethods.so

No symbol table info available.

#8  0x00007ffff5e6f2dd in boost::detail::function::function_obj_invoker1 const&, boost::intrusive_ptr const&, boost::intrusive_ptr const&, bool), std::vector > const&), boost::_bi::list2 const&, boost::intrusive_ptr const&, boost::intrusive_ptr const&, bool)>, boost::arg<1> > >, icinga::Value, std::vector > const&>::invoke(boost::detail::function::function_buffer&, std::vector > const&) () from /usr/lib64/icinga2/libmethods.so

No symbol table info available.

#9  0x00007ffff7cf69ad in icinga::Function::Invoke(std::vector > const&) ()

from /usr/lib64/icinga2/libbase.so
No symbol table info available.

#10 0x00007ffff647983f in icinga::CheckCommand::Execute(boost::intrusive_ptr const&, boost::intrusive_ptr const&, boost::intrusive_ptr const&, bool) () from /usr/lib64/icinga2/libicinga.so

No symbol table info available.
--Type to continue, or q to quit--

#11 0x00007ffff64d1c7e in icinga::Checkable::ExecuteCheck() () from /usr/lib64/icinga2/libicinga.so

No symbol table info available.

#12 0x00007ffff5c34a3f in icinga::CheckerComponent::ExecuteCheckHelper(boost::intrusive_ptr const&) ()

from /usr/lib64/icinga2/libchecker.so
No symbol table info available.

#13 0x00007ffff7d41afc in icinga::ThreadPool::WorkerThread::ThreadProc(icinga::ThreadPool::Queue&) () from /usr/lib64/icinga2/libbase.so

No symbol table info available.

#14 0x000000388ae0c5c3 in boost::(anonymous namespace)::thread_proxy (param=)

at libs/thread/src/pthread/thread.cpp:165
thread_info = {px = 0x6349a0, pn = {pi_ = 0x634b80}}
lock =

#15 0x0000003885207aa1 in start_thread () from /lib64/libpthread.so.0

No symbol table info available.

#16 0x0000003884ee893d in clone () from /lib64/libc.so.6

No symbol table info available.

Thread 1 (Thread 0x7ffff6abb7e0 (LWP 30508)):

#0  0x0000003884eaca7d in nanosleep () from /lib64/libc.so.6

No symbol table info available.

#1  0x0000003884ee1c24 in usleep () from /lib64/libc.so.6

No symbol table info available.

#2  0x00007ffff7d4363d in icinga::Application::RunEventLoop() () from /usr/lib64/icinga2/libbase.so

No symbol table info available.

#3  0x00007ffff64b1526 in icinga::IcingaApplication::Main() () from /usr/lib64/icinga2/libicinga.so

No symbol table info available.

#4  0x00007ffff7d211b5 in icinga::Application::Run() () from /usr/lib64/icinga2/libbase.so

No symbol table info available.

#5  0x00007ffff76e488b in icinga::DaemonCommand::Run(boost::program_options::variables_map const&, std::vector, std::allocator >, std::allocator, std::allocator > > > const&) const () from /usr/lib64/icinga2/libcli.so

No symbol table info available.

#6  0x0000000000411d84 in ?? ()

No symbol table info available.

#7  0x000000000040f48a in ?? ()

No symbol table info available.

#8  0x0000003884e1ed5d in __libc_start_main () from /lib64/libc.so.6

No symbol table info available.

#9  0x000000000040f581 in ?? ()

No symbol table info available.

#10 0x00007fffffffe618 in ?? ()

No symbol table info available.

#11 0x000000000000001c in ?? ()

No symbol table info available.

#12 0x0000000000000006 in ?? ()

No symbol table info available.

#13 0x00007fffffffe877 in ?? ()

--Type to continue, or q to quit--
No symbol table info available.

#14 0x00007fffffffe897 in ?? ()

No symbol table info available.

#15 0x00007fffffffe8a9 in ?? ()

No symbol table info available.

#16 0x00007fffffffe8b0 in ?? ()

No symbol table info available.

#17 0x00007fffffffe8b3 in ?? ()

No symbol table info available.

#18 0x00007fffffffe8b9 in ?? ()

No symbol table info available.

#19 0x0000000000000000 in ?? ()

No symbol table info available.

Attachments

• 11639.conf mfriedrich - 2016-04-21 13:08:18 +00:00

Changesets

2016-04-21 07:17:40 +00:00 by gbeutner 4a32211

Fix crash in Ido{Mysql,Pgsql}Connection::ExecuteMultipleQueries

fixes #11639

2016-04-21 10:29:20 +00:00 by gbeutner cf34aa8

Fix crash in Ido{Mysql,Pgsql}Connection::ExecuteMultipleQueries

fixes #11639

---

Relations:

• relates #10855

[icinga-migration]

Updated by gbeutner on 2016-04-21 07:14:31 +00:00

• Category set to DB IDO
• Status changed from New to Feedback
• Assigned to set to mzac

Please install the debug symbols using the command GDB gave you:

Missing separate debuginfos, use: debuginfo-install icinga2-bin-2.4.5-1.el6.x86_64

[icinga-migration]

Updated by gbeutner on 2016-04-21 07:17:23 +00:00

• Status changed from Feedback to Assigned
• Assigned to changed from mzac to gbeutner
• Target Version set to 2.4.7

Actually, I think I might already know why this happens.

[icinga-migration]

Updated by gbeutner on 2016-04-21 07:19:49 +00:00

• Relates set to 10855

[icinga-migration]

Updated by gbeutner on 2016-04-21 07:20:00 +00:00

• Subject changed from Crash on Icinga2 2.4.5 to Crash in IdoMysqlConnection::ExecuteMultipleQueries

[icinga-migration]

Updated by gbeutner on 2016-04-21 07:20:05 +00:00

• Status changed from Assigned to Resolved
• Done % changed from 0 to 100

Applied in changeset 4a32211.

[icinga-migration]

Updated by mfriedrich on 2016-04-21 13:08:37 +00:00

• File added 11639.conf

For future reference - the NotificationSentToAllUsers signal provides a set of users being notified. It might occur that this set is empty - especially when there was a notification triggered (no filters) and all users won't receive that notification (state = [ OK ]).

Attached is a test config to trigger the bug directly.