Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

graphd crashed inserting edges #5101

Closed
nebula-bots opened this issue Dec 23, 2022 · 0 comments · Fixed by #5100
Closed

graphd crashed inserting edges #5101

nebula-bots opened this issue Dec 23, 2022 · 0 comments · Fixed by #5100
Assignees
Labels
affects/master PR/issue: this bug affects master version. auto-sync process/done Process of bug severity/blocker Severity of bug type/bug Type: something is unexpected
Milestone

Comments

@nebula-bots
Copy link
Contributor

Please check the FAQ documentation before raising an issue

Describe the bug (required)

graphd crashed while inserting data, the crash stack:

[New LWP 108]
[New LWP 151]
[New LWP 239]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
--Type <RET> for more, q to quit, c to continue without paging--
Core was generated by `/root/src/nebula-ent-wwl/build/bin/nebula-graphd --flagfile /root/nebula-chaos-'.
Program terminated with signal SIGSEGV, Segmentation fault.
#0  nebula::storage::StorageClientBase<nebula::storage::cpp2::GraphStorageServiceAsyncClient, nebula::thrift::ThriftClientManager<nebula::storage::cpp2::GraphStorageServiceAsyncClient> >::getResponse<nebula::storage::cpp2::AddEdgesRequest, nebula::storage::StorageClient::addEdges(nebula::storage::StorageClient::CommonRequestParam const&, std::vector<nebula::storage::cpp2::NewEdge, std::allocator<nebula::storage::cpp2::NewEdge> >, std::vector<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::allocator<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > > >, bool, bool)::$_3, nebula::storage::cpp2::ExecResponse>(folly::EventBase*, nebula::HostAddr const&, nebula::storage::cpp2::AddEdgesRequest const&, nebula::storage::StorageClient::addEdges(nebula::storage::StorageClient::CommonRequestParam const&, std::vector<nebula::storage::cpp2::NewEdge, std::allocator<nebula::storage::cpp2::NewEdge> >, std::vector<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::allocator<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > > >, bool, bool)::$_3&&)::{lambda(folly::exception_wrapper&&)#1}::operator()(folly::exception_wrapper&&) (
    this=<optimized out>, exWrapper=...) at /data/src/nebula-ent-wwl/src/clients/storage/StorageClientBase-inl.h:206
206	          LOG(ERROR) << "Request to " << host << " failed: " << ex->what();
[Current thread is 1 (Thread 0x7f4640fff700 (LWP 224))]
(gdb) bt
#0  nebula::storage::StorageClientBase<nebula::storage::cpp2::GraphStorageServiceAsyncClient, nebula::thrift::ThriftClientManager<nebula::storage::cpp2::GraphStorageServiceAsyncClient> >::getResponse<nebula::storage::cpp2::AddEdgesRequest, nebula::storage::StorageClient::addEdges(nebula::storage::StorageClient::CommonRequestParam const&, std::vector<nebula::storage::cpp2::NewEdge, std::allocator<nebula::storage::cpp2::NewEdge> >, std::vector<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::allocator<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > > >, bool, bool)::$_3, nebula::storage::cpp2::ExecResponse>(folly::EventBase*, nebula::HostAddr const&, nebula::storage::cpp2::AddEdgesRequest const&, nebula::storage::StorageClient::addEdges(nebula::storage::StorageClient::CommonRequestParam const&, std::vector<nebula::storage::cpp2::NewEdge, std::allocator<nebula::storage::cpp2::NewEdge> >, std::vector<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::allocator<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > > >, bool, bool)::$_3&&)::{lambda(folly::exception_wrapper&&)#1}::operator()(folly::exception_wrapper&&) (
    this=<optimized out>, exWrapper=...) at /data/src/nebula-ent-wwl/src/clients/storage/StorageClientBase-inl.h:206
#1  folly::futures::detail::CoreCallbackState<nebula::StatusOr<nebula::storage::cpp2::ExecResponse>, nebula::storage::StorageClientBase<nebula::storage::cpp2::GraphStorageServiceAsyncClient, nebula::thrift::ThriftClientManager<nebula::storage::cpp2::GraphStorageServiceAsyncClient> >::getResponse<nebula::storage::cpp2::AddEdgesRequest, nebula::storage::StorageClient::addEdges(nebula::storage::StorageClient::CommonRequestParam const&, std::vector<nebula::storage::cpp2::NewEdge, std::allocator<nebula::storage::cpp2::NewEdge> >, std::vector<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::allocator<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > > >, bool, bool)::$_3, nebula::storage::cpp2::ExecResponse>(folly::EventBase*, nebula::HostAddr const&, nebula::storage::cpp2::AddEdgesRequest const&, nebula::storage::StorageClient::addEdges(nebula::storage::StorageClient::CommonRequestParam const&, std::vector<nebula::storage::cpp2::NewEdge, std::allocator<nebula::storage::cpp2::NewEdge> >, std::vector<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::allocator<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > > >, bool, bool)::$_3&&)::{lambda(folly::exception_wrapper&&)#1}>::invoke<folly::exception_wrapper>(folly::exception_wrapper&&) (this=<optimized out>, args=...)
    at /data/src/nebula-ent-wwl/build/third-party/install/include/folly/futures/Future-inl.h:144
#2  _ZZZNO5folly6FutureIN6nebula8StatusOrINS1_7storage4cpp212ExecResponseEEEE9thenErrorIZNS3_17StorageClientBaseINS4_30GraphStorageServiceAsyncClientENS1_6thrift19ThriftClientManagerISA_EEE11getResponseINS4_15AddEdgesRequestEZNS3_13StorageClient8addEdgesERKNSH_18CommonRequestParamESt6vectorINS4_7NewEdgeESaISM_EESL_INSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEESaISU_EEbbE3$_3S5_EENS0_INS2_IT1_EEEEPNS_9EventBaseERKNS1_8HostAddrERKT_OT0_EUlONS_17exception_wrapperEE_EENSt9enable_ifIXntsr20isFutureOrSemiFutureINS_13invoke_detail6traitsIS16_E6resultIS1B_EEEE5valueES7_E4typeEOS16_ENUlONS_8Executor9KeepAliveIS1N_EEONS_3TryIS6_EEE_clES1Q_S1T_ENKUlvE_clEv (this=<optimized out>) at /data/src/nebula-ent-wwl/build/third-party/install/include/folly/futures/Future-inl.h:1165
#3  _ZN5folly19makeTryWithNoUnwrapIZZNOS_6FutureIN6nebula8StatusOrINS2_7storage4cpp212ExecResponseEEEE9thenErrorIZNS4_17StorageClientBaseINS5_30GraphStorageServiceAsyncClientENS2_6thrift19ThriftClientManagerISB_EEE11getResponseINS5_15AddEdgesRequestEZNS4_13StorageClient8addEdgesERKNSI_18CommonRequestParamESt6vectorINS5_7NewEdgeESaISN_EESM_INSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEESaISV_EEbbE3$_3S6_EENS1_INS3_IT1_EEEEPNS_9EventBaseERKNS2_8HostAddrERKT_OT0_EUlONS_17exception_wrapperEE_EENSt9enable_ifIXntsr20isFutureOrSemiFutureINS_13invoke_detail6traitsIS17_E6resultIS1C_EEEE5valueES8_E4typeEOS17_ENUlONS_8Executor9KeepAliveIS1O_EEONS_3TryIS7_EEE_clES1R_S1U_EUlvE_EENS1F_IXntsr3std7is_sameINS1I_S1J_IEEvEE5valueENS1S_IS1X_EEE4typeES1N_ (f=...)
    at /data/src/nebula-ent-wwl/build/third-party/install/include/folly/Try-inl.h:257
#4  _ZN5folly11makeTryWithIZZNOS_6FutureIN6nebula8StatusOrINS2_7storage4cpp212ExecResponseEEEE9thenErrorIZNS4_17StorageClientBaseINS5_30GraphStorageServiceAsyncClientENS2_6thrift19ThriftClientManagerISB_EEE11getResponseINS5_15AddEdgesRequestEZNS4_13StorageClient8addEdgesERKNSI_18CommonRequestParamESt6vectorINS5_7NewEdgeESaISN_EESM_INSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEESaISV_EEbbE3$_3S6_EENS1_INS3_IT1_EEEEPNS_9EventBaseERKNS2_8HostAddrERKT_OT0_EUlONS_17exc--Type <RET> for more, q to quit, c to continue without paging--
eption_wrapperEE_EENSt9enable_ifIXntsr20isFutureOrSemiFutureINS_13invoke_detail6traitsIS17_E6resultIS1C_EEEE5valueES8_E4typeEOS17_ENUlONS_8Executor9KeepAliveIS1O_EEONS_3TryIS7_EEE_clES1R_S1U_EUlvE_EENS1F_IXntsr5isTryINS1I_S1J_IEEEE5valueENS1S_IS1X_EEE4typeES1N_ (f=...)
    at /data/src/nebula-ent-wwl/build/third-party/install/include/folly/Try-inl.h:279
#5  _ZZNO5folly6FutureIN6nebula8StatusOrINS1_7storage4cpp212ExecResponseEEEE9thenErrorIZNS3_17StorageClientBaseINS4_30GraphStorageServiceAsyncClientENS1_6thrift19ThriftClientManagerISA_EEE11getResponseINS4_15AddEdgesRequestEZNS3_13StorageClient8addEdgesERKNSH_18CommonRequestParamESt6vectorINS4_7NewEdgeESaISM_EESL_INSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEESaISU_EEbbE3$_3S5_EENS0_INS2_IT1_EEEEPNS_9EventBaseERKNS1_8HostAddrERKT_OT0_EUlONS_17exception_wrapperEE_EENSt9enable_ifIXntsr20isFutureOrSemiFutureINS_13invoke_detail6traitsIS16_E6resultIS1B_EEEE5valueES7_E4typeEOS16_ENUlONS_8Executor9KeepAliveIS1N_EEONS_3TryIS6_EEE_clES1Q_S1T_ (this=<optimized out>, ka=..., t=...) at /data/src/nebula-ent-wwl/build/third-party/install/include/folly/futures/Future-inl.h:1164
#6  _ZZN5folly7futures6detail4CoreIN6nebula8StatusOrINS3_7storage4cpp212ExecResponseEEEE11setCallbackIZNOS_6FutureIS8_E9thenErrorIZNS5_17StorageClientBaseINS6_30GraphStorageServiceAsyncClientENS3_6thrift19ThriftClientManagerISF_EEE11getResponseINS6_15AddEdgesRequestEZNS5_13StorageClient8addEdgesERKNSM_18CommonRequestParamESt6vectorINS6_7NewEdgeESaISR_EESQ_INSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEESaISZ_EEbbE3$_3S7_EENSB_INS4_IT1_EEEEPNS_9EventBaseERKNS3_8HostAddrERKT_OT0_EUlONS_17exception_wrapperEE_EENSt9enable_ifIXntsr20isFutureOrSemiFutureINS_13invoke_detail6traitsIS1B_E6resultIS1G_EEEE5valueESC_E4typeEOS1B_EUlONS_8Executor9KeepAliveIS1S_EEONS_3TryIS8_EEE_EEvS1R_OSt10shared_ptrINS_14RequestContextEENS1_18InlineContinuationEENUlRNS1_8CoreBaseES1V_PS1G_E_clES26_S1V_S27_ (this=0x7f4680651a40, coreBase=..., ka=..., ew=<optimized out>)
    at /data/src/nebula-ent-wwl/build/third-party/install/include/folly/futures/detail/Core.h:637
#7  _ZN5folly6detail8function14FunctionTraitsIFvRNS_7futures6detail8CoreBaseEONS_8Executor9KeepAliveIS7_EEPNS_17exception_wrapperEEE7callBigIZNS4_4CoreIN6nebula8StatusOrINSH_7storage4cpp212ExecResponseEEEE11setCallbackIZNOS_6FutureISM_E9thenErrorIZNSJ_17StorageClientBaseINSK_30GraphStorageServiceAsyncClientENSH_6thrift19ThriftClientManagerIST_EEE11getResponseINSK_15AddEdgesRequestEZNSJ_13StorageClient8addEdgesERKNS10_18CommonRequestParamESt6vectorINSK_7NewEdgeESaIS15_EES14_INSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEESaIS1D_EEbbE3$_3SL_EENSP_INSI_IT1_EEEEPNS_9EventBaseERKNSH_8HostAddrERKT_OT0_EUlOSB_E_EENSt9enable_ifIXntsr20isFutureOrSemiFutureINS_13invoke_detail6traitsIS1P_E6resultISB_EEEE5valueESQ_E4typeEOS1P_EUlSA_ONS_3TryISM_EEE_EEvS24_OSt10shared_ptrINS_14RequestContextEENS4_18InlineContinuationEEUlS6_SA_SC_E_EEvS6_SA_SC_RNS1_4DataE (args=<optimized out>, args=<optimized out>, args=<optimized out>, p=...)
    at /data/src/nebula-ent-wwl/build/third-party/install/include/folly/Function.h:385
#8  0x00000000025be19c in ?? ()
#9  0x00000000026072fb in folly::EventBase::FunctionLoopCallback::runLoopCallback() ()
#10 0x00000000025ffeea in folly::EventBase::runLoopCallbacks(boost::intrusive::list<folly::EventBase::LoopCallback, boost::intrusive::constant_time_size<false> >&) ()
#11 0x00000000025fff77 in folly::EventBase::runLoopCallbacks() ()
#12 0x0000000002602223 in folly::EventBase::loopBody(int, bool) ()
#13 0x0000000002602dae in folly::EventBase::loop() ()
#14 0x00000000026059e8 in folly::EventBase::loopForever() ()
#15 0x000000000258f389 in folly::IOThreadPoolExecutor::threadRun(std::shared_ptr<folly::ThreadPoolExecutor::Thread>) ()
#16 0x000000000259d8f7 in void folly::detail::function::FunctionTraits<void ()>::callBig<std::_Bind<void (folly::ThreadPoolExecutor::*(folly::ThreadPoolExecutor*, std::shared_ptr<folly::ThreadPoolExecutor::Thread>))(std::shared_ptr<folly::ThreadPoolExecutor::Thread>)> >(folly::detail::function::Data&) ()
--Type <RET> for more, q to quit, c to continue without paging--
#17 0x0000000002c5a184 in execute_native_thread_routine ()
#18 0x00007f46b01a6609 in start_thread (arg=<optimized out>) at pthread_create.c:477
#19 0x00007f46b00cd293 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
(gdb)

Your Environments (required)

  • OS: uname -a
  • Compiler: g++ --version or clang++ --version
  • CPU: lscpu
  • Commit id (e.g. a3ffc7d8) 8ac1a26

How To Reproduce(required)

Steps to reproduce the behavior:

  1. Step 1
  2. Step 2
  3. Step 3

Expected behavior

Additional context

@nebula-bots nebula-bots added affects/master PR/issue: this bug affects master version. auto-sync severity/blocker Severity of bug type/bug Type: something is unexpected labels Dec 23, 2022
@Sophie-Xie Sophie-Xie added this to the v3.4.0 milestone Dec 26, 2022
@github-actions github-actions bot added the process/fixed Process of bug label Dec 26, 2022
@nebula-bots nebula-bots added process/done Process of bug and removed process/fixed Process of bug labels Jan 9, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
affects/master PR/issue: this bug affects master version. auto-sync process/done Process of bug severity/blocker Severity of bug type/bug Type: something is unexpected
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants