Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Oversized allocation: 393216 bytes in kafka::op_context::create_response_placeholders #11017

Closed
dlex opened this issue May 24, 2023 · 0 comments · Fixed by #11181
Closed

Oversized allocation: 393216 bytes in kafka::op_context::create_response_placeholders #11017

dlex opened this issue May 24, 2023 · 0 comments · Fixed by #11181
Assignees

Comments

@dlex
Copy link
Contributor

dlex commented May 24, 2023

on (amd64, VM) in job https://buildkite.com/redpanda/vtools/builds/7528#01881429-6a58-4a0b-b50e-51408b80ff78

test_id:    rptest.scale_tests.many_partitions_test.ManyPartitionsTest.test_many_partitions

While doing

std::vector<kafka::fetchable_partition_response>::push_back(kafka::fetchable_partition_response&&)

Backtrace:

[Backtrace #0]
void seastar::backtrace<seastar::current_backtrace_tasklocal()::$_3>(seastar::current_backtrace_tasklocal()::$_3&&) at /v/build/v_deps_build/seastar-prefix/src/seastar/include/seastar/util/backtrace.hh:60
 (inlined by) seastar::current_backtrace_tasklocal() at /v/build/v_deps_build/seastar-prefix/src/seastar/src/util/backtrace.cc:86
 (inlined by) seastar::current_tasktrace() at /v/build/v_deps_build/seastar-prefix/src/seastar/src/util/backtrace.cc:137
 (inlined by) seastar::current_backtrace() at /v/build/v_deps_build/seastar-prefix/src/seastar/src/util/backtrace.cc:170
seastar::memory::cpu_pages::warn_large_allocation(unsigned long) at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/memory.cc:780
 (inlined by) seastar::memory::cpu_pages::check_large_allocation(unsigned long) at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/memory.cc:788
 (inlined by) seastar::memory::cpu_pages::allocate_large(unsigned int) at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/memory.cc:794
 (inlined by) seastar::memory::allocate_large(unsigned long) at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/memory.cc:1345
 (inlined by) seastar::memory::allocate(unsigned long) at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/memory.cc:1406
operator new(unsigned long) at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/memory.cc:2087
void* std::__1::__libcpp_operator_new<unsigned long>(unsigned long) at /vectorized/llvm/bin/../include/c++/v1/new:245
 (inlined by) std::__1::__libcpp_allocate(unsigned long, unsigned long) at /vectorized/llvm/bin/../include/c++/v1/new:271
 (inlined by) std::__1::allocator<kafka::fetchable_partition_response>::allocate(unsigned long) at /vectorized/llvm/bin/../include/c++/v1/__memory/allocator.h:105
 (inlined by) std::__1::allocator_traits<std::__1::allocator<kafka::fetchable_partition_response> >::allocate(std::__1::allocator<kafka::fetchable_partition_response>&, unsigned long) at /vectorized/llvm/bin/../include/c++/v1/__memory/allocator_traits.h:262
 (inlined by) __split_buffer at /vectorized/llvm/bin/../include/c++/v1/__split_buffer:306
 (inlined by) void std::__1::vector<kafka::fetchable_partition_response, std::__1::allocator<kafka::fetchable_partition_response> >::__push_back_slow_path<kafka::fetchable_partition_response>(kafka::fetchable_partition_response&&) at /vectorized/llvm/bin/../include/c++/v1/vector:1517
std::__1::vector<kafka::fetchable_partition_response, std::__1::allocator<kafka::fetchable_partition_response> >::push_back(kafka::fetchable_partition_response&&) at /vectorized/llvm/bin/../include/c++/v1/vector:1549
 (inlined by) operator() at /var/lib/buildkite-agent/builds/buildkite-amd64-builders-i-0168f1d5f24b16251-1/redpanda/redpanda/src/v/kafka/server/handlers/fetch.cc:852
 (inlined by) kafka::op_context::create_response_placeholders()::$_6 std::__1::for_each<boost::iterators::transform_iterator<kafka::fetch_partitions_linked_hash_map::make_partition_iterator(boost::intrusive::list_iterator<boost::intrusive::mhtraits<kafka::fetch_partitions_linked_hash_map::entry, boost::intrusive::list_member_hook<boost::intrusive::link_mode<(boost::intrusive::link_mode_type)2> >, &kafka::fetch_partitions_linked_hash_map::entry::_hook>, true>)::{lambda(kafka::fetch_partitions_linked_hash_map::entry const&)#1}, boost::intrusive::list_iterator<boost::intrusive::mhtraits<kafka::fetch_partitions_linked_hash_map::entry, boost::intrusive::list_member_hook<boost::intrusive::link_mode<(boost::intrusive::link_mode_type)2> >, &kafka::fetch_partitions_linked_hash_map::entry::_hook>, true>, boost::use_default, boost::use_default>, kafka::op_context::create_response_placeholders()::$_6>(boost::iterators::transform_iterator<kafka::fetch_partitions_linked_hash_map::make_partition_iterator(boost::intrusive::list_iterator<boost::intrusive::mhtraits<kafka::fetch_partitions_linked_hash_map::entry, boost::intrusive::list_member_hook<boost::intrusive::link_mode<(boost::intrusive::link_mode_type)2> >, &kafka::fetch_partitions_linked_hash_map::entry::_hook>, true>)::{lambda(kafka::fetch_partitions_linked_hash_map::entry const&)#1}, boost::intrusive::list_iterator<boost::intrusive::mhtraits<kafka::fetch_partitions_linked_hash_map::entry, boost::intrusive::list_member_hook<boost::intrusive::link_mode<(boost::intrusive::link_mode_type)2> >, &kafka::fetch_partitions_linked_hash_map::entry::_hook>, true>, boost::use_default, boost::use_default>, boost::iterators::transform_iterator<kafka::fetch_partitions_linked_hash_map::make_partition_iterator(boost::intrusive::list_iterator<boost::intrusive::mhtraits<kafka::fetch_partitions_linked_hash_map::entry, boost::intrusive::list_member_hook<boost::intrusive::link_mode<(boost::intrusive::link_mode_type)2> >, &kafka::fetch_partitions_linked_hash_map::entry::_hook>, true>)::{lambda(kafka::fetch_partitions_linked_hash_map::entry const&)#1}, boost::intrusive::list_iterator<boost::intrusive::mhtraits<kafka::fetch_partitions_linked_hash_map::entry, boost::intrusive::list_member_hook<boost::intrusive::link_mode<(boost::intrusive::link_mode_type)2> >, &kafka::fetch_partitions_linked_hash_map::entry::_hook>, true>, boost::use_default, boost::use_default>, kafka::op_context::create_response_placeholders()::$_6) at /vectorized/llvm/bin/../include/c++/v1/__algorithm/for_each.h:26
 (inlined by) kafka::op_context::create_response_placeholders() at /var/lib/buildkite-agent/builds/buildkite-amd64-builders-i-0168f1d5f24b16251-1/redpanda/redpanda/src/v/kafka/server/handlers/fetch.cc:836
op_context at /var/lib/buildkite-agent/builds/buildkite-amd64-builders-i-0168f1d5f24b16251-1/redpanda/redpanda/src/v/kafka/server/handlers/fetch.cc:803
std::__1::__unique_if<kafka::op_context>::__unique_single std::__1::make_unique<kafka::op_context, kafka::request_context, seastar::smp_service_group&>(kafka::request_context&&, seastar::smp_service_group&) at /vectorized/llvm/bin/../include/c++/v1/__memory/unique_ptr.h:725
 (inlined by) kafka::handler_template<kafka::fetch_api, (short)4, (short)11, seastar::future<seastar::foreign_ptr<std::__1::unique_ptr<kafka::response, std::__1::default_delete<kafka::response> > > >, &kafka::fetch_memory_estimator>::handle(kafka::request_context, seastar::smp_service_group) at /var/lib/buildkite-agent/builds/buildkite-amd64-builders-i-0168f1d5f24b16251-1/redpanda/redpanda/src/v/kafka/server/handlers/fetch.cc:748
kafka::handler_base<false>::handle(kafka::request_context&&, seastar::smp_service_group) const at /var/lib/buildkite-agent/builds/buildkite-amd64-builders-i-0168f1d5f24b16251-1/redpanda/redpanda/src/v/kafka/server/handlers/handler_interface.cc:88
kafka::process_generic(kafka::handler_interface const*, kafka::request_context&&, seastar::smp_service_group, kafka::session_resources const&) at /var/lib/buildkite-agent/builds/buildkite-amd64-builders-i-0168f1d5f24b16251-1/redpanda/redpanda/src/v/kafka/server/requests.cc:110
kafka::process_request(kafka::request_context&&, seastar::smp_service_group, kafka::session_resources const&) at /var/lib/buildkite-agent/builds/buildkite-amd64-builders-i-0168f1d5f24b16251-1/redpanda/redpanda/src/v/kafka/server/requests.cc:286
operator() at /var/lib/buildkite-agent/builds/buildkite-amd64-builders-i-0168f1d5f24b16251-1/redpanda/redpanda/src/v/kafka/server/connection_context.cc:374
decltype ((static_cast<kafka::connection_context::dispatch_method_once(kafka::request_header, unsigned long)::$_2::operator()(kafka::session_resources)::{lambda(iobuf)#1}&>({parm#1}))(static_cast<iobuf>({parm#2}))) std::__1::__invoke<kafka::connection_context::dispatch_method_once(kafka::request_header, unsigned long)::$_2::operator()(kafka::session_resources)::{lambda(iobuf)#1}&, iobuf>(kafka::connection_context::dispatch_method_once(kafka::request_header, unsigned long)::$_2::operator()(kafka::session_resources)::{lambda(iobuf)#1}&, iobuf&&) at /vectorized/llvm/bin/../include/c++/v1/type_traits:3640
 (inlined by) std::__1::invoke_result<kafka::connection_context::dispatch_method_once(kafka::request_header, unsigned long)::$_2::operator()(kafka::session_resources)::{lambda(iobuf)#1}&, iobuf>::type std::__1::invoke<kafka::connection_context::dispatch_method_once(kafka::request_header, unsigned long)::$_2::operator()(kafka::session_resources)::{lambda(iobuf)#1}&, iobuf>(kafka::connection_context::dispatch_method_once(kafka::request_header, unsigned long)::$_2::operator()(kafka::session_resources)::{lambda(iobuf)#1}&, iobuf&&) at /vectorized/llvm/bin/../include/c++/v1/__functional/invoke.h:93
 (inlined by) auto seastar::internal::future_invoke<kafka::connection_context::dispatch_method_once(kafka::request_header, unsigned long)::$_2::operator()(kafka::session_resources)::{lambda(iobuf)#1}&, iobuf>(kafka::connection_context::dispatch_method_once(kafka::request_header, unsigned long)::$_2::operator()(kafka::session_resources)::{lambda(iobuf)#1}&, iobuf&&) at /vectorized/include/seastar/core/future.hh:1155
 (inlined by) operator() at /vectorized/include/seastar/core/future.hh:1455
 (inlined by) void seastar::futurize<seastar::future<void> >::satisfy_with_result_of<seastar::future<iobuf>::then_impl_nrvo<kafka::connection_context::dispatch_method_once(kafka::request_header, unsigned long)::$_2::operator()(kafka::session_resources)::{lambda(iobuf)#1}, seastar::future<void> >(kafka::connection_context::dispatch_method_once(kafka::request_header, unsigned long)::$_2::operator()(kafka::session_resources)::{lambda(iobuf)#1}&&)::{lambda(seastar::internal::promise_base_with_type<void>&&, kafka::connection_context::dispatch_method_once(kafka::request_header, unsigned long)::$_2::operator()(kafka::session_resources)::{lambda(iobuf)#1}&, seastar::future_state<iobuf>&&)#1}::operator()(seastar::internal::promise_base_with_type<void>&&, kafka::connection_context::dispatch_method_once(kafka::request_header, unsigned long)::$_2::operator()(kafka::session_resources)::{lambda(iobuf)#1}&, seastar::future_state<iobuf>&&) const::{lambda()#1}>(seastar::internal::promise_base_with_type<void>&&, kafka::connection_context::dispatch_method_once(kafka::request_header, unsigned long)::$_2::operator()(kafka::session_resources)::{lambda(iobuf)#1}&&) at /vectorized/include/seastar/core/future.hh:1984
 (inlined by) operator() at /vectorized/include/seastar/core/future.hh:1451
 (inlined by) seastar::continuation<seastar::internal::promise_base_with_type<void>, kafka::connection_context::dispatch_method_once(kafka::request_header, unsigned long)::$_2::operator()(kafka::session_resources)::{lambda(iobuf)#1}, seastar::future<iobuf>::then_impl_nrvo<kafka::connection_context::dispatch_method_once(kafka::request_header, unsigned long)::$_2::operator()(kafka::session_resources)::{lambda(iobuf)#1}, seastar::future<void> >(kafka::connection_context::dispatch_method_once(kafka::request_header, unsigned long)::$_2::operator()(kafka::session_resources)::{lambda(iobuf)#1}&&)::{lambda(seastar::internal::promise_base_with_type<void>&&, kafka::connection_context::dispatch_method_once(kafka::request_header, unsigned long)::$_2::operator()(kafka::session_resources)::{lambda(iobuf)#1}&, seastar::future_state<iobuf>&&)#1}, iobuf>::run_and_dispose() at /vectorized/include/seastar/core/future.hh:742
seastar::reactor::run_tasks(seastar::reactor::task_queue&) at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/reactor.cc:2557
 (inlined by) seastar::reactor::run_some_tasks() at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/reactor.cc:3020
seastar::reactor::do_run() at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/reactor.cc:3189
seastar::reactor::run() at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/reactor.cc:3072
seastar::app_template::run_deprecated(int, char**, std::__1::function<void ()>&&) at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/app-template.cc:265
seastar::app_template::run(int, char**, std::__1::function<seastar::future<int> ()>&&) at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/app-template.cc:156
application::run(int, char**) at /var/lib/buildkite-agent/builds/buildkite-amd64-builders-i-0168f1d5f24b16251-1/redpanda/redpanda/src/v/redpanda/application.cc:349
main at /var/lib/buildkite-agent/builds/buildkite-amd64-builders-i-0168f1d5f24b16251-1/redpanda/redpanda/src/v/redpanda/main.cc:22
@BenPope BenPope self-assigned this Jun 2, 2023
BenPope added a commit to BenPope/redpanda that referenced this issue Jun 3, 2023
BenPope added a commit to BenPope/redpanda that referenced this issue Jun 3, 2023
BenPope added a commit to BenPope/redpanda that referenced this issue Oct 2, 2023
BenPope added a commit to BenPope/redpanda that referenced this issue Oct 2, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants