Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Failure in ScalingUpTest.test_adding_multiple_nodes_to_the_cluster #7398

Closed
jcsp opened this issue Nov 21, 2022 · 1 comment
Closed

Failure in ScalingUpTest.test_adding_multiple_nodes_to_the_cluster #7398

jcsp opened this issue Nov 21, 2022 · 1 comment
Assignees
Labels

Comments

@jcsp
Copy link
Contributor

jcsp commented Nov 21, 2022

failure at 2022-11-21T08:03:37.606Z: TimeoutError('Timed out after 120s while awaiting record consumption of 1500000 records')
in job https://buildkite.com/redpanda/redpanda/builds/18850#018498b4-885b-4759-a57d-1ffce6c33ecc
failure at 2022-11-21T07:33:12.178Z: TimeoutError('Timed out after 120s while awaiting record consumption of 1500000 records')
in job https://buildkite.com/redpanda/redpanda/builds/18847#01849898-f4c2-4f40-89cb-1e7b58be4062
failure at 2022-11-19T20:01:34.430Z: TimeoutError('Timed out after 120s while awaiting record consumption of 1500000 records')
in job https://buildkite.com/redpanda/redpanda/builds/18834#018490fa-0cc1-43b1-8adc-de8c7f8e2029

Traceback (most recent call last):
  File "/usr/local/lib/python3.10/dist-packages/ducktape/tests/runner_client.py", line 135, in run
    data = self.run_test()
  File "/usr/local/lib/python3.10/dist-packages/ducktape/tests/runner_client.py", line 227, in run_test
    return self.test_context.function(self.test)
  File "/root/tests/rptest/services/cluster.py", line 35, in wrapped
    r = f(self, *args, **kwargs)
  File "/root/tests/rptest/tests/scaling_up_test.py", line 142, in test_adding_multiple_nodes_to_the_cluster
    self.await_startup(min_records=15 * throughput, timeout_sec=120)
  File "/root/tests/rptest/tests/end_to_end.py", line 241, in await_startup
    self.await_num_consumed(min_records, timeout_sec)
  File "/root/tests/rptest/tests/end_to_end.py", line 224, in await_num_consumed
    wait_until(lambda: self.consumer.total_consumed() >= min_records,
  File "/usr/local/lib/python3.10/dist-packages/ducktape/utils/util.py", line 57, in wait_until
    raise TimeoutError(err_msg() if callable(err_msg) else err_msg) from last_exception
ducktape.errors.TimeoutError: Timed out after 120s while awaiting record consumption of 1500000 records
@jcsp jcsp added kind/bug Something isn't working area/controller ci-failure labels Nov 21, 2022
@mmaslankaprv mmaslankaprv self-assigned this Nov 21, 2022
@mmaslankaprv
Copy link
Member

As a part of another fix i decreased the number of messages to be consumed before adding another nodes to the cluster. this issue should be fixed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants