[v22.3.x] CI Failure (missing warning log line) in RpkRedpandaStartTest.test_rpc_tls_list

[andrwng]

https://buildkite.com/redpanda/redpanda/builds/24358#01877d40-e001-482b-9ec4-804abaa03d94

Module: rptest.tests.rpk_start_test
Class:  RpkRedpandaStartTest
Method: test_rpc_tls_list

test_id:    rptest.tests.rpk_start_test.RpkRedpandaStartTest.test_rpc_tls_list
status:     FAIL
run time:   8.057 seconds


    NameError("name 'line' is not defined")
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/dist-packages/ducktape/tests/runner_client.py", line 135, in run
    data = self.run_test()
  File "/usr/local/lib/python3.10/dist-packages/ducktape/tests/runner_client.py", line 227, in run_test
    return self.test_context.function(self.test)
  File "/root/tests/rptest/services/cluster.py", line 35, in wrapped
    r = f(self, *args, **kwargs)
  File "/root/tests/rptest/tests/rpk_start_test.py", line 345, in test_rpc_tls_list
    assert self.redpanda.search_log_all(
  File "/root/tests/rptest/services/redpanda.py", line 2429, in search_log_all
    f"Did not find {pattern} on node {node.name}: {line}")
NameError: name 'line' is not defined

The static error is a red herring: the actual error appears to be the fact that we're missing a log line (at least, I pulled one set of logs from a server and didn't see it).

[r-vasquez]

Unable to reproduce locally (it prints the warning): here and it gets redirected to the log and nothing has changed in the test apart for some cleanup improvements in the test.

Last successful test in this branch was yesterday: https://buildkite.com/redpanda/redpanda/builds/27441#018796f6-0385-430f-8a73-48e0523ac286/6-2453 in the tip of v22.3.x.

This warning line is the first thing in the log.

I requested the backport of the 2 missing PRs that helped with the node cleanup since it's my only hypothesis at the moment:

• [v22.3.x] duck: stop process in node before starting rp with rpk #10207
• [v22.3.x] tests: add wait_until for cluster start #10203

[r-vasquez]

Can we close this? since I merged the 2 PRs above we haven't hit this issue in 3 weeks.

[twmb]

Closing as this appears resolved.