Move benchmark tests outside of tests directory

[ocelotl]

Describe your environment

OS: (e.g, Ubuntu)
Python version: (e.g., Python 3.8.10)
SDK version: (e.g., 1.25.0)
API version: (e.g., 1.25.0)

What happened?

Benchmark tests are inside tests directory.

Steps to Reproduce

Just look at tests.

Expected Result

No benchmarks in tests directory.

Actual Result

So many benchmark tests in tests directory

Additional context

So, I fixed the issue with benchmarks being run in CI at #4019 but just having them somewhere else is a much better solution that does not require ifs in our github workflows. Fix that.

Would you like to implement a fix?

None