workflow: add cockroach-microbench-ci step in github actions

[sambhav-jain-16]

Fixes: #106661
Release note: None
Epic: https://cockroachlabs.atlassian.net/browse/CRDB-29662

This change intends to add a new CI step which will run BenchmarkKV microbenchmark for the current commit and compares the result with that of the base commit's results which is stored in a cloud bucket.

This is needed to avoid minor perf regressions so that any regression is caught in the PR itself. The current threshold is set to 5%.

There are highly 3 steps

1. Run benchmarks
2. If this is PR branch, download the latest commit of the target branch's bench results from the cloud storage and compare the results. If there's a regression fail here itself
3. If it is a push step (PR merge to master/release), upload the result to the cloud storage with the current commit sha.

Currently, this change won't block the PR. However it will still run the microbenchmarks and upload the results during the push step.

[cockroach-teamcity]

This change is 

[herkolategan]

Nice work. A few comments: I realised you might have copied some of my earlier work regarding using dev to build roachprod-microbench. I've been meaning to update it to use the CI way run_bazel rather. It should be an easy update here.

[rickystewart]

By the way, the build is failing, please have a look at that.

[sambhav-jain-16]

By the way, the build is failing, please have a look at that.

@rickystewart Fixed it. PTAL

[rickystewart]

Are you aware that the script in CI does not seem to be working correctly?

+ _bazel/bin/pkg/cmd/roachprod-microbench/roachprod-microbench_/roachprod-microbench clean ./artifacts/microbench/microbench.log ./artifacts/microbench/current/pkg_sql-report.log
+ false
+ gcloud storage cp gs://cockroach-microbench-ci/master/15efb7e2270b05f5c18183d30ae95a0eea8670ad.log ./artifacts/microbench/base/pkg_sql-report.log
  

ERROR: (gcloud.storage.cp) The following URLs matched no objects or files:
-gs://cockroach-microbench-ci/master/15efb7e2270b05f5c18183d30ae95a0eea8670ad.log
+ echo 'Couldn'\''t download base bench file, exiting.'
+ exit 0
Couldn't download base bench file, exiting.

[rickystewart]

Spoke with Herko and it seems the current behavior is expected so this is fine.

[sambhav-jain-16]

Spoke with Herko and it seems the current behavior is expected so this is fine.

Yes, this is expected since there's no bench file for the current latest master commit. Thanks for the review !

[sambhav-jain-16]

TFTR!

bors r=rickystewart,herkolategan

[craig]

Build succeeded:

• lint
• windows_build
• examples_orms
• check_generated_code
• local_roachtest_fips
• docker_image_amd64
• unit_tests
• linux_amd64_fips_build
• macos_arm64_build
• acceptance
• macos_amd64_build
• local_roachtest
• linux_arm64_build
• linux_amd64_build