-
Notifications
You must be signed in to change notification settings - Fork 3.8k
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
87938: bazci: move the logic of posting github issues to bazci r=srosenberg a=healthy-pod This code change moves the logic of filtering tests JSON output files and posting github issues to bazci. Release note: None Epic CRDB-15060 89257: upgrades: remove unused struct field r=stevendanna a=stevendanna Epic: None Release note: None 89873: cliccl: add `encryption-registry-list` command r=jbowenns a=nicktrav The existing `enc_util` package contains a tool that could be used to dump the files in an encryption registry. This command has been broken since the file registry format was updated. Add the `(*PebbleFileRegistry).List` function, that returns a map of files in the registry. Adapt existing test cases. Add a `debug encryption-registry-list` command that will print all files contained in the registry of an encrypted store. This is useful for debugging which store / data key was used to encrypt each file, replacing the equivalent functionality in `enc_util`. Touches: #89095. Epic: None. Release note (ops change): Adds a new command that can be used by an operator to list the files present in the Encryption-At-Rest file registry. 89988: rangedesciter: carve out library for range desc iteration r=irfansharif a=irfansharif Informs #87503; pure code-movement. Going to use it in future commits as part of multi-tenant replication reports (#89987) where we'll need to iterate over the set of range descriptors. Release note: None Co-authored-by: healthy-pod <[email protected]> Co-authored-by: Steven Danna <[email protected]> Co-authored-by: Nick Travers <[email protected]> Co-authored-by: irfan sharif <[email protected]>
- Loading branch information
Showing
61 changed files
with
1,802 additions
and
1,363 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
14 changes: 3 additions & 11 deletions
14
build/teamcity/cockroach/nightlies/pebble_nightly_metamorphic_impl.sh
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,37 +1,29 @@ | ||
#!/usr/bin/env bash | ||
|
||
dir="$(dirname $(dirname $(dirname $(dirname "${0}"))))" | ||
source "$dir/teamcity-bazel-support.sh" # For process_test_json | ||
|
||
set -euxo pipefail | ||
ARTIFACTS_DIR=/artifacts/meta | ||
mkdir -p $ARTIFACTS_DIR | ||
GO_TEST_JSON_OUTPUT_FILE=/artifacts/test.json.txt | ||
|
||
echo "TC_SERVER_URL is $TC_SERVER_URL" | ||
|
||
bazel build //pkg/cmd/bazci //pkg/cmd/github-post //pkg/cmd/testfilter --config=ci | ||
bazel build //pkg/cmd/bazci --config=ci | ||
|
||
BAZEL_BIN=$(bazel info bazel-bin --config ci) | ||
|
||
exit_status=0 | ||
# NB: If adjusting the metamorphic test flags below, be sure to also update | ||
# pkg/cmd/github-post/main.go to ensure the GitHub issue poster includes the | ||
# correct flags in the reproduction command. | ||
$BAZEL_BIN/pkg/cmd/bazci/bazci_/bazci -- test --config=ci \ | ||
$BAZEL_BIN/pkg/cmd/bazci/bazci_/bazci --process_test_failures --formatter=pebble-metamorphic -- test --config=ci \ | ||
@com_github_cockroachdb_pebble//internal/metamorphic:metamorphic_test \ | ||
--test_timeout=25200 '--test_filter=TestMeta$' \ | ||
--define gotags=bazel,invariants \ | ||
"--test_env=GO_TEST_JSON_OUTPUT_FILE=$GO_TEST_JSON_OUTPUT_FILE" \ | ||
--run_under "@com_github_cockroachdb_stress//:stress -bazel -shardable-artifacts 'GO_TEST_JSON_OUTPUT_FILE=cat,XML_OUTPUT_FILE=$BAZEL_BIN/pkg/cmd/bazci/bazci_/bazci merge-test-xmls' -maxtime 6h -maxfails 1 -stderr -p 1" \ | ||
--run_under "@com_github_cockroachdb_stress//:stress -bazel -shardable-artifacts 'XML_OUTPUT_FILE=$BAZEL_BIN/pkg/cmd/bazci/bazci_/bazci merge-test-xmls' -maxtime 6h -maxfails 1 -stderr -p 1" \ | ||
--test_arg -dir --test_arg $ARTIFACTS_DIR \ | ||
--test_arg -ops --test_arg "uniform:5000-10000" \ | ||
--test_output streamed \ | ||
|| exit_status=$? | ||
|
||
BAZEL_SUPPORT_EXTRA_GITHUB_POST_ARGS=--formatter=pebble-metamorphic process_test_json \ | ||
$BAZEL_BIN/pkg/cmd/testfilter/testfilter_/testfilter \ | ||
$BAZEL_BIN/pkg/cmd/github-post/github-post_/github-post \ | ||
/artifacts $GO_TEST_JSON_OUTPUT_FILE $exit_status | ||
|
||
exit $exit_status |
14 changes: 3 additions & 11 deletions
14
build/teamcity/cockroach/nightlies/pebble_nightly_metamorphic_race_impl.sh
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,37 +1,29 @@ | ||
#!/usr/bin/env bash | ||
|
||
dir="$(dirname $(dirname $(dirname $(dirname "${0}"))))" | ||
source "$dir/teamcity-bazel-support.sh" # For process_test_json | ||
|
||
set -euxo pipefail | ||
ARTIFACTS_DIR=/artifacts/meta | ||
mkdir -p $ARTIFACTS_DIR | ||
GO_TEST_JSON_OUTPUT_FILE=/artifacts/test.json.txt | ||
|
||
echo "TC_SERVER_URL is $TC_SERVER_URL" | ||
|
||
bazel build //pkg/cmd/bazci //pkg/cmd/github-post //pkg/cmd/testfilter --config=ci | ||
bazel build //pkg/cmd/bazci --config=ci | ||
|
||
BAZEL_BIN=$(bazel info bazel-bin --config ci) | ||
|
||
exit_status=0 | ||
# NB: If adjusting the metamorphic test flags below, be sure to also update | ||
# pkg/cmd/github-post/main.go to ensure the GitHub issue poster includes the | ||
# correct flags in the reproduction command. | ||
$BAZEL_BIN/pkg/cmd/bazci/bazci_/bazci -- test --config=race --config=ci \ | ||
$BAZEL_BIN/pkg/cmd/bazci/bazci_/bazci --process_test_failures --formatter=pebble-metamorphic -- test --config=race --config=ci \ | ||
@com_github_cockroachdb_pebble//internal/metamorphic:metamorphic_test \ | ||
--test_timeout=14400 '--test_filter=TestMeta$' \ | ||
--define gotags=bazel,invariants \ | ||
"--test_env=GO_TEST_JSON_OUTPUT_FILE=$GO_TEST_JSON_OUTPUT_FILE" \ | ||
--run_under "@com_github_cockroachdb_stress//:stress -bazel -shardable-artifacts 'GO_TEST_JSON_OUTPUT_FILE=cat,XML_OUTPUT_FILE=$BAZEL_BIN/pkg/cmd/bazci/bazci_/bazci merge-test-xmls' -maxtime 3h -maxfails 1 -stderr -p 1" \ | ||
--run_under "@com_github_cockroachdb_stress//:stress -bazel -shardable-artifacts 'XML_OUTPUT_FILE=$BAZEL_BIN/pkg/cmd/bazci/bazci_/bazci merge-test-xmls' -maxtime 3h -maxfails 1 -stderr -p 1" \ | ||
--test_arg -dir --test_arg $ARTIFACTS_DIR \ | ||
--test_arg -ops --test_arg "uniform:5000-10000" \ | ||
--test_output streamed \ | ||
|| exit_status=$? | ||
|
||
BAZEL_SUPPORT_EXTRA_GITHUB_POST_ARGS=--formatter=pebble-metamorphic process_test_json \ | ||
$BAZEL_BIN/pkg/cmd/testfilter/testfilter_/testfilter \ | ||
$BAZEL_BIN/pkg/cmd/github-post/github-post_/github-post \ | ||
/artifacts $GO_TEST_JSON_OUTPUT_FILE $exit_status | ||
|
||
exit $exit_status |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.