Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add script to refresh testnet nodes #600

Merged
merged 2 commits into from
Jul 13, 2018
Merged

Conversation

mvines
Copy link
Member

@mvines mvines commented Jul 13, 2018

This moves our previous inline buildkite script out of the GUI, and adds support for validator refresh

Part of #598

@mvines mvines requested review from pgarg66 and rob-solana July 13, 2018 02:55
fi

# Default to --edge channel. To select the beta channel:
# export SOLANA_METRICS_CONFIG=--beta
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

When we're ready to flip to a tagged release, SOLANA_METRICS_CONFIG=--beta gets defined in the buildkite pipeline configuration

@mvines
Copy link
Member Author

mvines commented Jul 13, 2018

The validators are managed by this GCP instance group, https://console.cloud.google.com/compute/instanceGroups/details/us-west1/testnet-solana-com-validator, which means we can add/remove individual nodes trivially. They're all running in us-west1 right now, eventually we should run some in different regions of course but that's beyond 0.7.0

Here's what this script does when it runs: https://buildkite.com/solana-labs/testnet/builds/388#a1c0c680-c409-4c19-b31c-6e4bde05ba9a

It'll run every hour right now, just like the previous testnet refresh setup that was only managing the leader node

@mvines mvines added the work in progress This isn't quite right yet label Jul 13, 2018
@mvines
Copy link
Member Author

mvines commented Jul 13, 2018

Ah man, it's going to take too long to serially update all the validators. I need to run it all in parallel. Will need to push a new commit that does that before this PR can land

@mvines
Copy link
Member Author

mvines commented Jul 13, 2018

Fixed, 😅.
All 50 nodes now refresh in ~1 minute - https://buildkite.com/solana-labs/testnet/builds/390

@mvines mvines removed the work in progress This isn't quite right yet label Jul 13, 2018
Copy link
Contributor

@garious garious left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🥇

@mvines
Copy link
Member Author

mvines commented Jul 13, 2018

Landing to keep moving. Post-merge review welcome, will send follow-up PRs as needed

@mvines mvines merged commit 54db379 into solana-labs:master Jul 13, 2018
vkomenda pushed a commit to vkomenda/solana that referenced this pull request Aug 29, 2021
buffalojoec pushed a commit to buffalojoec/solana that referenced this pull request Apr 5, 2024
* Show staked vs nonstaked packets sent down

* add metrics on throttled staked vs non-staked
yihau pushed a commit that referenced this pull request Apr 11, 2024
… of #600) (#614)

* Show staked vs nonstaked packets sent down/throttled (#600)

* Show staked vs nonstaked packets sent down

* add metrics on throttled staked vs non-staked

(cherry picked from commit b443cfb)

# Conflicts:
#	streamer/src/quic.rs

* fix merge conflicts

---------

Co-authored-by: Lijun Wang <[email protected]>
Co-authored-by: HaoranYi <[email protected]>
yihau pushed a commit that referenced this pull request Apr 11, 2024
… of #600) (#613)

* Show staked vs nonstaked packets sent down/throttled (#600)

* Show staked vs nonstaked packets sent down

* add metrics on throttled staked vs non-staked

(cherry picked from commit b443cfb)

# Conflicts:
#	streamer/src/quic.rs

* fix merge conflicts

---------

Co-authored-by: Lijun Wang <[email protected]>
Co-authored-by: HaoranYi <[email protected]>
lijunwangs added a commit to lijunwangs/solana that referenced this pull request Apr 12, 2024
… of solana-labs#600) (solana-labs#613)

* Show staked vs nonstaked packets sent down/throttled (solana-labs#600)

* Show staked vs nonstaked packets sent down

* add metrics on throttled staked vs non-staked

(cherry picked from commit b443cfb)

# Conflicts:
#	streamer/src/quic.rs

* fix merge conflicts

---------

Co-authored-by: Lijun Wang <[email protected]>
Co-authored-by: HaoranYi <[email protected]>
lijunwangs added a commit to lijunwangs/solana that referenced this pull request Apr 18, 2024
* Show staked vs nonstaked packets sent down

* add metrics on throttled staked vs non-staked
lijunwangs added a commit to lijunwangs/solana that referenced this pull request Apr 24, 2024
… of solana-labs#600) (solana-labs#614)

* Show staked vs nonstaked packets sent down/throttled (solana-labs#600)

* Show staked vs nonstaked packets sent down

* add metrics on throttled staked vs non-staked

(cherry picked from commit b443cfb)

# Conflicts:
#	streamer/src/quic.rs

* fix merge conflicts

---------

Co-authored-by: Lijun Wang <[email protected]>
Co-authored-by: HaoranYi <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants