Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Audit each individual thread pool size #35

Open
steviez opened this issue Mar 4, 2024 · 0 comments
Open

Audit each individual thread pool size #35

steviez opened this issue Mar 4, 2024 · 0 comments
Assignees

Comments

@steviez
Copy link

steviez commented Mar 4, 2024

Problem

The solana-validator process creates a lot of threads, including a number of threadpools. A staked node running v1.17 was observed to have more than 800 threads. The exact number may vary a little depending on some configuration as well as the number of physical cores the machine has (several pools scale with the number of cores). This is a lot of threads, and all of these threads add non-trivial overhead to the system.

Proposed Solution

Examine each thread pool more closely, and reduce thread pool sizes where appropriate. Even if a particular workflow actually utilizes a very high level of parallelism, it may be the case that we should still put a hard upper bound in place instead of letting the thread pool size scale with the number of cores.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: In Progress
Development

No branches or pull requests

1 participant