Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Agent always detect node IOPS to 0 #2825

Closed
mildred opened this issue Jul 12, 2017 · 8 comments
Closed

Agent always detect node IOPS to 0 #2825

mildred opened this issue Jul 12, 2017 · 8 comments

Comments

@mildred
Copy link
Contributor

mildred commented Jul 12, 2017

When starting a nomad agent on a node, it detects the available IOPS on that node to 0. it doesn't seem there is a way to override that.

Either you should allow the nomad agent to override the detected IOPS available (you kave a -network-speed option to override the network speed) and document it, or you should remove the IOPS information from the documentation.

@jippi
Copy link
Contributor

jippi commented Jul 12, 2017

It's a documentation issue.. IOPS can be configured inside the client{} stanza on the nomad client (see the source)

Simply add iops = 9999 to force it

Afaik nomad does no effort to detect the iops for a device, as there are no reliable way to do so. AWS could potentially be detected iops for based on the EBS volume, but probably not worth the effort

@mildred
Copy link
Contributor Author

mildred commented Jul 12, 2017

Isn't the location you linked in the source code a configuration option about reserved resources ? https://www.nomadproject.io/docs/agent/configuration/client.html#reserved

reserved (Reserved: nil) - Specifies that Nomad should reserve a portion of the node's resources from receiving tasks. This can be used to target a certain capacity usage for the node. For example, 20% of the node's CPU could be reserved to target a CPU utilization of 80%.

@jippi
Copy link
Contributor

jippi commented Jul 12, 2017

You are right @mildred - sorry :)

@schmichael
Copy link
Member

Right now specifying IOPS in a job only affects exec jobs. For those it is used to directly set the blkio.weight cgroup: https://www.kernel.org/doc/Documentation/cgroup-v1/blkio-controller.txt

That cgroup only accepts a weight from 10-1000, so there's nothing to detect or set for the client.

It should become a more portable IOP provisioning system in the future, but it's use is limited today. Sorry for the confusion! Our docs definitely don't explain it correctly!

@schmichael
Copy link
Member

Oops, but I neglected to notice that the scheduler treats IOPS as an absolute resource. So your bug is valid, and there's more to it than I originally suspected! Reopening.

@Miserlou
Copy link

Miserlou commented Oct 4, 2018

:[

It's been more than a year and the docs are still lying about this, is there anywhere to submit PRs to fix mistruthful docs?

@schmichael
Copy link
Member

is there anywhere to submit PRs to fix mistruthful docs?

Yes! You can submit a PR against our entire website as its located in the website/ subdirectory: https://github.com/hashicorp/nomad/tree/master/website

The readme covers building/testing locally.

@github-actions
Copy link

I'm going to lock this issue because it has been closed for 120 days ⏳. This helps our maintainers find and focus on the active issues.
If you have found a problem that seems similar to this, please open a new issue and complete the issue template so we can capture all the details necessary to investigate further.

@github-actions github-actions bot locked as resolved and limited conversation to collaborators Nov 27, 2022
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

4 participants