-
Notifications
You must be signed in to change notification settings - Fork 3
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
DOC: adapts documentation for first-time users #28
Conversation
I did have one question on the "Using the start, status, and stop subcommands" subsection: why can't I run |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
A few nitpicks, and one thought about the already-running-job message, but otherwise LGTM
Yep, that should work just fine. I want there to be a workflow that doesn't involve Do note that it won't be quite as protected as the fully-detached |
Co-authored-by: Josh Karpel <[email protected]>
How can I be a good user so CHTC admins don't kill my jobs? I'm interested in running |
The main consideration is: try not to use large amounts of CPU, memory, or disk I/O on the submit node for longer than a few minutes at a time. The HTCondor daemons need those resources to serve other people's jobs. For a Dask workflow, this means making sure that you do all the heavy-duty computation through Dask, pulling only the minimal information back to the scheduler.
Right now, very few (for you; there are some incidental benefits for us). But we're hoping to be able to enforce resource limits by doing this, which will make CHTC admins much happier with this workflow. As far as I know, there shouldn't be a difference in the behavior of Jupyter once you've got it running - let me know if there is, so that we can fix it :) |
# Conflicts: # docs/source/index.rst
What does this PR implement?
This is my first time running Dask-CHTC. I've adapted the documentation for items I'd like to see in the documentation. So far, these are:
dask-chtc jupyter run lab
instead of that and the unusefuljupyter lab
.Reference issues/PRs
Other issues that came up in this first usage are #25, #26 and #27.