Skip to content

Commit

Permalink
Avoid workers with no cores when over-subscribing workers
Browse files Browse the repository at this point in the history
  • Loading branch information
Allan Douglas R. de Oliveira committed May 3, 2014
1 parent 149c767 commit 65f0cfe
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion deploy_templates.py
Original file line number Diff line number Diff line change
Expand Up @@ -51,7 +51,7 @@

worker_instances = int(os.getenv("SPARK_WORKER_INSTANCES", 1))
# Distribute equally cpu cores among worker instances
worker_cores = slave_cpus / worker_instances
worker_cores = max(slave_cpus / worker_instances, 1)

template_vars = {
"master_list": os.getenv("MASTERS"),
Expand Down

0 comments on commit 65f0cfe

Please sign in to comment.