Skip to content

Commit

Permalink
Addressed docs comments
Browse files Browse the repository at this point in the history
  • Loading branch information
liyinan926 committed Dec 9, 2017
1 parent 7d2b303 commit caf2206
Show file tree
Hide file tree
Showing 2 changed files with 6 additions and 4 deletions.
6 changes: 4 additions & 2 deletions docs/configuration.md
Original file line number Diff line number Diff line change
Expand Up @@ -163,7 +163,8 @@ of the most common options to set are:
<td>
The amount of off-heap memory (in megabytes) to be allocated per driver in cluster mode. This is
memory that accounts for things like VM overheads, interned strings, other native overheads, etc.
This tends to grow with the container size (typically 6-10%).
This tends to grow with the container size (typically 6-10%). This option is supported in Yarn
mode and Kubernetes mode.
</td>
</tr>
<tr>
Expand All @@ -179,7 +180,8 @@ of the most common options to set are:
<td>
The amount of off-heap memory (in megabytes) to be allocated per executor. This is memory that
accounts for things like VM overheads, interned strings, other native overheads, etc. This tends
to grow with the executor size (typically 6-10%).
to grow with the executor size (typically 6-10%). This option is supported in Yarn mode and
Kubernetes mode.
</td>
</tr>
<tr>
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -131,15 +131,15 @@ private[spark] object Config extends Logging {
.checkValue(interval => interval > 0, s"Logging interval must be a positive time value.")
.createWithDefaultString("1s")

private[spark] val JARS_DOWNLOAD_LOCATION =
val JARS_DOWNLOAD_LOCATION =
ConfigBuilder("spark.kubernetes.mountDependencies.jarsDownloadDir")
.doc("Location to download jars to in the driver and executors. When using" +
" spark-submit, this directory must be empty and will be mounted as an empty directory" +
" volume on the driver and executor pod.")
.stringConf
.createWithDefault("/var/spark-data/spark-jars")

private[spark] val FILES_DOWNLOAD_LOCATION =
val FILES_DOWNLOAD_LOCATION =
ConfigBuilder("spark.kubernetes.mountDependencies.filesDownloadDir")
.doc("Location to download files to in the driver and executors. When using" +
" spark-submit, this directory must be empty and will be mounted as an empty directory" +
Expand Down

0 comments on commit caf2206

Please sign in to comment.