Skip to content

Commit

Permalink
Doc: update hadoop document. (intel-analytics#5623)
Browse files Browse the repository at this point in the history
* doc: update hadoop document.

* fix: fix wording.

* fix: fix wording.

* fix: fix wording.
  • Loading branch information
lalalapotter authored and ForJadeForest committed Sep 20, 2022
1 parent 2fd9dfc commit f837c8f
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions docs/readthedocs/source/doc/UserGuide/hadoop.md
Original file line number Diff line number Diff line change
Expand Up @@ -119,7 +119,7 @@ Follow the steps below if you need to run BigDL with [spark-submit](https://spar
--archives environment.tar.gz#environment \
script.py
```
Note: For `yarn-client`, the Spark driver is running on local and it will use the Python interpreter in the current active conda environment while the executors will use the Python interpreter in `environment.tar.gz`.
Note: For `yarn-cluster`, the Spark driver is running in a YARN container as well and thus both the driver and executors will use the Python interpreter in `environment.tar.gz`. If you want to operate HDFS as some certain user, you can add `spark.yarn.appMasterEnv.HADOOP_USER_NAME=username` to SparkConf.


For `yarn-client` mode:
Expand All @@ -134,4 +134,4 @@ Follow the steps below if you need to run BigDL with [spark-submit](https://spar
--archives environment.tar.gz#environment \
script.py
```
Note: For `yarn-cluster`, the Spark driver is running in a YARN container as well and thus both the driver and executors will use the Python interpreter in `environment.tar.gz`.
Note: For `yarn-client`, the Spark driver is running on local and it will use the Python interpreter in the current active conda environment while the executors will use the Python interpreter in `environment.tar.gz`.

0 comments on commit f837c8f

Please sign in to comment.