Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Windows][PySpark] Error: Cannot Find File #18

Closed
nihalsoans91 opened this issue Jan 25, 2018 · 2 comments
Closed

[Windows][PySpark] Error: Cannot Find File #18

nihalsoans91 opened this issue Jan 25, 2018 · 2 comments
Assignees

Comments

@nihalsoans91
Copy link
Contributor

FileNotFoundError: [WinError 2] The system cannot find the file specified

This error Appears at the line sc=SparkContext

@nihalsoans91 nihalsoans91 self-assigned this Jan 25, 2018
@nihalsoans91
Copy link
Contributor Author

The Issue for this is the Environment Variable is not Set correctly.
PYSPARK_PYTHON should point to the python.exe
This Python.exe has to be the one in the environment
For Example: If you are using Anaconda then you will have to point it to the python .exe in that environment.

@nihalsoans91 nihalsoans91 changed the title Error: Cannot Find File On Windows + PyCharm [Windows][PySpark] Error: Cannot Find File Jan 25, 2018
@ismailsajjadnbs
Copy link

add spark_home and hadoop_home path in system variables path list and user variable path list as well....
restart the machine..

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants