Skip to content

Commit 0a516f5

Browse files
Ken TakagiwaKen Takagiwa
authored andcommitted
add coment for hack why PYSPARK_PYTHON is needed in spark-submit
1 parent a7a0b5c commit 0a516f5

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

bin/spark-submit

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -45,7 +45,7 @@ DEPLOY_MODE=${DEPLOY_MODE:-"client"}
4545
# pythonExec(which python Spark should execute).
4646
# Since pyprint is located in DStream, Spark does not know which python should use.
4747
# In that case, get python path from PYSPARK_PYTHON, environmental variable.
48-
# This fix is ongoing in print branch in my repo.
48+
# This fix is ongoing in print branch in https://github.com/giwa/spark/tree/print.
4949

5050
# Figure out which Python executable to use
5151
if [[ -z "$PYSPARK_PYTHON" ]]; then

0 commit comments

Comments
 (0)