Skip to content

Commit ce483d7

Browse files
committed
SPARK-938 - Openstack Swift object storage support
This is initial documentation describing how to integrate Spark with Swift. This commit contains documentation for stand alone cluster. Next patches will contain details how to integrate Swift in other deployment of Spark.
1 parent b6c37ef commit ce483d7

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

docs/openstack-integration.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -60,7 +60,7 @@ Create core-sites.xml and place it under /spark/conf directory. Configure core-s
6060
<value>true</value>
6161
</property>
6262

63-
We left with `fs.swift.service.<PROVIDER>.tenant`, `fs.swift.service.<PROVIDER>.username`, `fs.swift.service.<PROVIDER>.password`. The best way is to provide them to SparkContext in run time, which seems to be impossible yet.
63+
We left with `fs.swift.service.<PROVIDER>.tenant`, `fs.swift.service.<PROVIDER>.username`, `fs.swift.service.<PROVIDER>.password`. The best way to provide those parameters to SparkContext in run time, which seems to be impossible yet.
6464
Another approach is to change Hadoop Swift FS driver to provide them via system environment variables. For now we provide them via core-sites.xml
6565

6666
<property>

0 commit comments

Comments
 (0)