Skip to content

Commit 1c5ac08

Browse files
committed
Update building Spark docs and remove unnecessary newline
1 parent 9c1421c commit 1c5ac08

File tree

2 files changed

+3
-24
lines changed

2 files changed

+3
-24
lines changed

docs/building-spark.md

Lines changed: 2 additions & 23 deletions
Original file line numberDiff line numberDiff line change
@@ -60,32 +60,11 @@ mvn -Dhadoop.version=2.0.0-mr1-cdh4.2.0 -DskipTests clean package
6060
mvn -Phadoop-0.23 -Dhadoop.version=0.23.7 -DskipTests clean package
6161
{% endhighlight %}
6262

63-
For Apache Hadoop 2.x, 0.23.x, Cloudera CDH, and other Hadoop versions with YARN, you can enable the "yarn-alpha" or "yarn" profile and optionally set the "yarn.version" property if it is different from "hadoop.version". The additional build profile required depends on the YARN version:
64-
65-
<table class="table">
66-
<thead>
67-
<tr><th>YARN version</th><th>Profile required</th></tr>
68-
</thead>
69-
<tbody>
70-
<tr><td>0.23.x to 2.1.x</td><td>yarn-alpha (Deprecated.)</td></tr>
71-
<tr><td>2.2.x and later</td><td>yarn</td></tr>
72-
</tbody>
73-
</table>
74-
75-
Note: Support for YARN-alpha API's will be removed in Spark 1.3 (see SPARK-3445).
63+
For Apache Hadoop 2.x, 0.23.x, Cloudera CDH, and other Hadoop versions with YARN, you can enable the "yarn" profile and optionally set the "yarn.version" property if it is different from "hadoop.version". As of Spark 1.3, Spark only supports YARN versions 2.2.0 and later.
7664

7765
Examples:
7866

7967
{% highlight bash %}
80-
# Apache Hadoop 2.0.5-alpha
81-
mvn -Pyarn-alpha -Dhadoop.version=2.0.5-alpha -DskipTests clean package
82-
83-
# Cloudera CDH 4.2.0
84-
mvn -Pyarn-alpha -Dhadoop.version=2.0.0-cdh4.2.0 -DskipTests clean package
85-
86-
# Apache Hadoop 0.23.x
87-
mvn -Pyarn-alpha -Phadoop-0.23 -Dhadoop.version=0.23.7 -DskipTests clean package
88-
8968
# Apache Hadoop 2.2.X
9069
mvn -Pyarn -Phadoop-2.2 -Dhadoop.version=2.2.0 -DskipTests clean package
9170

@@ -99,7 +78,7 @@ Versions of Hadoop after 2.5.X may or may not work with the -Phadoop-2.4 profile
9978
released after this version of Spark).
10079

10180
# Different versions of HDFS and YARN.
102-
mvn -Pyarn-alpha -Phadoop-2.3 -Dhadoop.version=2.3.0 -Dyarn.version=0.23.7 -DskipTests clean package
81+
mvn -Pyarn -Phadoop-2.3 -Dhadoop.version=2.3.0 -Dyarn.version=2.2.0 -DskipTests clean package
10382
{% endhighlight %}
10483

10584
# Building With Hive and JDBC Support

yarn/src/main/scala/org/apache/spark/deploy/yarn/ClientArguments.scala

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -183,7 +183,7 @@ private[spark] class ClientArguments(args: Array[String], sparkConf: SparkConf)
183183
|Options:
184184
| --jar JAR_PATH Path to your application's JAR file (required in yarn-cluster
185185
| mode)
186-
| --class CLASS_NAME Name of your application's main class (required)\n" +
186+
| --class CLASS_NAME Name of your application's main class (required)
187187
| --arg ARG Argument to be passed to your application's main class.
188188
| Multiple invocations are possible, each will be passed in order.
189189
| --num-executors NUM Number of executors to start (Default: 2)

0 commit comments

Comments
 (0)