[SPARK-5671] Upgrade jets3t to 0.9.2 in hadoop-2.3 and 2.4 profiles

[JoshRosen]

Upgrading from jets3t 0.9.0 to 0.9.2 fixes a dependency issue that was
causing UISeleniumSuite to fail with ClassNotFoundExceptions when run
the hadoop-2.3 or hadoop-2.4 profiles.

The jets3t release notes can be found at http://www.jets3t.org/RELEASE_NOTES.html

[JoshRosen]

/cc @pwendell @srowen.

Note that we had previously rejected a patch that would have done this same version bumping, but I think that was because there wasn't a Spark-specific motivation for upgrading: #3654 (comment)

[JoshRosen]

@pwendell if you want to reproduce the old UISeleniumSuite Jenkins failures locally, you can run

build/mvn -Pyarn -Phadoop-2.3 -Dhadoop.version=2.3.0 test -DwildcardSuites=org.apache.spark.ui.UISeleniumSuite -Dtest=none

after packaging Spark.

I ran this locally to confirm that this patch fixes that issue.

[SparkQA]

Test build #27017 has started for PR 4454 at commit fa6cb3e.

• This patch merges cleanly.

[JoshRosen]

Note that the actual dependency conflict here involves an old version of httpcomponets.httpclient being pulled in via the jets3t dependency. I ran into a variant of this problem when working on the original PR for the UISeleniumSuite (#2474) but didn't have to add a workaround for it there since some build changes in other PRs ended up fixing this issue.

I think we need version 4.2.3 or higher of httpcomponents.httpclient, but jets3t 0.9.0 depends on 4.1.2, which is why the older version was causing a problem here.

I guess we could fix this by adding an explicit test-scoped dependency on the newer version of httpcomponents, but I thought this approach seemed easier unless there's a strong motivation to not upgrade to 0.9.2.

[srowen]

+1 to updating to 0.9.2 (0.9.3 even?) for all the reasons you've cited here. There wasn't a reason not to update before, just not obviously a reason to. Now there is.

[JoshRosen]

It looks like 0.9.3 has been released, but it's not on Maven Central yet: http://search.maven.org/#search%7Cga%7C1%7Cg%3A%22net.java.dev.jets3t%22

[SparkQA]

Test build #27017 has finished for PR 4454 at commit fa6cb3e.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[AmplabJenkins]

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/27017/
Test PASSed.

[JoshRosen]

I'm going to go ahead and merge this into master (1.4.0) and branch-1.3 (1.3.0) in order to un-break those Jenkins builds.