Merge pull request alteryx#145 from aarondav/sls-fix

rxin · rxin · commit 951024feeadc · 2013-11-06T09:36:14.000-08:00
Attempt to fix SparkListenerSuite breakage

Could not reproduce locally, but this test could've been flaky if the build machine was too fast, due to typo. (index 0 is intentionally slowed down to ensure total time is &gt;= 1 ms)

This should be merged into branch-0.8 as well.
diff --git a/core/src/test/scala/org/apache/spark/scheduler/SparkListenerSuite.scala b/core/src/test/scala/org/apache/spark/scheduler/SparkListenerSuite.scala
@@ -83,7 +83,7 @@ class SparkListenerSuite extends FunSuite with LocalSparkContext with ShouldMatc
       i
     }
 
-    val d = sc.parallelize(1 to 1e4.toInt, 64).map{i => w(i)}
+    val d = sc.parallelize(0 to 1e4.toInt, 64).map{i => w(i)}
     d.count()
     assert(sc.dagScheduler.listenerBus.waitUntilEmpty(WAIT_TIMEOUT_MILLIS))
     listener.stageInfos.size should be (1)

Original file line number	Diff line number	Diff line change
`@@ -83,7 +83,7 @@ class SparkListenerSuite extends FunSuite with LocalSparkContext with ShouldMatc`
`83`	`83`	`i`
`84`	`84`	`}`
`85`	`85`
`86`		`- val d = sc.parallelize(1 to 1e4.toInt, 64).map{i => w(i)}`
	`86`	`+ val d = sc.parallelize(0 to 1e4.toInt, 64).map{i => w(i)}`
`87`	`87`	`d.count()`
`88`	`88`	`assert(sc.dagScheduler.listenerBus.waitUntilEmpty(WAIT_TIMEOUT_MILLIS))`
`89`	`89`	`listener.stageInfos.size should be (1)`