Skip to content

[SPARK-8023][SQL] Add "deterministic" attribute to Expression to avoid collapsing nondeterministic projects. #6573

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 5 commits into from

Conversation

rxin
Copy link
Contributor

@rxin rxin commented Jun 2, 2015

This closes #6570.

@yhuai
Copy link
Contributor

yhuai commented Jun 2, 2015

lgtm

asfgit pushed a commit that referenced this pull request Jun 2, 2015
…d collapsing nondeterministic projects.

This closes #6570.

Author: Yin Huai <[email protected]>
Author: Reynold Xin <[email protected]>

Closes #6573 from rxin/deterministic and squashes the following commits:

356cd22 [Reynold Xin] Added unit test for the optimizer.
da3fde1 [Reynold Xin] Merge pull request #6570 from yhuai/SPARK-8023
da56200 [Yin Huai] Comments.
e38f264 [Yin Huai] Comment.
f9d6a73 [Yin Huai] Add a deterministic method to Expression.

(cherry picked from commit 0f80990)
Signed-off-by: Reynold Xin <[email protected]>

Conflicts:
	sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/random.scala
@asfgit asfgit closed this in 0f80990 Jun 2, 2015
@SparkQA
Copy link

SparkQA commented Jun 2, 2015

Test build #33959 has finished for PR 6573 at commit 356cd22.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

jeanlyn pushed a commit to jeanlyn/spark that referenced this pull request Jun 12, 2015
…d collapsing nondeterministic projects.

This closes apache#6570.

Author: Yin Huai <[email protected]>
Author: Reynold Xin <[email protected]>

Closes apache#6573 from rxin/deterministic and squashes the following commits:

356cd22 [Reynold Xin] Added unit test for the optimizer.
da3fde1 [Reynold Xin] Merge pull request apache#6570 from yhuai/SPARK-8023
da56200 [Yin Huai] Comments.
e38f264 [Yin Huai] Comment.
f9d6a73 [Yin Huai] Add a deterministic method to Expression.
nemccarthy pushed a commit to nemccarthy/spark that referenced this pull request Jun 19, 2015
…d collapsing nondeterministic projects.

This closes apache#6570.

Author: Yin Huai <[email protected]>
Author: Reynold Xin <[email protected]>

Closes apache#6573 from rxin/deterministic and squashes the following commits:

356cd22 [Reynold Xin] Added unit test for the optimizer.
da3fde1 [Reynold Xin] Merge pull request apache#6570 from yhuai/SPARK-8023
da56200 [Yin Huai] Comments.
e38f264 [Yin Huai] Comment.
f9d6a73 [Yin Huai] Add a deterministic method to Expression.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants