Search results

[SPARK-52771][PS] Fix float32 type widening in <code>truediv</code>/<code>floordiv</code>

PANDAS API ON SPARK

PYTHON

Status: Open (in progress).

apache/sparknumber 51456

#51456 In apache/spark;

· xinrong-meng opened on Jul 11, 2025

[SPARK-52751][PYTHON][CONNECT] Don't eagerly validate column name in <code>dataframe['col_name']</code>

CONNECT

DOCS

PYTHON

SQL

Status: Open (in progress).

apache/sparknumber 51400

#51400 In apache/spark;

· zhengruifeng opened on Jul 8, 2025

[WIP][SPARK-52646][PS] Avoid CAST_INVALID_INPUT of <code>__eq__</code> in ANSI mode

PANDAS API ON SPARK

PYTHON

Status: Draft (not ready).

apache/sparknumber 51370

#51370 In apache/spark;

· xinrong-meng opened on Jul 4, 2025

[SPARK-52673][CONNECT][CLIENT] Add grpc RetryInfo handling to Spark Connect retry policies

CONNECT

PYTHON

SQL

Status: Open (in progress).

apache/sparknumber 51363

#51363 In apache/spark;

· khakhlyuk opened on Jul 3, 2025

[SPARK-52669][PySpark]Improvement PySpark choose pythonExec in cluster yarn client mode

PYTHON

Status: Open (in progress).

apache/sparknumber 51357

#51357 In apache/spark;

· gwdgithubnom opened on Jul 3, 2025

[SPARK-52640][SDP] Propagate Python Source Code Location

CONNECT

PYTHON

SQL

Status: Open (in progress).

apache/sparknumber 51344

#51344 In apache/spark;

· AnishMahto opened on Jul 1, 2025

[WIP][SPARK-52622][PS] Avoid CAST_INVALID_INPUT of <code>DataFrame.melt</code> in ANSI mode

PANDAS API ON SPARK

PYTHON

Status: Draft (not ready).

apache/sparknumber 51326

#51326 In apache/spark;

· xinrong-meng opened on Jul 1, 2025

[SPARK-51051][SQL]Add an optional parameter for <code>array_position</code> function to specify starting index for matching.

CONNECT

PYTHON

SQL

Status: Draft (not ready).

apache/sparknumber 51317

#51317 In apache/spark;

· konjac opened on Jun 29, 2025

[MINOR][DOCS] Updated the docstring of DataStreamWriter.foreach() method

PYTHON

STRUCTURED STREAMING

Status: Open (in progress).

apache/sparknumber 51316

#51316 In apache/spark;

· nagaarjun-p opened on Jun 29, 2025

[SPARK-52593][PS] Avoid CAST_INVALID_INPUT of <code>Series.dot</code> and <code>DataFrame.dot</code> in ANSI mode

PANDAS API ON SPARK

PYTHON

Status: Open (in progress).

apache/sparknumber 51310

#51310 In apache/spark;

· xinrong-meng opened on Jun 27, 2025

[SPARK-52592][PS] Prevent error when creating ps.Series from ps.Series

PANDAS API ON SPARK

PYTHON

Status: Open (in progress).

apache/sparknumber 51300

#51300 In apache/spark;

· petern48 opened on Jun 27, 2025

[SPARK-52580][PS] Avoid CAST_INVALID_INPUT of <code>replace</code> in ANSI mode

PANDAS API ON SPARK

PYTHON

Status: Open (in progress).

apache/sparknumber 51297

#51297 In apache/spark;

· xinrong-meng opened on Jun 26, 2025