[Improvement] Collect the partition lengths in ShuffleWriteTaskStats #2670
Description
Code of Conduct
- I agree to follow this project's Code of Conduct
Search before asking
- I have searched in the issues and found no similar issues.
What would you like to be improved?
Now. the partition length statistic is collected by the PartitionLengthStatistic , that could be replaced by the ShuffleWriteTaskStats in spark3
How should we improve?
No response
Are you willing to submit PR?
- Yes I am willing to submit a PR!