Bump to 0.17.1 and cherry-pick arrow/parquet related commits #1356
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Signed-off-by: Yong Tang <[email protected]>
This PR tries to address the issue raised in 1254 where reading parquet files will results in `InvalidArgumentError: null value in column` The issue comes from the fact that parquet's ColumnReader C++ API `ReadBatch(...)` does not necessarily respect the number of rows requested and may return less instead. This PR fixes 1254. Signed-off-by: Yong Tang <[email protected]>
* Bump Apache Arrow to 2.0.0 Also bumps Apache Thrift to 0.13.0 Signed-off-by: Yong Tang <[email protected]> * Update code to match Arrow Signed-off-by: Yong Tang <[email protected]> * Bump pyarrow to 2.0.0 Signed-off-by: Yong Tang <[email protected]> * Stay with version=1 for write_feather to pass tests Signed-off-by: Yong Tang <[email protected]> * Bump flatbuffers to 1.12.0 Signed-off-by: Yong Tang <[email protected]> * Fix Windows issue Signed-off-by: Yong Tang <[email protected]> * Fix tests Signed-off-by: Yong Tang <[email protected]> * Fix Windows Signed-off-by: Yong Tang <[email protected]> * Remove -std=c++11 and leave default -std=c++14 for arrow build Signed-off-by: Yong Tang <[email protected]> * Update sha256 of libapr1 As the hash changed by the repo. Signed-off-by: Yong Tang <[email protected]>
Signed-off-by: Yong Tang <[email protected]>
This PR patchs arrow to temporarily resolve the ARROW-11518 issue. See 1281 for details Credit to diggerk. We will update arrow after the upstream PR is merged. Signed-off-by: Yong Tang <[email protected]>
yongtang
force-pushed
the
R0.17
branch
2 times, most recently
from
1390af2 to
9f71986
Compare
Signed-off-by: Yong Tang <[email protected]>
This PR updates pulsar download link as old link does not work anymore. Signed-off-by: Yong Tang <[email protected]>
…le system (tensorflow#1357) * Update to use https for http file system test also registers https file system The http test is failing as apache switched to use https for license page. This PR makes adjustment to fix the issue. Signed-off-by: Yong Tang <[email protected]> * Update README.md to use https Signed-off-by: Yong Tang <[email protected]>
|
The PR is ready for review now. |
kvignesh1420
approved these changes
Apr 12, 2021
There was a problem hiding this comment.
@yongtang LGTM. So the process was to:
- create a new branch named
R0.17with the commits uptov0.17.0. - apply the applicable commits to the branch.
- modify github actions to generate the whl files.
|
@kvignesh1420 Yes. In addition to the list, the following will also need to be done for the release:
I will merge this PR for now. Will see if we can update the README.md and RELEASE.md and push for a release today or tomorrow. |
|
@yongtang sure! |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR bumps version to 0.17.1 and cherry-pick arrow/parquet related commits
This is part of the effort for #1313 (comment)
Signed-off-by: Yong Tang [email protected]