Skip to content

Better support for reading and writing UTC adjusted time types in parquet #8027

@masonh22

Description

@masonh22

Is your feature request related to a problem or challenge? Please describe what you are trying to do.

In parquet, the TIME logical type has a boolean parameter for whether the values are adjusted to UTC. Arrow doesn't have any notion of time zones for time types. #6278 added a metadata key whose presence indicates that the parquet logical TIME type should be adjusted to UTC. This solution is limited in that it is not documented and the metadata key is not added on the read side unless the file was written by arrow-rs and the reader doesn't skip the arrow metadata.

Describe the solution you'd like

I would like this feature to be documented and for the key to be added automatically whenever the parquet TIME type is adjusted to UTC.

Describe alternatives you've considered

Additional context

Metadata

Metadata

Assignees

Labels

enhancementAny new improvement worthy of a entry in the changelog

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions