Skip to content

Ingestion of Parquet containing int or double columns throw validation errors #91

Closed
@vishalbollu

Description

@vishalbollu

Description

Parquet file containing IntegerType or DoubleType columns will throw errors during ingestion time because the validation check expects FLOAT_COLUMN to be FloatType and INT_COLUMN to be LongType

Possible Solution / Implementation

During the validation check, accept FloatType or DoubleType when a column is defined to be FLOAT_COLUMN and IntegerType or LongType when a column is defined to be INT_COLUMN

Metadata

Metadata

Assignees

Labels

bugSomething isn't working

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions