impala

mirror of https://github.com/apache/impala.git synced 2026-02-03 00:00:40 -05:00

Files

Gergely Fürnstáhl f598b2ad68 IMPALA-10610: Support multiple file formats in a single Iceberg Table

Added support for multiple file formats. Previously Impala created a
Scanner class based on the partitions file format, now in case of an
Iceberg table it will read out the file format from the file level
metadata instead.

IcebergScanNode will aggregate file formats as well instead of relying
on partitions, so it can be used for plannig.

Testing:

Created a mixed file format table with hive and added a test for it.

Change-Id: Ifc816595724e8fd2c885c6664f790af61ddf5c07
Reviewed-on: http://gerrit.cloudera.org:8080/18935
Reviewed-by: Impala Public Jenkins <impala-public-jenkins@cloudera.com>
Tested-by: Impala Public Jenkins <impala-public-jenkins@cloudera.com>

2022-09-08 18:03:37 +00:00

hadoop_catalog

IMPALA-11507: Use absolute_path when Iceberg data files are outside of the table location

2022-09-06 18:35:30 +00:00

iceberg_migrated_alter_test

IMPALA-11034: Resolve schema of old data files in migrated Iceberg tables

2022-07-14 13:06:04 +00:00

iceberg_migrated_alter_test_orc

IMPALA-11034: Resolve schema of old data files in migrated Iceberg tables

2022-07-14 13:06:04 +00:00

iceberg_migrated_complex_test

IMPALA-11034: Resolve schema of old data files in migrated Iceberg tables