Description
Component: extensions-contrib/druid-iceberg-extensions
Druid's Iceberg input source (druid-iceberg-extensions) currently only supports reading Iceberg tables stored in Parquet format.
IcebergNativeRecordReader hardcodes Parquet.read() + GenericParquetReaders for all reads:
Motivation
This was flaged while working on v2 spec support #19266 (comment)
dependecies : iceberg-orc, orc-core, iceberg-avro, and avro are absent
References:
• IcebergNativeRecordReader.java — current Parquet-only implementation
• IcebergFileTaskInputSource.java — serialisation boundary between coordinator and worker
• Iceberg API: org.apache.iceberg.data.GenericDeleteFilter (public, already on classpath)
• Iceberg API: org.apache.iceberg.data.orc.GenericOrcReader, org.apache.iceberg.data.avro.GenericAvroReader
• PR #19266 — added Iceberg V2 delete support (Parquet only); this is the follow-up
Description
Component: extensions-contrib/druid-iceberg-extensions
Druid's Iceberg input source (druid-iceberg-extensions) currently only supports reading Iceberg tables stored in Parquet format.
IcebergNativeRecordReader hardcodes Parquet.read() + GenericParquetReaders for all reads:
Motivation
This was flaged while working on v2 spec support #19266 (comment)
dependecies : iceberg-orc, orc-core, iceberg-avro, and avro are absent
References:
• IcebergNativeRecordReader.java — current Parquet-only implementation
• IcebergFileTaskInputSource.java — serialisation boundary between coordinator and worker
• Iceberg API: org.apache.iceberg.data.GenericDeleteFilter (public, already on classpath)
• Iceberg API: org.apache.iceberg.data.orc.GenericOrcReader, org.apache.iceberg.data.avro.GenericAvroReader
• PR #19266 — added Iceberg V2 delete support (Parquet only); this is the follow-up