The iceberg extension is a loadable extension that implements support for the Apache Iceberg format.

Installing and Loading

To install and load the iceberg extension, run:

INSTALL iceberg; LOAD iceberg; 

Usage

To test the examples, download the iceberg_data.zip file and unzip it.

Querying Individual Tables

SELECT count(*) FROM iceberg_scan('data/iceberg/lineitem_iceberg', allow_moved_paths = true); 

The allow_moved_paths option ensures that some path resolution is performed, which allows scanning Iceberg tables that are moved.

You can also address specify the current manifest directly in the query, this may be resolved from the catalog prior to the query, in this example the manifest version is a UUID.

SELECT count(*) FROM iceberg_scan('data/iceberg/lineitem_iceberg/metadata/02701-1e474dc7-4723-4f8d-a8b3-b5f0454eb7ce.metadata.json'); 

This extension can be paired with the httpfs extension to access Iceberg tables in object stores such as S3.

SELECT count(*) FROM iceberg_scan('s3://bucketname/lineitem_iceberg/metadata/02701-1e474dc7-4723-4f8d-a8b3-b5f0454eb7ce.metadata.json', allow_moved_paths = true); 

Access Iceberg Metadata

SELECT * FROM iceberg_metadata('data/iceberg/lineitem_iceberg', allow_moved_paths = true); 

Visualizing Snapshots

SELECT * FROM iceberg_snapshots('data/iceberg/lineitem_iceberg'); 

Limitations

Writing (i.e., exporting to) Iceberg files is currently not supported.