feat(iceberg): Adds support for read_iceberg with metadata_location to Daft-SQL

[rchowell]

This PR adds support for read_iceberg given a metadata location, and it adds this to Daft-SQL.

Note

This was tested manually because PyIceberg StaticTable has a bug where the filepaths in the iceberg metadata are resolved relative to the caller's current working directory rather than relative to the metadata file. This will need to be fixed in PyIceberg, but I wanted to close this out for now since it still works if the paths are right.

Future Additions

• support for a table identifier as the first argument to SQL read_iceberg
• support for the table name only and get latest version
• Support version-hint.txt for reading iceberg tables #3698

Testing

• Using the dataset from https://duckdb.org/docs/extensions/iceberg.html copied to the project root.

[codspeed-hq]

CodSpeed Performance Report

Merging #3701 will degrade performances by 32.65%

_{Comparing rchowell/read_iceberg (c9ac983) with main (a7dd7ef)}

Summary

❌ 1 regressions
✅ 26 untouched benchmarks

⚠️ Please fix the performance issues or acknowledge them on CodSpeed.

Benchmarks breakdown

	Benchmark	main	rchowell/read_iceberg	Change
❌	test_show[100 Small Files]	16 ms	23.7 ms	-32.65%

[codecov]

Codecov Report

Attention: Patch coverage is 5.20833% with 91 lines in your changes missing coverage. Please review.

Project coverage is 77.58%. Comparing base (6b302af) to head (c9ac983).
Report is 3 commits behind head on main.

Files with missing lines	Patch %	Lines
src/daft-sql/src/table_provider/read_iceberg.rs	0.00%	34 Missing ⚠️
src/daft-scan/src/builder.rs	0.00%	29 Missing ⚠️
src/daft-sql/src/table_provider/read_deltalake.rs	0.00%	24 Missing ⚠️
src/daft-scan/src/storage_config.rs	0.00%	3 Missing ⚠️
daft/io/_iceberg.py	75.00%	1 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #3701      +/-   ##
==========================================
- Coverage   77.94%   77.58%   -0.37%     
==========================================
  Files         725      727       +2     
  Lines       90952    92081    +1129     
==========================================
+ Hits        70895    71442     +547     
- Misses      20057    20639     +582     

Files with missing lines	Coverage Δ
src/daft-sql/src/functions.rs	85.41% <ø> (ø)
src/daft-sql/src/table_provider/mod.rs	96.77% <100.00%> (+42.22%)	⬆️
daft/io/_iceberg.py	87.87% <75.00%> (-2.13%)	⬇️
src/daft-scan/src/storage_config.rs	84.44% <0.00%> (-6.04%)	⬇️
src/daft-sql/src/table_provider/read_deltalake.rs	0.00% <0.00%> (ø)
src/daft-scan/src/builder.rs	33.95% <0.00%> (-3.38%)	⬇️
src/daft-sql/src/table_provider/read_iceberg.rs	0.00% <0.00%> (ø)

... and 25 files with indirect coverage changes