Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEAT] Iceberg partitioned writes #2842

Merged
merged 11 commits into from
Sep 20, 2024

fix iceberg day transform

1963141
Select commit
Loading
Failed to load commit list.
Merged

[FEAT] Iceberg partitioned writes #2842

fix iceberg day transform
1963141
Select commit
Loading
Failed to load commit list.
Codecov / codecov/patch succeeded Sep 16, 2024 in 1s

85.53% of diff hit (target 64.11%)

View this Pull Request on Codecov

85.53% of diff hit (target 64.11%)

Annotations

Check warning on line 655 in daft/dataframe/dataframe.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

daft/dataframe/dataframe.py#L655

Added line #L655 was not covered by tests

Check warning on line 23 in daft/execution/execution_step.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

daft/execution/execution_step.py#L23

Added line #L23 was not covered by tests

Check warning on line 56 in daft/execution/physical_plan.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

daft/execution/physical_plan.py#L56

Added line #L56 was not covered by tests

Check warning on line 23 in daft/execution/rust_physical_plan_shim.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

daft/execution/rust_physical_plan_shim.py#L23

Added line #L23 was not covered by tests

Check warning on line 82 in daft/iceberg/iceberg_scan.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

daft/iceberg/iceberg_scan.py#L82

Added line #L82 was not covered by tests

Check warning on line 12 in daft/iceberg/iceberg_write.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

daft/iceberg/iceberg_write.py#L10-L12

Added lines #L10 - L12 were not covered by tests

Check warning on line 70 in daft/iceberg/iceberg_write.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

daft/iceberg/iceberg_write.py#L70

Added line #L70 was not covered by tests

Check warning on line 103 in daft/iceberg/iceberg_write.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

daft/iceberg/iceberg_write.py#L102-L103

Added lines #L102 - L103 were not covered by tests

Check warning on line 118 in daft/iceberg/iceberg_write.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

daft/iceberg/iceberg_write.py#L118

Added line #L118 was not covered by tests

Check warning on line 120 in daft/iceberg/iceberg_write.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

daft/iceberg/iceberg_write.py#L120

Added line #L120 was not covered by tests

Check warning on line 54 in daft/table/table_io.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

daft/table/table_io.py#L54

Added line #L54 was not covered by tests

Check warning on line 492 in daft/table/table_io.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

daft/table/table_io.py#L490-L492

Added lines #L490 - L492 were not covered by tests

Check warning on line 584 in daft/table/table_io.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

daft/table/table_io.py#L582-L584

Added lines #L582 - L584 were not covered by tests

Check warning on line 586 in daft/table/table_io.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

daft/table/table_io.py#L586

Added line #L586 was not covered by tests

Check warning on line 603 in daft/table/table_io.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

daft/table/table_io.py#L602-L603

Added lines #L602 - L603 were not covered by tests

Check warning on line 605 in daft/table/table_io.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

daft/table/table_io.py#L605

Added line #L605 was not covered by tests

Check warning on line 611 in daft/table/table_io.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

daft/table/table_io.py#L611

Added line #L611 was not covered by tests

Check warning on line 618 in daft/table/table_io.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

daft/table/table_io.py#L618

Added line #L618 was not covered by tests

Check warning on line 620 in daft/table/table_io.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

daft/table/table_io.py#L620

Added line #L620 was not covered by tests

Check warning on line 622 in daft/table/table_io.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

daft/table/table_io.py#L622

Added line #L622 was not covered by tests

Check warning on line 629 in daft/table/table_io.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

daft/table/table_io.py#L629

Added line #L629 was not covered by tests

Check warning on line 48 in src/daft-core/src/series/ops/partitioning.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

src/daft-core/src/series/ops/partitioning.rs#L48

Added line #L48 was not covered by tests

Check warning on line 129 in src/daft-core/src/series/ops/partitioning.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

src/daft-core/src/series/ops/partitioning.rs#L129

Added line #L129 was not covered by tests

Check warning on line 125 in src/daft-dsl/src/functions/partitioning/evaluators.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

src/daft-dsl/src/functions/partitioning/evaluators.rs#L125

Added line #L125 was not covered by tests

Check warning on line 99 in src/daft-plan/src/logical_ops/sink.rs

See this annotation in the file changed.

@codecov codecov / codecov/patch

src/daft-plan/src/logical_ops/sink.rs#L99

Added line #L99 was not covered by tests