Do not exit early when checking incompatible tasks #2692
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
andrewnester
requested review from
pietern,
shreyas-goenka,
denik and
anton-107
as code owners
andrewnester
temporarily deployed
to
test-trigger-is
GitHub Actions
Inactive
pietern
reviewed
Apr 9, 2025
andrewnester
temporarily deployed
to
test-trigger-is
GitHub Actions
Inactive
andrewnester
temporarily deployed
to
test-trigger-is
GitHub Actions
Inactive
|
@pietern it will give us metrics on how many users have this wrapper enabled but not how many saw this error |
| if hasIncompatibleWheelTasks(ctx, b) { | ||
| return diag.Errorf("Python wheel tasks require compute with DBR 13.3+ to include local libraries. Please change your cluster configuration or use the experimental 'python_wheel_wrapper' setting. See https://docs.databricks.com/dev-tools/bundles/python-wheel.html for more information.") | ||
| diags := hasIncompatibleWheelTasks(ctx, b) | ||
| if len(diags) > 0 { |
There was a problem hiding this comment.
style nit: Why return a diag object instead of returning the error directory? Seems like an antipattern to add an error diag if any diags are returned by hasIncompatibleWheelTasks.
There was a problem hiding this comment.
This is common pattern we do across codebase when we want to collect all diagnostics instead of returning early
There was a problem hiding this comment.
In this case we don't have to return diags from hasIncompatibleWheelTasks, we can just return the error directly. That seems more idiomatic for Go.
shreyas-goenka
approved these changes
Apr 11, 2025
andrewnester
temporarily deployed
to
test-trigger-is
GitHub Actions
Inactive
deco-sdk-tagging bot
added a commit
that referenced
this pull request
Apr 16, 2025
## Release v0.248.0 ### Notable Changes * Python for Databricks Asset Bundles is now in Public Preview. This feature extends bundles so that you can define jobs and pipelines as Python code, dynamically create jobs and pipelines using metadata, and modify jobs and pipelines defined in YAML or Python during bundle deployment. For more information and to get started see [Configuration in Python](https://docs.databricks.com/aws/en/dev-tools/bundles/python). * Fixed a regression with pipeline library globs introduced in 0.247.0 ([#2723](#2723)). The issue caused glob patterns to fail when using paths relative to a directory that is not the bundle root. ### Dependency updates * Upgraded Go SDK to 0.63.0 ([#2716](#2716)) * Upgraded TF provider to 1.73.0 ([#2728](#2728)) ### CLI * Added an error when invalid subcommand is provided for CLI commands ([#2655](#2655)) * Added dry-run flag support to sync command ([#2657](#2657)) ### Bundles * Do not use app config section in test templates and generated app configuration ([#2599](#2599)) * Do not exit early when checking incompatible tasks for specified DBR ([#2692](#2692)) * Removed include/exclude flags support from bundle sync command ([#2718](#2718)) * Do not clean up Python artifacts dist and build folder in "bundle validate", do it in "bundle deploy". This reverts the behaviour introduced in 0.245.0 ([#2722](#2722)) ### API Changes * Added enable-export-notebook, enable-notebook-table-clipboard and enable-results-downloading workspace-level commands. * Removed unused `timeout` and `no-wait` flags for clusters and pipelines
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Changes
Do not exit early when checking incompatible tasks
Why
This allows us to find all tasks with local libraries and old DBR versions setup and not only the first one.
Tests
Existing tests pass