-
Notifications
You must be signed in to change notification settings - Fork 128
direct: support quality monitors #4278
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
andrewnester
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Could you please include known differences between TF and direct implementation in the PR description?
| @@ -0,0 +1,14 @@ | |||
| { | |||
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
It looks like the update now causes a recreation instead of the actual update, which leads to a quality monitor URL / id change. This URL / ID might be referenced from other places (outside of bundle scope, like let's say some dashboard)
Is this recreation intentional?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
yes, because assets_dir is not available on update request for quality monitors, so it simply cannot be updated.
https://docs.databricks.com/api/workspace/qualitymonitors/update
|
Commit: 906aed8
26 interesting tests: 19 RECOVERED, 6 KNOWN, 1 SKIP
Top 29 slowest tests (at least 2 minutes):
|
## Release v0.283.0 ### Notable Changes * Bundle commands now cache the user's account details to improve command latency. To disable this, set the environment variable DATABRICKS_CACHE_ENABLED to false. ### CLI * Add commands to pipelines command group ([#4275](#4275)) ### Bundles * Add support for configuring app.yaml options for apps via bundle config ([#4271](#4271)) * Enable caching user identity by default ([#4202](#4202)) * Do not show single node warning when is_single_node option is explicitly set ([#4272](#4272)) * Fix false positive folder permission warnings and make them more actionable ([#4216](#4216)) * Pass additional Azure DevOps system variables ([#4236](#4236)) * Replace Black formatter with Ruff in Python bundle templates for faster, all-in-one linting and formatting ([#4196](#4196)) * engine/direct: support quality monitors ([#4278](#4278)) * Improve folder permissions warning ([#4216](#4216)) ### Dependency updates * Upgrade TF provider to 1.102.0 ([#4235](#4235)) * Upgrade Go SDK to 0.96.0 ([#4206](#4206))
|
Commit: 1241eb8
32 interesting tests: 17 RECOVERED, 8 flaky, 6 KNOWN, 1 SKIP
Top 50 slowest tests (at least 2 minutes):
|
Changes
Support quality monitors in direct engine. Compared to terraform, this supports changing assets_dir and table_name (by recreating the monitor).
Why
Closes #4158
Tests
New local + cloud tests.