DatabricksCLI: скачать старые версии

CLI
- Fix GitHub API rate limit errors in aitools list and plugin installs by pinning skills to 0.2.32. (#7159)

CLI
- Fix databricks aitools install overwriting newer raw skills with an older pinned release. CLI 1.22.0 and newer now install the latest published skills and prevent automatic downgrades. (#7069)
- Fix auth login --timeout not applying to the browser login, which waited for the OAuth redirect indefinitely. (#7103)
- Remove the 50-workspace limit in auth login and support searching workspaces by name or ID. (#7071)
- databricks ssh connect now fails right away with the workspace's reason when port forwarding to serverless compute is disabled, instead of waiting out the server start timeout. (#7057)
AI Runtime
- air run now spends less time before submitting: it fetches only the user name from SCIM. (#7153)
- Align multi-image container name validation with backend services: allow hyphens and up to 32 characters, and reject uppercase letters and underscores. (#7154)
Bundles
- The compute_id deprecation warning for a target now shows the full path (targets.<name>.compute_id). (#7048)
- Add DATABRICKS_BUNDLE_STRICT_PROFILE_MATCH, which requires a target's host and workspace ID to match exactly one profile in the config file before authenticating. Targets without a host or workspace ID are not affected. (#7109)
- Zero-value overrides of presets, lifecycle.prevent_destroy and deployment settings in includes now replace non-zero base values, and bundle validate -o json shows explicit zero presets. (#7117)
- bundle deployment bind and unbind now accept a resource as type.key, e.g. jobs.foo. (#7128)
- Retry more transient server errors during bundle deploy and bundle destroy, including when releasing the deploy lock and reading state. (#7129)
- Fix migration from Terraform failing when a deployed resource references a resource that was never deployed. (#7157)
- Add app-appkit to bundle templates to simplify starting a Databricks Apps project. (#7004, #7007)
- Add support for the features resource type. (#6952)
- Fix bundle validate warning that sync.include and sync.exclude patterns do not match any files when sync.paths includes a directory outside the bundle root. (#7122)
Dependency Updates
- Bump dependencies with known vulnerabilities. (#7083)
- Bump Go to 1.27.2. Release binaries now require macOS 13 Ventura or later. (#7052)
- Update the Go SDK to v0.189.0. (#7138)
- Bump Go toolchain to 1.27.3. (#7116)

Release v1.20.0
Notable Changes
- Remove the Terraform deployment engine. bundle.engine: terraform and DATABRICKS_BUNDLE_ENGINE=terraform now error, and a failed migration of existing Terraform state is reported as an error instead of falling back to Terraform. To keep deploying with Terraform, use Databricks CLI v1.19.x. (#6888, #6889)
CLI
- databricks aitools install now supports Kiro, installing Databricks agent skills into its skills directory. (#6908)
- Fixed databricks api corrupting integers larger than 2^53 (such as job and pipeline ids) — request bodies and responses now preserve them exactly. (#6884)
- Added --auth-mode and --set <plugin>.<resourceKey>.authMode=obo|sp|both to databricks apps init so AppKit resources can be accessed on behalf of the user, by the service principal, or both. The default stays service principal. (#6886)
- databricks apps init now requires a value for every field a service principal resource binding references, prompting for missing values in an interactive terminal and otherwise failing with the --set key to use, instead of creating a project with unset variables. (#6903)
- Add databricks apps init --package-manager <npm|pnpm> to select the package manager for Node.js templates. Infer the default quietly from template lockfiles and AppKit version, check prerequisites before creating files, and preserve template formatting and pnpm version pins. (#6902)
- Select npm or pnpm from packageManager declarations and lockfiles for apps validate and project validation during apps deploy. (#6892)
- Fix auth docker host reporting the credential helper as configured when its executable is missing from PATH. (#6880)
- Warn when the CLI binary was built more than 6 months ago and recommend updating. (#6898)
AI Runtime
- Add an experimental rank-partitioned container images to AI Runtime jobs. (#6841)
- Support snapshot fields directly under code_source without requiring type or a nested snapshot block. (#6927)
- Map AIR priority and Unity Catalog image fields when converting run configurations to bundles. (#6905)
- Add workspace backend validation to air run --dry-run. (#6934)
Bundles
- Warn that bundle.terraform is deprecated and has no effect since the Terraform deployment engine was removed. (#6940)
- Direct engine now detects and applies an explicitly configured zero-value boolean or float (e.g. gcp_attributes.use_preemptible_executors: false, azure_attributes.spot_bid_max_price: 0) added to a resource first deployed without the field, matching the existing handling of an explicit integer zero. (#6882)
- Fix bundle deployment migrate failing with "no such file or directory" when the Terraform state has no resources or the configuration no longer declares any of them. (#6958)
- bundle run and pipelines run now send the per-update development parameter for pipelines in development mode targets. Setting development on a pipeline is deprecated and now emits a warning; use mode: development instead. (#6863)
- Remove the hidden bundle debug terraform command. (#6933)
- Add support for run_as.group_name at the bundle and target levels for jobs and pipelines. (#6676)
- Fix recreating a secret scope that was deleted outside of the bundle with the direct deployment engine. (#6970)
- Accept title-case booleans (True/False, as rendered by Azure Pipelines) for boolean variables, and accept the same boolean strings (yes/no, on/off, ...) in Python bundles as in YAML. (#6942)
Dependency Updates
- Bump github.com/databricks/databricks-sdk-go from v0.182.0 to v0.185.0. (#6928)

CLI
- Honor CLAUDE_CONFIG_DIR in aitools commands. (#6838)
- Added --ttl and --no-expiry flags to databricks postgres create-branch so a branch's expiration can be set without hand-writing a --json spec. --ttl accepts the REST API duration form (604800s), a Go duration (168h), or day/week units (7d, 3w); --no-expiry creates a branch that never expires. One of --ttl, --no-expiry, or a spec expiration in --json is required. (#6313)
- databricks ssh connect serverless sessions now provide Claude Code and Codex configured with Unity Gateway out of the box. (#6885)
AI Runtime
- Add databricks air images push (Preview) to configure Docker authentication and push container images to Databricks Artifact Registry. (#6869)
- air run now grants the configured permissions on the MLflow experiment as well as the job. (#6870)
Bundles
- Add libraries field to clusters. (#6831)
- Error out when a configured workspace_id does not match the connected workspace, instead of silently using it in resource URLs emitted by bundle summary. (#6754)
- Fix spurious recreation of Lakebase (Postgres) branches, roles, and catalogs when the referenced project is updated in place: an in-place project change (e.g. display_name) no longer forces a delete + create of resources that reference the project's or branch's name. (#6865)
- Direct engine now detects and applies an explicitly configured integer zero (e.g. gcp_attributes.local_ssd_count: 0) added to a resource first deployed without the field. (#6867)
- Migrate existing Terraform deployment state to the direct engine before deploying (previously done after a Terraform deploy), so the deploy runs on the direct engine. (#6749)
- The postgres_snapshot_schedules resource (introduced in v1.16.0) is now marked Beta and is no longer available in PyDABs, matching the other postgres_* resources; configure it in YAML instead. (#6887)

Release v1.18.0 (2026-09-24)
CLI
- The AI Runtime commands have moved to databricks air. The previous databricks experimental air path now directs users to the new command. (#6722)
- Write local state, cache, and config files atomically so an interrupted or concurrent write cannot corrupt them. (#6708)
- Deprecate --region in databricks auth docker configure ahead of its removal in the next release, infer the Artifact Registry region when it is omitted, and add databricks auth docker host --profile <name> to show the profile's registry host and credential-helper status. (#6782)
- Return UNAUTHENTICATED instead of INVALID_REFRESH_TOKEN when databricks auth token --output json cannot refresh a cached U2M token. (#6731)
- Retry the current-user (SCIM Me) lookup on transient HTTP 500 responses so a temporarily-unavailable backend no longer fails bundle commands outright. (#6766)
- Preserve workspace-file and volume access for SSH server descendants when the bootstrap notebook exits and the server survives. (#6645)
- ssh connect and ssh setup now accept a --keep-detached-processes flag to keep processes detached from the SSH session (tmux, setsid, nohup) running after the tunnel shuts down. Teardown then terminates only the tunnel's own process group, and the bootstrap job run is held open while any detached process is still running, so the survivors keep their /Workspace and /Volumes access. A held-open run also suppresses cluster autotermination, so the flag is off by default, is bounded by --server-timeout, and is dedicated-cluster only. Without it, the server now logs a warning naming the detached processes it is about to destroy, instead of sweeping them silently. (#6387)
Bundles
- direct: Allow clearing a catalog's or schema's custom_max_retention_hours by removing it from configuration. (#6792)
- direct: Allow clearing a genie space's description and a secret's comment by removing them from configuration. (#6789)
- Fix direct-engine deploy recreating an MLflow experiment on every deploy when its trace_location was set out-of-band. (#6787)
- direct: Store a Genie space's serialized_space in state as a content hash instead of its full contents. (#6707)
- Fix bundle deploy failing with "Invalid python file reference" for jobs that use git_source with a spark_python_task on the direct engine. (#6751)
- Fixed the direct engine mishandling UC grants that combine ALL_PRIVILEGES with a privilege it does not imply (MANAGE, READ_METADATA, EXTERNAL_USE_SCHEMA, EXTERNAL_USE_LOCATION): such privileges were dropped when granted and left behind when revoked, so the deployment never converged. (#6733, #6743)
- Don't fail migration if clean up actions fail. (#6772)
- Ignore the backend-provided spark.sql.ansi.enabled: "true" pipeline configuration default when detecting direct-engine drift. (#6816)
- Fix recreating a postgres synced table sometimes failing with a 409 ALREADY_EXISTS error while the previous table is still being deleted. (#6728)
- Direct engine no longer recreates a resource when an immutable field the config omits was populated by the backend. (#6790)
Dependency Updates
- Bump dependencies with known vulnerabilities. (#6723)
- Bump github.com/databricks/databricks-sdk-go from v0.178.0 to v0.182.0. (#6817)
- Bump the Databricks Terraform provider from v1.132.0 to v1.134.0. (#6818)

Release v1.17.0
Notable Changes
- Bump the direct deployment state version to 3. Clients older than v1.8.0 will reject bundles deployed with this release. (#6713)
CLI
- Add an INVALID_REFRESH_TOKEN error code to databricks auth token --output json failures. (#6684)
- Add experimental databricks auth docker configure to configure Docker credential helper access for Databricks Artifact Registry. (#6700)
- Add experimental databricks auth docker token to generate Docker credentials for Databricks Artifact Registry. (#6699)
- databricks environments setup-local now reports the E_PROVISION_CONFLICT error code instead of the generic E_PROVISION when uv sync fails to resolve a dependency conflict. (#6666)
- Preserve SSH sessions across temporary tunnel disconnects, with bounded replay and backpressure for large transfers. (#6650)
- Allow OAuth U2M logins to override the CLI client ID with --client-id, profile client_id, or DATABRICKS_CLIENT_ID. (#6594)
Bundles
- direct: Store a dashboard's serialized_dashboard in state as a content hash instead of its full contents. (#6105)
- direct: Fix pipelines recreation when the whole ingestion_definition block is added or removed. (#6589)
- bundle plan, deploy, and destroy no longer report removing permissions, grants, or secret scope ACLs from a bundle as a deletion, since it leaves the resource untouched. (#6647)
- bundle plan and deploy no longer list or count a resource that was already deleted remotely as a deletion, matching bundle destroy; applying still cleans up its stale state entry. (#6675)
- Fix bundle run failing with expected an int, found a string when an unrelated resource references another resource that is not deployed. bundle run now resolves ${resources.*} references only within the resource being run. (#6690)
- Add grants support for the AI Gateway model_service, mcp_service, and model_provider_service resources (direct engine). (#6635)
- Add bundle support for the AI Gateway mcp_service resource (direct engine). (#6633)
- Add bundle support for the AI Gateway model_provider_service resource (direct engine). (#6634)
- Add bundle support for the AI Gateway model_service resource (direct engine). (#6525)
- Prevent resource drift on catalogs if storage_root contained a trailing slash in the URL. (#6622)
- Fixed a "lineage mismatch in state files" error that could occur after destroying a bundle and redeploying it from another machine. bundle destroy now removes the local state file so no stale lineage is left behind, and prunes the state directories it leaves empty (such as .internal/ and sync-snapshots/). (#6210, #6685)
- direct: bundle plan no longer reports a permanent update on a cluster that uses a cluster policy: when the cluster spec sets policy_id, a field present in the remote but absent from the bundle config is not treated as drift. (#6531)
- bundle deploy on the direct engine now reports each resource as soon as it is deployed, instead of listing them all after the deployment finishes. A deploy that fails part way through now reports the resources it did apply. (#6361)
- Direct-engine bundles no longer flag phantom drift on server-populated nested fields under reused config types (e.g. external_locations file-event-queue resource IDs, database_instances parent-instance refs, apps git credential ID). (#6618)
- databricks bundle generate app now reproduces a git-backed app's git_repository and git_source configuration instead of emitting a workspace source_code_path, so generating from a Git-deployed app no longer silently converts it to workspace source. (#6656)
- Improved configuration load time for bundles with many included files. (#6195)
- bundle destroy no longer deletes triggered job runs, leaving them untouched on the backend. (#6672)
- direct: resources.job_runs: new lifecycle.triggers.on_file_change setting to restart the run when monitored files change. Can be set to a series of paths or globs. (#6309)
- Bundle summary now shows a name for Postgres branche

Release v1.16.1
CLI
- Revert tunnel resume layer to fix SSH transfer regression in v1.16.0 affecting transfers larger than 1 MiB. (#6608, #6612)

Release v1.16.0
CLI
- aitools install now registers the official Claude marketplace if it is missing before installing the Databricks Claude plugin. (#6485)
- databricks aitools install --output json now reports an error_category for a failed or skipped install (per agent, and at the top level for a failure with no per-agent entry), giving coding agents and CI a stable classification of why an install did not complete. (#6482)
- databricks aitools install honors --output json, emitting a structured {scope, agents[...]} document that reports each agent's delivery and install status so coding agents and CI can consume the result without scraping the text output. JSON mode requires --scope and --agents so the command runs without interactive prompts. (#6481)
- databricks bundle sync now prints sync progress (Action: PUT, Uploaded ...) by default, matching databricks sync. Previously it was silent unless --output was passed. Use --output json for machine-readable output. (#6568)
- Support major-only DBR runtime versions such as 19.x-scala2.13 in the cluster picker used by databricks auth login --configure-cluster and databricks labs. (#6574)
- Deprecated the databricks environments setup-local --constraints-only flag in favour of the orthogonal --no-dbconnect; the flag still works as a hidden alias but is hidden from --help and prints a one-line deprecation notice, and will be removed in a later release. (#6470)
- Add orthogonal --no-constraints and --no-dbconnect flags to databricks environments setup-local: --no-constraints skips writing the remote Python-version and dependency pins, and --no-dbconnect skips the databricks-connect dependency. (#6464)
- databricks environments setup-local now reports a distinct E_PROVISION_CONFLICT error code in --output json when the project's dependencies conflict with the pins written for the target environment, making the requirements unsatisfiable (the same conflict surfaced as a W_USER_CONSTRAINT_CONFLICT warning); it is reported after the project files are written, without attempting the doomed provisioning, while other provisioning failures continue to report E_PROVISION. (#6479)
- databricks ssh connect and ssh setup now verify the tunnel's SSH host key against the key the workspace published for the connection, recorded in ~/.databricks/ssh-tunnel-known-hosts/<name> instead of ~/.ssh/known_hosts. Reconnecting with a name used before no longer fails with Host key verification failed when the compute behind that name changed, and no longer needs a manual ssh-keygen -R; host blocks written by an earlier databricks ssh setup pick this up once you re-run it. (#6557)
- Stop databricks ssh connect --ide from adding a duplicate entry to the IDE's Remote Explorer on every connect: the remote authority is now the SSH host alias alone, instead of embedding the per-instance remote OS user. (#6550)
- Add --max-clients and --server-timeout flags to databricks ssh setup, and --server-timeout to databricks ssh connect. Both are fixed when the SSH tunnel server job is submitted, so ssh setup now serializes them into the generated ProxyCommand instead of falling back to the built-in defaults. (#6547)
- ssh connect sessions no longer end when the tunnel's websocket connection is lost. The CLI reattaches to the running session and replays the bytes that were missed, so the shell and everything running in it stay intact, and a transient failure to open a replacement connection for the periodic auth refresh is retried rather than ending the session. Reattaching requires an SSH server started by a CLI that supports it; against an older server the connection behaves as before. (#6558)
Bundles
- Added PyDABs (Python) support for secrets: Resources.add_secret and the secret_mutator decorator. (#6553)
- Fix job and pipeline environment dependencies with a * version wildcard (e.g. numpy==2.5.*) being treated as local file paths. (#6555)
- Add the postgres_snapshot_schedules bundle resource for managing a Lakebase 

Release v1.15.0 (2026-09-03)
CLI
- When uv python install fails, databricks environments setup-local now falls back to a compatible Python interpreter already installed on the machine. (#6457)
- Allow databricks environments setup-local to update pyproject.toml files containing TOML multi-line strings. (#6445)
Bundles
- Before committing the automatic terraform→direct migration, run a deployment plan against the converted state; if the plan fails the migration is abandoned. (#6486)
- The dbt-sql bundle template now uses Databricks Runtime 16.4 LTS (up from 15.4 LTS) for classic (non-serverless) compute. (#6418)
- Fixed the direct engine silently ignoring edits to duration and timestamp fields, such as a Lakebase endpoint's suspend_timeout_duration. Such a change planned 0 to change and was never applied. (#6377)
- Fixed $${...} not escaping a literal ${...} on the direct engine, which failed with an invalid dependency error. (#6484, #6489)
- Remove forward_user_access_token from update_mask for Apps because it's not supported. Fixes regression in 1.14.1. (#6510)
- direct: Fix deploying an update to postgres_projects.default_endpoint_settings. (#6440)
- direct: Fix deploying an update to postgres_endpoints.settings.pg_settings. (#6441)
- direct: Fix deploying an update to expire_time, ttl or suspend_timeout_duration on Lakebase resources. (#6443)
- Added PyDABs (Python) support for catalogs: Resources.add_catalog and the catalog_mutator decorator. (#6408)
- Bundle templates now use serverless environment version 5, which offers better performance, and databricks-connect 16.4. (#6378)
- Fixed a job with a table_update trigger never converging on the direct engine. (#6442)
Dependency Updates
- Bump Go toolchain to 1.26.8. (#6476)

Release v1.14.1
Bundles
- Fix bundle deploy failing with deployment_source.source_code_path cannot be set on UpdateApp (400) when updating an app that has an active deployment (#6401).
- Fixed ${resources...} references to resource keys starting with an underscore (e.g. _my_job). On the direct engine, deploying such a resource with permissions or grants failed with cannot parse "/jobs/${resources.jobs._my_job.id}", and user-written references to it were silently left unresolved (

Notable Changes
- Bundles still on Terraform state are now migrated to the direct engine automatically, after a deploy whose dry-run conversion comes back clean. To opt out, set engine: terraform under bundle or DATABRICKS_BUNDLE_ENGINE=terraform. See https://docs.databricks.com/aws/en/dev-tools/bundles/direct
CLI
- Fixed idle databricks ssh connect sessions disconnecting after a few minutes, on dedicated clusters and on serverless. The tunnel now keeps itself warm: the SSH client and the SSH server on the compute exchange keepalives every 30 seconds, and the CLI's proxy pings the tunnel's websocket every 20 seconds. A session nobody is typing into stays connected, with no need to set ServerAliveInterval by hand.
Bundles
- bundle plan no longer reports a permanent, unconvergeable update on securable_kind for Unity Catalog TABLE securables declared under an app's resources. The field is computed by the backend (output-only), so it is now ignored during drift detection. Direct engine only (#6342).
- Add support for the cluster_policies resource type in Declarative Automation Bundles. Cluster policies are only supported in direct deployment mode.
- bundle destroy no longer counts resources that are already gone remotely in its Destroy: N deleted summary. Such deletes only clean up stale state and are not listed under the deletion prompt, so they are now excluded from the count as well, matching the terraform engine.
- bundle destroy now also removes the directory named after the bundle, not just the target directory beneath it, when workspace.root_path ends in ${bundle.name}/${bundle.target} — which includes the default root path. It is removed non-recursively, so it stays in place while another target of the same bundle is still deployed there. Previously every destroy left an empty directory behind (#6317).
- job_runs now plans skip for a run that is still in progress and when on_bundle_deploy is removed, instead of treating either case as an update. (#6357)
- Added DATABRICKS_BUNDLE_RESOURCE_MAX_WAIT (in seconds) to cap how long deploy and destroy wait for a resource. Direct engine only.
- Fixed bundle deploy on the direct engine failing with Nothing to update, or reporting a change it never applied, when a schema, catalog, volume, registered model or external location field was removed from the configuration or set outside the bundle. The update now sends the fields the plan reports as cleared instead of dropping them.
Dependency Updates
- Bump github.com/databricks/databricks-sdk-go from v0.171.0 to v0.175.0 (#6322).
- Bump Terraform provider from v1.127.0 to v1.128.0 (#6323).

Release v1.13.0 (2026-08-20)
Notable Changes
- bundle deploy now reports the per-resource actions it took, how many files it synced, and a summary of created/changed/deleted/unchanged resources; bundle destroy reports how many resources it deleted. -q prints only the summaries, -qq only warnings and errors. (#5720)
CLI
- databricks aitools install now supports Goose, installing Databricks agent skills into its skills directory.
- Error messages for failed key lookups and variable references now suggest the closest matching key if one is found. (#6208)
- Released binaries are now built against the FIPS 140-3 validated Go Cryptographic Module, with FIPS 140-3 mode enabled by default. TLS connections negotiate only FIPS-approved cipher suites, which drops ChaCha20 and CBC from what the client offers. FIPS mode can be disabled at startup with GODEBUG=fips140=off, which restores the previous TLS behaviour (#6262).
- databricks environments setup-local now removes a databricks-connect pin from [project].dependencies, an optional-dependency extra, or a dependency group when its version range conflicts with the compute target's databricks-connect version, so uv sync no longer fails with an unsatisfiable resolution when a template ships a conflicting pin. A pin that co-resolves, carries no version, or is marker-gated is left untouched, and each removed pin is reported with the new W_DBCONNECT_CONSOLIDATED warning. Wildcard version pins such as ==15.1.* are now also checked for conflicts with the environment's constraints.
Bundles
- Allow dashes in the catalog and schema names prompted by databricks bundle init, and backtick-quote the catalog and schema identifiers in the SQL generated by the built-in templates so names with dashes work at runtime.
- Fixed bundle.git.branch, bundle.git.commit, and bundle.git.origin_url being empty for bundles deployed from a workspace Git folder that has Git CLI access. The workspace API does not report git metadata for those folders, so it is now read from the Repos API instead.
- direct: job_runs deploy progress lines now include the resource key (e.g. Output from job_runs.foo: id=123: ...) so concurrent runs are easier to tell apart.
- direct: resources.job_runs can set lifecycle.triggers.on_bundle_deploy: true to re-fire the run on every bundle deploy. Removing the trigger does not recreate the existing run.
- When migrating a bundle to the direct deployment engine, resources that only the direct engine supports (e.g. instance pools, catalogs) are now skipped by the deploy that migrates the state instead of failing it. They are created by the next deploy, which runs on the migrated state.
- Warn on invalid secret_scopes permission levels (READ, WRITE, MANAGE); fail under bundle validate --strict.
- Reject secret scope permissions that name no principal, instead of failing after the scope is created.
- Write the deployment state atomically so an interrupted save cannot leave a state file that the CLI refuses to read.
- Warn when the deployment state was last written by a newer CLI version than the one running.
- Support pip extras (e.g. [train]) on local wheels in a job environment's dependencies (#1602).
Dependency Updates
- Bump github.com/databricks/databricks-sdk-go from v0.170.0 to v0.171.0 (#6320).
- Bump the Databricks Terraform provider to 1.127.0 (#6319).
- Bump Go toolchain to 1.26.6 (#6266).
- Bump Go toolchain to 1.26.7 (#6325).

Release v1.12.1
Dependency Updates
- Bump github.com/databricks/databricks-sdk-go from v0.166.0 to v0.170.0 (#6251).

Release v1.12.0
CLI
- databricks aitools install now supports Gemini CLI, installing Databricks agent skills into its skills directory.
- databricks aitools install now supports Pi, installing Databricks agent skills into its skills directory.
- A locally built CLI (go build, without release flags) now reports the next release version with a -dev prerelease, e.g. 1.12.0-dev+abcdef123456, instead of 0.0.0-dev+abcdef123456. The old string sorted below every published release even though a local build is newer than the latest release; the new one sorts above the latest release and below the release it will become, matching what goreleaser already produces for snapshot builds.
- Added the databricks environments setup-local command, which provisions (or updates) a local Python environment matched to a Databricks compute target. It resolves the target to an environment key, fetches the pinned Python version, databricks-connect version, and dependency constraints published for that key, then provisions a matched .venv with uv.
Bundles
- Added a cascade_on_destroy field to the pipeline resource to control whether destroying a pipeline also deletes its datasets (MVs, STs, Views). When unset, the server default applies; set cascade_on_destroy: false to retain the datasets on destroy. Supported with the direct deployment engine (#5846).
- Fix bundle.deployment.lock.force being ignored. The --force-lock flag's default value overwrote the value configured in databricks.yml, so setting the field had no effect and a stale deployment lock could only be overridden with the flag. (#6188)
- direct: experimental job_runs now sends a CLI-managed idempotency token on every run-now, so an SDK retry after a lost response returns the same run. Configured idempotency_token values are rejected.
- direct: the experimental job_runs resource now waits for the triggered run to finish, so other resources can reference its outcome (e.g. ${resources.job_runs.nightly.state.result_state}). A run that does not succeed fails the deploy, naming the failed task, and is run again on the next deploy. If a deploy is interrupted while waiting, the next one resumes waiting on the same run.
- direct: Fixed model serving telemetry_config drift and applied planned telemetry updates. Unsupported endpoint types now fail when telemetry is applied; create may still succeed because it drops the field (#6106).
- The cli_version field in the direct engine's deployment state (resources.json) now records the CLI version that last wrote the state. Previously it kept the version of the CLI that first created the state.
- Add support for UC secrets resource (#5861)
Dependency Updates
- Bump github.com/databricks/databricks-sdk-go from v0.166.0 to v0.169.0.
- Bump Terraform provider from v1.124.0 to v1.126.0 (#6250).

CLI
- Fixed databricks repos get/update/delete failing with object at path "..." is not a repo for Git-CLI-enabled folders (currently in preview), which the workspace API reports as directories rather than repos (#6181).
- Support dbfs:/Skills/... paths in databricks fs commands, routed to the Files API. (#6147)
Bundles
- For jobs where ai_runtime_task.code_source_path is a relative path to a local directory, the directory is now packaged into a tarball (honoring .gitignore and sync.include/sync.exclude), uploaded during deployment, and code_source_path is rewritten to the uploaded workspace path. (#6110)
- Added JSON output to bundle init. Running databricks bundle init <template> -o json now reports the files the template wrote, relative to the output directory. This lets callers that pass --output-dir learn where the template materialized instead of assuming the output is a single directory named after the project. The default text output is unchanged. (#6161)
- The terraform deployment engine is deprecated and will stop working in a future version of the CLI. Setting bundle.engine: terraform now emits a deprecation warning. See https://docs.databricks.com/aws/en/dev-tools/bundles/direct for how to migrate to the direct deployment engine. (#6099)
- Fixed the direct deployment engine planning a spurious create for an empty grants: [] list. Terraform records no grants resource for such a list, so bundle plan after bundle deployment migrate no longer reports an action for it. Emptying a previously deployed list still revokes the grants, after which the node is dropped from the deployment state instead of being reported as unchanged forever. (#6039)
- Fixed bundle generate downloading notebooks found inside a folder without their file extension. They are now exported like top-level notebooks, so a Python notebook lands as notebook.py instead of an extensionless file (#6144).
- direct: webhook_notifications.on_* destinations on jobs, tasks, and for_each_task are now compared as unordered sets. Previously the Jobs API returning these lists in a different order than submitted produced a phantom diff that bundle plan and bundle deploy could never converge past, reporting 1 to change on every run (#6060).
- Fixed a pipeline with allow_duplicate_names: true never converging on the direct engine: the field is only accepted on create/update and is never returned by the pipelines GET API, so every subsequent bundle plan reported the pipeline as a perpetual update. (#6076)
- direct: A local change to an input-only field (one the API accepts on write but never returns on read, e.g. pipelines' run_as or external locations' skip_validation) is no longer silently skipped when the new value coincidentally matches the field's fabricated remote value. Previously such a change could hit the remote_already_set shortcut and be dropped from the plan. (#6112)
- Revert usage of RedactiveSenstiveFields (added in #5896, released in 1.10.0) which lead to incorrect behaviour (permanent drift) for duration field in Postgres resources (#6179).
- Document postgres resource fields in the json schema (#6164, #6163).
- direct: Recreating a vector_search_indexes resource no longer fails with "Index ... is currently pending deletion" when the backend has not yet released the index name. The create is now retried until the name becomes available. (#6143)
Dependency Updates
- Bump github.com/databricks/databricks-sdk-go from v0.165.0 to v0.166.0. (#6175)
- Upgrade Terraform provider to 1.124.0. (#6174)

Release v1.10.0 (2026-07-29)
CLI
- ssh connect now supports specifying a serverless usage policy with --usage-policy-id
Bundles
- Fixed bundle deploy/bundle destroy failing when an app enters the transient DELETING state between plan and apply (e.g. with a saved plan); the delete is now treated as complete instead of erroring (direct engine only).
- Fixed bundle deploy/bundle destroy failing when an app is still in the transient DELETING state; the delete is now treated as complete instead of erroring (direct engine only).
- bundle destroy --force-lock now proceeds without a deployment lock when the workspace directory is at its child-node limit and cannot accept the lock file, so a deployment can still be torn down when the workspace is full.
- Empty-string values on optional (omitempty) resource fields are now dropped before deployment instead of being sent to the backend. This fixes deploys failing with errors like '' is not a valid cluster policy ID when a field such as policy_id was set to "" (often via a variable that resolved to an empty string). The behavior now matches between the terraform and direct engines and is reflected in bundle validate -o json.
- bundle validate and bundle deploy now reject a grant that is missing a principal with an error instead of a warning. Previously the deploy would start and, on the direct engine, create the securable before the grants PATCH failed (400 INVALID_PARAMETER_VALUE), leaving a partially-applied deployment.
- bundle validate and bundle deploy now reject a grant with an empty privileges list with an error. Previously, on the direct engine, such a grant never converged: the backend drops principals with no privileges, so every subsequent bundle plan reported the grant as a perpetual update.
- Fixes #6030: spurious update on catalog/schema/volume grants (direct engine); a principal granted ALL_PRIVILEGES no longer drifts when the backend also reports the concrete privileges it implies (#6064).
- Use vector search endpoint permission types that are supported by the backend (#6022).
Dependency Updates
- Bump github.com/databricks/databricks-sdk-go from v0.160.0 to v0.165.0.
- Upgrade Terraform provider to 1.123.0

Release v1.8.0 (2026-07-15)
Notable Changes
- Auto-migrate a bundle from terraform to the direct engine when bundle.engine is "direct" (or DATABRICKS_BUNDLE_ENGINE=direct) and the post-deploy dry-run migration is clean; a warning is emitted if the dry-run surfaces errors or warnings so the automatic migration is skipped.
CLI
- experimental ssh connect: bare python/pip in an interactive session now resolve to the environment interpreter ($DATABRICKS_VIRTUAL_ENV) instead of the system or cluster-libraries interpreter, so packages installed in the environment are importable without extra setup. The interactive shell is now non-login (bash -i) and the server seeds a ~/.bashrc snippet that re-prepends the environment's bin directory to PATH (#5888).
- When Claude Code runs the CLI without the Databricks AI tooling installed, the CLI now prints a one-line recommendation on stderr to run databricks aitools install. The recommendation is shown at most once per hour per Claude session, and never for human callers or aitools commands.
- Fixed databricks auth describe misattributing a profile selected via DATABRICKS_CONFIG_PROFILE as (from bundle) when run inside a bundle root (#5904).
Bundles
- bundle generate now warns when the generated configuration file is not matched by any pattern in the include section of databricks.yml (#5868).
- direct: Match UC Auto Upgrade managed property defaults with a wildcard pattern instead of enumerating each key (#5877).
- Recognize ssh:// template URLs in databricks bundle init (#5891).
- databricks bundle init now reports an actionable error when given a template URL with an unsupported protocol (http://, git://, ftp://, ftps://) instead of failing with a confusing "not a bundle template" message (#5902).
- Added an env: section to scripts.<name> for declaring environment variables that may reference ${bundle.*}, ${workspace.*}, and ${var.*} (#4179, #5299).

CLI
- An explicitly selected profile (--profile or a bundle's workspace.profile) now takes precedence over auth environment variables (DATABRICKS_HOST, DATABRICKS_TOKEN, etc.) instead of being silently shadowed by them; env vars still fill auth fields the profile leaves empty (#5096).
- Fix intermittent crashes when processing pages from API calls (#5815).
Bundles
- direct: add basic version of job_runs resource (experimental) (#5603).
- Fix permissions added to a job or pipeline by a Python (PyDABs) mutator failing to deploy with "must have exactly one owner"; the deploying identity is now set as owner, matching resources whose permissions are declared in YAML (#5821).
- Remove duplicate enum values for jsonschema.json (#5839).
- direct: volumes: support volume_path property (#5550).
- direct: Fix deploy bug when a postgres_projects, postgres_branches, or postgres_endpoints field is set to its zero value (e.g. enable_pg_native_login: false, replace_existing: false) (#5782).
- bundle run --only help now documents the + modifier syntax: prefix a task key with + to also run its upstream tasks, or suffix it with + for downstream tasks (#5760).
- direct: Recognize UC-managed catalog and schema property defaults to avoid unnecessary drift (#5865 & #5870).
- Fix bundle deploy --select <resource> skipping the resource's grants and permissions; they are now applied as part of the selected resource (#5852).
- Support purge_on_delete: true on postgres_branches so bundles can hard-delete a Lakebase branch on destroy (skipping the soft-delete retention window) (#5801).
- Support replace_existing: true on postgres_databases and postgres_roles so bundles can take over a database or role that already exists on a Lakebase branch instead of failing with ALREADY_EXISTS (#5803).
Dependency updates
- Bump databricks-sdk-go to v0.154.0 (#5855).
- Bump terraform-provider to 1.121.0 (#5857).
- Bump OpenTelemetry dependencies to v1.44.0 to address CVE-2026-41178 (#5873).

Release v1.6.0
CLI
- ssh connect now accepts a --base-environment flag to run a serverless session on a custom base environment. It takes an env.yaml path, a workspace-base-environments/... resource ID, or a base environment display name, and is rejected together with --environment-version or --cluster (#5706).
- databricks aitools install is now plugin-first: it installs the Databricks plugin through each agent's own CLI (Claude Code, Codex, GitHub Copilot) instead of copying raw skill files. Agents without a plugin (OpenCode, Antigravity) still get skill files, and Cursor prints the /add-plugin databricks step. Use --skills-only to force raw skill files for every agent, or --path <dir> to write skills to a directory (#5738).
- databricks labs list now only shows projects that can be installed (#5560).
Bundles
- direct: Fixed persistent drift on model_serving_endpoints caused by the traffic_config field (#5708).
- direct: Fix spurious update when apply_policy_default_values: true is set on job task, for-each-task, or job cluster new_cluster (#5731). Also fix spurious updates for for-each-task clusters due to missing backend defaults for data_security_mode, node_type_id, driver_node_type_id, driver_instance_pool_id, enable_elastic_disk, and enable_local_disk_encryption.
- direct: Cluster resize now falls back to regular update if resize fails due to INVALID_STATE (#5716).
- bundle generate dashboard now honors the --key flag when naming the generated resource, and rejects combining --existing-path, --existing-id, and --resource instead of silently ignoring all but one (#5492).
- Fixed bundle deployment migrate failing on model_serving_endpoints/database_instances with permissions (regression since v1.5.0) (#5775).
- After a terraform deploy, the CLI now dry-runs a migration to the direct engine (writing nothing locally or remotely) and reports the outcome via telemetry, warning if the migration could not be completed (#5797).
Dependency updates
- Bump github.com/databricks/databricks-sdk-go from v0.147.0 to v0.152.0 (#5773).
- Bump Terraform provider from v1.118.0 to v1.120.0 (#5792).

CLI
- workspace export-dir no longer aborts when a workspace object's name is not a legal local filename (e.g. a notebook named New Notebook 2026-05-04 13:54:24 whose : is illegal on Windows). Such files are now exported under a sanitized name with a warning and the export completes (#5171).
- ssh connect now opens an interactive bash login shell by default instead of the compute image's default /bin/sh, falling back gracefully when bash is unavailable. Passing an explicit remote command (-- <cmd>) is unaffected (#5687).
- ssh connect interactive sessions now start in the user's workspace home folder (/Workspace/Users/<email>) instead of the OS home directory, falling back to the OS home when that folder is unavailable (#5688).
Bundles
- Add documentation for the common bundle resource fields permissions, lifecycle, and grants in the JSON schema, so they surface in editor completions and the docs.
- bundle run now prints the modern job run URL (/jobs/<id>/runs/<id>) so that non-admin users permitted to view the run are taken to the run instead of the workspace homepage.
- References to a registered model's registered_model_id now resolve under the direct engine, matching Terraform behavior (#5621).
- Fix missing field descriptions in the bundle JSON schema for fields whose upstream API docs arrived after the field was first annotated (e.g. vector_search_endpoints.*.target_qps); stale placeholder markers no longer hide them (#5588).
- Fix bundle deploy --plan dropping a postgres_role's role_id, which caused the role to be recreated on the next deploy (#5672).
- direct: Fix spurious cluster recreate when apply_policy_default_values: true is set (#5693).
- direct: New 'deployment migrate' implementation that parses terraform state instead of fetching resources state from the backend (#5399).
Dependency updates
- Bump github.com/databricks/databricks-sdk-go from v0.141.0 to v0.147.0 (#5636).
- Bump Terraform provider from v1.117.0 to v1.118.0 (#5637).

CLI
- Improved error messages for ssh connect: when an SSH connection attempt fails, the client now fetches and prints the server's recent error logs (#5555).
- Increase the SSH server startup timeout from 10 to 45 minutes when a GPU accelerator is requested via databricks ssh connect --accelerator (#5569).
- Fix authentication falling back to the default profile in .databrickscfg when a host is already configured via the environment (e.g. DATABRICKS_HOST with DATABRICKS_TOKEN) (#5616).
- ssh: fix opening remote environment in Cursor, which previously hung on default-extension install and never opened the editor (#5619).
- Improve the error shown when databricks labs install cannot find a project's labs.yml: the message now explains that either the requested version does not exist or the project is not installable with the CLI, and links to the repository (#5559).
Bundles
- Remove API enum values and types that are still in development from the databricks-bundles Python package; these were never accepted by the backend (#5484).
- direct: Fix resolving a resource reference that is used more than once within the same field (#5558).
- Bundle variable references now accept Unicode letters in path segments (e.g. ${var.变量}). (#5532)
- Ignore remote changes for vector search direct_access_index_spec.schema_json to prevent drift when the backend normalizes the schema (#5481).
- Remove hidden, never-functional --existing-dashboard-id, --existing-dashboard-path, --existing-alert-id, and --existing-genie-space-id alias flags from bundle generate; use the documented --existing-id / --existing-path flags instead (#5591).
- engine/direct: Fix WAL corruption after two consecutive failed deploys (#5606).
- engine/direct: Don't open the deployment state WAL when a deploy's plan fails (#5607).
- Ignore unity catalog managed schema property defaults to avoid unnecessary drift (#5195).
- Add postgres_roles and postgres_databases resources to create Postgres roles and databases on a Lakebase branch (#5467, #5627).
- direct: Stop spurious recreate/rename on redeploy when the backend normalizes a resource's name-based ID (e.g. Unity Catalog lowercasing a schema or volume name) (#5599).
- Fix the generated pipeline README to suggest databricks bundle run <pipeline> --refresh <table> for running a single transformation; the previously documented --select flag is not supported by bundle run (#5252).

Release v1.3.0 (2026-06-10)
Notable Changes
- The direct deployment engine is now Generally Available and the default for new deployments. To opt out, set engine: terraform under bundle in your databricks.yml or set DATABRICKS_BUNDLE_ENGINE=terraform. Existing deployments keep their current engine; see https://docs.databricks.com/aws/en/dev-tools/bundles/direct to migrate.
CLI
- Added the databricks quickstart command, a short introduction to the CLI that prints a human-friendly guide interactively and an agent-oriented version when run non-interactively (#5464).
- Add databricks version --check to report whether a newer CLI version is available and print the upgrade command for the detected install method (#5469).
- databricks auth describe now verifies credentials against both the workspace and account endpoints before reporting a failure, fixing false "Unable to authenticate" errors for account console profiles (#5479).
- databricks auth login no longer prompts for workspace selection when logging in to an account console host (https://accounts.*). Pass --workspace-id explicitly to store a workspace ID on such a profile (#5504).
- databricks auth profiles --skip-validate no longer makes any network calls; the host metadata fetch is skipped along with validation (#5530).
Bundles
- Set the default data_security_mode to DATA_SECURITY_MODE_AUTO in bundle templates (#5452).
- Mark vector search index index_subtype as backend_default to prevent drift after deployment (#5454).
- bundle deployment migrate: handle resources added to or removed from databricks.yml since the last Terraform deploy (#5463).
- Add the genie_spaces bundle resource for managing Databricks Genie spaces as code, plus bundle generate genie-space to import an existing space. Direct deployment engine only (#5282).
- Fix spurious recreate of schemas and volumes whose names use mixed case (#5531).

Release v1.2.1 (2026-06-04)
Bundles
- direct: Fix updating the apps after the Go SDK upgrade (#5444)

Release v1.2.0
CLI
- experimental open now opens every DABs resource type that has a workspace URL, picking up catalogs, schemas, volumes, database_instances, database_catalogs, synced_database_tables, postgres_catalogs, postgres_synced_tables, quality_monitors, vector_search_endpoints, and vector_search_indexes (#5346).
Bundles
- Retry transient HTTP 5xx and 408 errors in direct deployment engine (#5349, #5364).
- Preserve .designer.ipynb suffix when translating notebook task paths so Lakeflow Designer files referenced from a notebook_task resolve correctly in the workspace (#5370).
- Fix script output dropping last line without trailing newline (#4995).
- engine/direct: Add --select flag to bundle plan and bundle deploy to plan/deploy a subset of resources (e.g. --select my_job or --select jobs.my_job); resources referenced by the selection are included transitively (#5413).
- Support purge_on_delete: true on postgres_projects so bundles can hard-delete a Lakebase project on destroy (skipping the soft-delete retention window) (#5414).
- Support terraform references in direct engine (#5392)
- Support lifecycle.started for SQL warehouses (#5348)
Dependency updates
- Bump Go toolchain to 1.26.4 (#5420).
- Bump github.com/databricks/databricks-sdk-go from v0.136.0 to v0.141.0 (#5361)
- Bump Terraform provider from v1.115.0 to v1.117.0 (#5421)

The Databricks CLI is now generally available with version v1.0.0 as the first major release 🚀.From this version on, the CLI follows semantic versioning (see README).This change does not impact DABs or other existing commands beyond the changes listed below.The 0.299.x line continues to receive security-critical patches through May 20, 2027; see SECURITY for the support policy.Notable Changes
- Starting with v1.0.0, the CLI will use immutable release tags to increase security against supply chain attacks.
- Breaking change: OAuth tokens for interactive logins (auth_type = databricks-cli) are now stored in the OS-native secure store by default (Keychain on macOS, Credential Manager on Windows, Secret Service on Linux) instead of ~/.databricks/token-cache.json. After upgrading, run databricks auth login once per profile to re-authenticate; cached tokens from older versions are not migrated. To keep the previous file-backed storage, set DATABRICKS_AUTH_STORAGE=plaintext or add auth_storage = plaintext under [__settings__] in ~/.databrickscfg (the env var takes precedence over the config setting), then re-run databricks auth login. On systems where the OS keyring is not reachable (e.g. Linux containers without a D-Bus session bus), the CLI transparently falls back to the file cache when reading tokens so legacy token-cache.json entries remain accessible without manual configuration.
CLI
- Added databricks aitools command group for installing Databricks skills into your coding agents (Claude Code, Cursor, Codex CLI, OpenCode, GitHub Copilot, Antigravity). Skills are fetched from github.com/databricks/databricks-agent-skills and either symlinked into each agent's skills directory or copied into the current project. Use databricks aitools install to set up, update to pull newer versions, list to see what's available, and uninstall to remove them. Pick where they go with --scope=project|global (--scope=both is accepted on update and list).
- [__settings__].default_profile is now consulted as a fallback by databricks api, databricks auth token, and bundle commands when neither --profile nor DATABRICKS_CONFIG_PROFILE is set. databricks auth token continues to give precedence to DATABRICKS_HOST over default_profile. For bundle commands, default_profile only applies when the bundle does not pin its own workspace.host.
- Fixed bug where auth commands did not load the DEFAULT profile properly during auth where type is databricks-cli.
- databricks workspace import-dir now skips .git, .databricks, and node_modules directories during recursive imports. To import one of these directories deliberately, pass it as SOURCE_PATH (#5118).
- databricks postgres create-role --help now documents the --json body shape and rejects the common mistake of wrapping the body in {"role": ...} client-side with a hint pointing at the correct shape (#5111).
- databricks aitools list honors --output json, emitting a structured {release, skills[...], summary{}} document so coding agents and CI can consume the skill/version/installation matrix without scraping the tabular text output (#5233).
Bundles
- Make sure warnings asking for approval are understood by agents (#5239)
- Support replace_existing: true on postgres_branches and postgres_endpoints so bundles can manage the implicitly-created production branch and primary read-write endpoint of a Lakebase project.
- Add postgres_catalogs resource to bind a Unity Catalog catalog to a Postgres database on a Lakebase Autoscaling branch (#5265).
- Add postgres_synced_tables resource to sync a Unity Catalog Delta table into a Postgres table on a Lakebase Autoscaling branch (#5268).
- engine/direct: Changes to state file now persisted to .wal file right away instead of being saved in the end (#5149)

CLI
- Moved file-based OAuth token cache management from the SDK to the CLI. No user-visible change; part of a three-PR sequence that makes the CLI the sole owner of its token cache (#5056).
- Remove the --experimental-is-unified-host flag and stop reading experimental_is_unified_host from .databrickscfg profiles and the DATABRICKS_EXPERIMENTAL_IS_UNIFIED_HOST env var. Unified hosts are now detected exclusively from /.well-known/databricks-config discovery. The experimental_is_unified_host field is retained as a no-op in databricks.yml for schema compatibility (#5047).
- Added interactive pagination for list commands that have a row template (jobs, clusters, apps, pipelines, etc.). When stdin, stdout, and stderr are all TTYs, databricks <resource> list now streams 50 rows at a time and prompts [space] more [enter] all [q|esc] quit. ENTER can be interrupted by q/esc/Ctrl+C between pages. Colors and alignment match the existing non-paged output; column widths stay stable across pages. Piped output and --output json are unchanged (#5015).
- Added experimental OS-native secure token storage opt-in via DATABRICKS_AUTH_STORAGE=secure. Legacy file-backed token storage remains the default (#5008, #5013).
- Fixed a panic in databricks warehouses update-default-warehouse-override when invoked without all required positional arguments (e.g. picking a warehouse from the interactive drop-down and then hitting an index-out-of-range crash). The command now validates arguments up front and returns a usage error. Fixes #5070 via #5079.
Bundles
- Translate relative paths in alert_task.workspace_path on job tasks to fully qualified workspace paths, matching the behavior of other task path fields. Applies to both regular tasks and for_each_task nested tasks (#4836).
Dependency updates
- Added github.com/zalando/go-keyring as a new dependency (dormant until a later release enables experimental secure-storage for OAuth tokens) (#5008).

CLI
- Added --limit flag to all paginated list commands for client-side result capping (#4984). On jobs list and jobs list-runs the former API page-size flag was renamed to --page-size (hidden) to avoid collision.
- Accept yes in addition to y for confirmation prompts, and show [y/N] to indicate that no is the default.
- Cache /.well-known/databricks-config lookups under ~/.cache/databricks/<version>/host-metadata/ so repeat CLI invocations against the same host skip the ~700ms discovery round trip.
- Deprecated auth env. The command is hidden from help listings and prints a deprecation warning to stderr; it will be removed in a future release.
Bundles
- Remove experimental-jobs-as-code template, superseded by pydabs (#4999).
- Prompt before destroying or recreating Lakebase resources (database instances, synced database tables, postgres projects and branches) (#5052).
- Treat deleted resources as not running in the fail-on-active-runs check (#5044).
- engine/direct: Added support for Vector Search Endpoints (#4887).
- engine/direct: Exclude deploy-only fields (e.g. lifecycle) from the Apps update mask so requests that change both description and lifecycle.started in the same deploy no longer fail with INVALID_PARAMETER_VALUE (#5042, #5051).
- engine/direct: Fix phantom diffs from depends_on reordering in job tasks (#4990).
Dependency updates
- Bump github.com/databricks/databricks-sdk-go from v0.126.0 to v0.128.0 (#4984, #5031).
- Bump Go toolchain to 1.25.9 (#5004).

Notable Changes
- This release includes a fix for error downloading Terraform: unable to verify checksums signature: openpgp: key expired error observed when running databricks bundle deploy command.
Bundles
- Use hardcoded ArmoredPublicKey for TF binary installation (#5019)

Dependency updates
- Bump Go toolchain to 1.25.9 (#5004)

CLI
- Auth commands now accept a profile name as a positional argument (#4840)
- Add auth logout command for clearing cached OAuth tokens and optionally removing profiles (#4613, #4616, #4647)
Bundles
- Added support for lifecycle.started option for apps (#4672)
- engine/direct: Fix permissions for resources.models (#4941)
- Fix resource references not correctly resolved in apps config section (#4964)
- Allow run_as for dashboards with embed_credentials set to false (#4961)
- direct: Pass changed fields into update mask for apps instead of wildcard (#4963)
- engine/direct: Fix deploy of configurations with dots in maps keys (#4977)

Notable Changes
- Direct deployment engine for DABs is now in Public Preview. Documentation at docs/direct.md.
CLI
- Auth commands now error when --profile and --host conflict (#4841)
- Add --force-refresh flag to databricks auth token to force a token refresh even when the cached token is still valid (#4767)
Bundles
- Deduplicate grant entries with duplicate principals or privileges during initialization (#4801)
- Fix bundle deployment bind to always pull remote state before modifying (#4892)
- engine/direct: Fix drift in grants resource due to privilege reordering (#4794)
- engine/direct: Fix 400 error when deploying grants with ALL_PRIVILEGES (#4801)
- engine/direct: Fix unwanted recreation of secret scopes when scope_backend_type is not set (#4834)
- engine/direct: Fix bind and unbind for non-Terraform resources (#4850)
- engine/direct: Fix deploying removed principals (#4824)
- engine/direct: Fix secret scope permissions migration from Terraform to Direct engine (#4866)

Notable Changes
- Databricks Asset Bundles have been renamed to Declarative Automation Bundles (DABs). This is a non-breaking change; no code or configuration modifications are required. See the FAQ.
- Add bundle.engine config setting to select the deployment engine (terraform or direct). The bundle.engine setting takes precedence over the DATABRICKS_BUNDLE_ENGINE environment variable. When the configured engine doesn't match existing deployment state, a warning is issued and the existing engine is used (#4749, #4782)
CLI
- Add databricks auth switch command for setting the default profile (#4651)
- Add positional argument support to auth logout (#4744)
- Strip trailing slash from host in auth login, auth token, and configure commands (#4633)
Bundles
- Standardize personal_schemas enum across bundle templates (#4401)
- engine/direct: Fix permanent drift on experiment name field (#4627)
- engine/direct: Fix permissions state path to match input config schema (#4703)
- Add default project name and success message to default-scala template (#4661)
- Skip enum validation for unresolved variable references (#4752)
- engine/direct: Support references to/from grants (#4774)

Changelog
- [Release] Release v0.294.0

Changelog
- Add depguard rule to prevent imports of experimental/ packages (#4662)
- Add lint rule for context.Background() in non-test code (#4664)
- Added permissions support for Lakebase Database projects (#4626)
- Preserve manual .gitattributes entries after genkit regeneration (#4667)
- Remove context.Background() usage in libs/filer (#4657)
- Remove nil context fallback from libs/log (#4656)
- SSH: bump serverless environment version and expose a flag for it (#4663)
- Simulate app service principal and job permissions in test server (#4644)
- Use env.UserHomeDir(ctx) in experimental/ssh package (#4658)
- Use env.UserHomeDir(ctx) instead of os.UserHomeDir() (#4654)
- Use t.Chdir() instead of manual os.Chdir patterns in tests (#4660)
- Use t.Context() instead of context.Background() in tests (#4655)
- [Release] Release v0.292.0
- acc: Fix postgres_endpoints integration tests (#4665)

Changelog
- [Release] Release v0.292.0

Changelog
- [Release] Release v0.291.0

Changelog
- Include missing NEXT_CHANGELOG entries (#4610)
- [Release] Release v0.290.1

Changelog
- [Release] Release v0.290.0

Changelog
- Update NEXT_CHANGELOG.md with proper sections (#4556)
- [Release] Release v0.289.1

Changelog
- Update NEXT_CHANGELOG.md for the v0.288.0 release (#4498)
- [Release] Release v0.288.0

Changelog
- [Release] Release v0.287.0

Changelog
- [Release] Release v0.286.0

Changelog
- [Release] Release v0.285.0
- acc: Fix test output after TF upgrade (#4358)

Changelog
- Update NEXT_CHANGELOG.md (#4347)
- [Release] Release v0.284.0

Changelog
- Fixes for NEXT_CHANGELOG.md (#4281)
- [Release] Release v0.283.0

Changelog
- [Release] Release v0.282.0

Changelog
- [Release] Release v0.281.0

Changelog
- [Release] Release v0.280.0

Changelog
- [Release] Release v0.279.0

Changelog
- [Release] Release v0.278.0

Changelog
- Add changelog entry for #3904 (#3910)
- Add default-minimal template (#3885)
- Add test recording permissions API behaviour (#3900)
- Add validation and translation for served_models and served_entities in serving endpoints (#3880)
- Automatically sign CLI binary using Goreleaser (#3879)
- Collect metrics of source-linked deployment usage in non-development … (#3894)
- Fix oss-source pipeline errors when using the Databricks CLI (#3889)
- Fix race condition in the ssh tunnel handover logic (#3888)
- Homebrew tap action needs to depend on goreleaser-unix (#3914)
- Merge unix and windows SHA files into one (#3915)
- Pass public key name in every client ssh connection (#3775)
- Select single permissions level per principal (#3904)
- Stricter validation of DATABRICKS_BUNDLE_ENGINE (#3875)
- Update release workflow to use repository context for artifact upload (#3911)
- Update testserver jobs to add server-side fields like real backend (#3909)
- [Python] Move python directory (#3851)
- [Release] Release v0.277.0
- direct: Add DoUpdateWithChanges (#3901)
- direct: grants support (#3883)
- gh_parse.py: show slowest test durations, total time (#3903)

Changelog
CLI
- Remove previously added flags from the jobs create and pipelines create commands. (#3870)
Bundles
- Updated the default-python template to follow the Lakeflow conventions: pipelines as source files, pyproject.toml (#3712).
- Fix a permissions bug adding second IS_OWNER and causing "The job must have exactly one owner." error. Introduced in 0.274.0. (#3850)

Notable Changes
- Python support for Databricks Asset Bundles is now generally available.
CLI
- Remove inplace mode for the --progress-format flag (#3811)
- Remove json mode for the --progress-format flag (#3812)
- Deprecate the --progress-format flag (#3819)
Bundles
- Add support for --bind flag in bundle generate (#3782)
- Add pydabs template replacing experimental-jobs-as-code template (#3806)
- You can now use the top-level python section instead of experimental/python (#3540)

Bundles
- Fix a panic in TF when it fails to read the job (#3799)
- For secret scopes, no longer remove current user's permissions (#3780)
- Automatically add owner permissions during bundle initialization, this makes final permissions visible in 'bundle validate -o json' (#3780)

Notable Changes
- (via Terraform v1.92.0) DABs will no longer try to update pipeline permissions upon pipeline deletion. This fixes PERMISSION_ERROR upon 'bundle destroy'
for pipelines that have run_as setting enabled (described in https://community.databricks.com/t95/data-engineering/dab-dlt-destroy-fails-due-to-ownership-permissions-mismatch/td-p/132101)
The downside is that if 'permissions:' block is removed from the resource, DABs will not try anymore to restore permissions to just the owner of the pipeline.
CLI
- Add the --configure-serverless flag to databricks auth login to configure Databricks Connect to use serverless.
Dependency updates
- Upgrade Go SDK to 0.82.0 (#3769)
- Upgrade TF provider to 1.92.0 (#3772)
Bundles
- Updated the internal lakeflow-pipelines template to use an "src" layout (#3671).
- Fix for pip flags with equal sign being incorrectly treated as local file names (#3766)

Release v0.272.0
Bundles
- Fix processing short pip flags in environment dependencies (#3708)
- Add support for referencing local files in -e pip flag for environment dependencies (#3708)
- Add error for when an etag is specified in dashboard configuration. Setting etags was never supported / valid in bundles but now users will see this error during validation rather than deployment. (#3723)
- Fix PIP flag processing in pipeline environment dependencies (#3734)

Changelog
- [Release] Release v0.271.0

Notable Changes
- Add 'databricks bundle plan' command. This command shows the deployment plan for the current bundle configuration without making any changes. (#3530)
Bundles
- Add 'databricks bundle plan' command (#3530)
- Add new Lakeflow Pipelines support for bundle generate (#3568)
- Fix bundle deploy to not update permissions or grants for unbound resources (#3642)
- Introduce new bundle variable: ${workspace.current_user.domain_friendly_name} (#3623)
- Improve the output of bundle run when bundle is not deployed (#3652)

Changelog
- [Release] Release v0.269.0

Bundles
- Add support for schemas in Python support ([#3389])(
- Updated templates to use the new "environment_version" property instead of the deprecated "client" property (#3554).

CLI
- Introduce retries to databricks psql command (#3492)
- Add rule files for coding agents working on the CLI code base (#3245)
Dependency updates
- Upgrade TF provider to 1.88.0 (#3529)
- Upgrade Go SDK to 0.82.0
Bundles
- Update default-python template to make DB Connect work out of the box for unit tests, using uv to install dependencies (#3254)
- Add support for TaskRetryMode for continuous jobs (#3529)
- Add support for specifying database instance as an application resource (#3529)
- Allow referencing job libraries outside bundle root without the need to specify sync root (#2842)
- Add top level run_as support for Lakeflow Declarative Pipelines (#3307)

⚠️ Breaking Change ⚠️
DABs now return an error when paths are incorrectly defined relative to the job or
pipeline definition location instead of the configuration file location. Previously, the CLI would show a
warning and fallback to resolving the path relative to the resource location. Users must update their bundle
configurations to define all relative paths relative to the configuration file where the path is specified.
See more details here: (#3225)Notable Changes
- Add support volumes in Python support ([#3383])(
Bundles
- [Breaking Change] Remove deprecated path fallback mechanism for jobs and pipelines (#3225)
- Add support for Lakebase synced database tables in DABs (#3467)
- Rename Delta Live Tables to Lakeflow Declarative Pipelines in the default-python template (#3476).
- Fixed bundle init not working on Standard tier (#3496)

Changelog
CLI
- Fix "cache: token not found" for auth token command (#3447)
Dependency updates
- Upgrade TF provider to 1.87.0 (#3430)
- Upgrade Go SDK to 0.81.0 (#3449)
Bundles
- Add support for Lakebase database instances in DABs (#3283)
- Add support for Lakebase database catalogs in DABs (#3436)
- Improve error message for SDK/API errors (#3379)
- Separate generated classes between jobs and pipelines in Python support (#3428)

Changelog
- [Release] Release v0.264.2

Release v0.264.1
Notable Changes
- Fixed regression in databricks auth login for OAuth redirect URL (#3417)
Bundles
- Add supported enum values to JSON schema for volume grant privileges (#3395)

Changelog
Dependency updates
- Upgrade TF provider to 1.86.0 (#3374)
- Update Go SDK to 0.79.0 (#3376)
CLI
- Fixed panic when providing a CLI command with an incorrect JSON input (#3398)
Bundles
- Changed logic for resolving ${resources...} references. Previously this would be done by terraform at deploy time. Now if it references a field that is present in the config, it will be done by DABs during bundle loading (#3370)
- Add support for tagging pipelines (#3086)
- Add warning for when an invalid value is specified for an enum field (#3050)
- Add support for running specified job tasks instead of all job tasks (#3388)

CLI
- Show "DEFAULT" as the default profile for databricks auth login #3252
Bundles
- Always set default value for source field for tasks if not explicitly set already (#3359)
- Fix panic in auto completion handler for bundler run/open. Regression introduced in 0.259.0. #3358
- Fix error propagation in the bundle generate dashboard command. Regression introduced in 0.259.0. #3354

Release v0.262.0
CLI
- Fixed auth login ignoring DATABRICKS_CONFIG_FILE environmental variable when saving profile (#3266)
Bundles
- Modified run flag validation to allow --refresh and --full-refresh flags to be used together (#3300)
- Fixed bundle generate for not yet deployed apps (#3319)
- Respect export format for notebooks on bundle generate (#3316)

Notable Changes
The following CLI commands now have additional required positional arguments:
- alerts-v2 update-alert ID UPDATE_MASK - Update an alert (v2)
- database update-database-instance NAME UPDATE_MASK - Update a database instance
- external-lineage create-external-lineage-relationship SOURCE TARGET - Create an external lineage relationship
- external-lineage update-external-lineage-relationship UPDATE_MASK SOURCE TARGET - Update an external lineage relationship
- external-metadata update-external-metadata NAME UPDATE_MASK SYSTEM_TYPE ENTITY_TYPE - Update external metadata
- feature-store update-online-store NAME UPDATE_MASK CAPACITY - Update an online store
- lakeview create-schedule DASHBOARD_ID CRON_SCHEDULE - Create a schedule
- lakeview create-subscription DASHBOARD_ID SCHEDULE_ID SUBSCRIBER - Create a subscription
- lakeview update-schedule DASHBOARD_ID SCHEDULE_ID CRON_SCHEDULE - Update a schedule
- network-connectivity update-private-endpoint-rule NETWORK_CONNECTIVITY_CONFIG_ID PRIVATE_ENDPOINT_RULE_ID UPDATE_MASK - Update a private endpoint rule
CLI
- Add required query parameters as positional arguments in CLI commands (#3289)
Bundles
- Fixed an issue where allow_duplicate_names field on the pipeline definition was ignored by the bundle (#3274)
- Add warning for when required bundle fields are not set (#3044)

Notable Changes
- Added support for creating SQL warehouses in DABs (#3129)
Dependency updates
- Upgrade Go SDK to 0.75.0 (#3256)
CLI
- Add databricks psql command to connect to Lakebase with a single command (#3128)
Bundles
- Jobs that use cluster policy default values for their cluster configuration now correctly update those defaults on every deployment (#3255).
- Add upper and lower helper methods for bundle templates (#3242)

Release v0.259.0
Notable Changes
- Add support for arbitrary scripts in DABs. Users can now define scripts in their bundle configuration. These scripts automatically inherit the bundle's credentials for authentication. They can be invoked with the bundle run command. (#2813)
- Error when the absolute path to databricks.yml contains a glob character. These are: *, ?, [, ] and ^. If the path to the databricks.yml file on your local filesystem contains one of these characters, that could lead to incorrect computation of glob patterns for the includes block and might cause resources to be deleted. After this patch users will not be at risk for unexpected deletions due to this issue. (#3096)
- Diagnostics messages are no longer buffered to be printed at the end of command, flushed after every mutator (#3175)
- Diagnostics are now always rendered with forward slashes in file paths, even on Windows (#3175)
- "bundle summary" now prints diagnostics to stderr instead of stdout in text output mode (#3175)
- "bundle summary" no longer prints recommendations, it will only prints warnings and errors (#3175)
Bundles
- Fix default search location for whl artifacts (#3184). This was a regression introduced in 0.255.0.
- The job tasks are now sorted by task key in "bundle validate/summary" output (#3212)

Release v0.258.0
Notable Changes
- Switch default-python template to use pyproject.toml + dynamic_version in dev target. uv is now required. (#3042)
Dependency updates
- Upgraded TF provider to 1.84.0 (#3151)
CLI
- Fixed an issue where running databricks auth login would remove the cluster_id field from profiles in .databrickscfg. The login process now preserves the cluster_id field. (#2988)
Bundles
- Added support for pipeline environment field (#3153)
- "bundle summary" now prints diagnostic warnings to stderr (#3123)
- "bundle open" will print the URL before opening the browser (#3168)

Release v0.257.0
Bundles
- Improve error message for host mismatch between bundle and profile used (#3100)
- Remove support for deprecated experimental/pydabs config, use experimental/python instead. See Configuration in Python
. (#3102)
- Pass through OIDC token env variable to Terraform (#3113)
- The default-python template now prompts if you want to use serverless compute (default to yes) (#3051).
API Changes
- Removed databricks custom-llms command group.
- Added databricks ai-builder command group.
- Added databricks feature-store command group.

Bundles
- When building Python artifacts as part of "bundle deploy" we no longer delete dist, build, *egg-info and __pycache__ directories (#2982)
- When glob for wheels is used, like "*.whl", it will filter out different version of the same package and will only take the most recent version (#2982)
- Add preset presets.artifacts_dynamic_version that automatically enables dynamic_version: true on all "whl" artifacts (#3074)
- Update client version to "2" for the serverless variation of the default-python template (#3083)
- Fix reading dashboard contents when the sync root is different than the bundle root (#3006)
- Fix variable resolution for lookup variables with other references (#3054)
- Allow users to override the Terraform version to use by setting the DATABRICKS_TF_VERSION environment variable (#3069)

Notable Changes
- Fix databricks auth login to tolerate URLs copied from the browser (#3001).
CLI
- Use OS aware runner instead of bash for run-local command (#2996)
Bundles
- Fix "bundle summary -o json" to render null values properly (#2990)
- Fix dashboard generation for already imported dashboard (#3016)
- Fixed null pointer de-reference if artifacts missing fields (#3022)
- Update bundle templates to also include resources/*/*.yml (#3024)
- Apply YAML formatter on default-python and dbt-sql templates (#3026)

Bundles
- Added experimental.skip_artifact_cleanup flag (#2980)
- Add an experimental project template for Lakeflow Declarative Pipelines (#2959)

Dependency updates
- Upgrade SDK to v0.70.0 (#2920)
- Upgrade TF provider to v1.81.0 (#2936)

Changelog
Dependency updates
- Upgraded Go SDK to 0.69.0 (#2867)
- Upgraded to TF provider 1.79.0 (#2869)
Bundles
- Remove unused fields from resources.models schema: creation_timestamp, last_updated_timestamp, latest_versions and user_id. Using them now raises a warning (#2828).
- Preserve folder structure for app source code in bundle generate (#2848)
- Fix normalising requirements file path in dependencies section (#2861)
- Fix default-python template not to add environments when serverless=yes and include_python=no (#2866)
- Fix handling of Unicode characters in Python support (#2873)
- Add support for secret scopes in DABs (#2744)
- Make artifacts.*.type optional in bundle JSON schema (#2881)
- Fix support for spot_bid_max_price field in Python support (#2883)

Release v0.251.0
Dependency updates
- Upgrade to use Go SDK 0.68.0 (#2823)
Bundles
- Fix dynamic_version when sync root != bundle root (#2805)

Changelog
- [Release] Release v0.250.0

Release v0.249.0
CLI
- Added exclude-from and include-from flags support to sync command (#2660)
Bundles
- Correctly translate paths to local requirements.txt file in environment dependencies (#2736)
- Check for running resources with --fail-on-active-runs before any mutative operation during deploy (#2743)

Release v0.248.0
Notable Changes
- Python for Databricks Asset Bundles is now in Public Preview. This feature extends bundles so that you can define jobs and pipelines as Python code, dynamically create jobs and pipelines using metadata, and modify jobs and pipelines defined in YAML or Python during bundle deployment. For more information and to get started see Configuration in Python.
- Fixed a regression with pipeline library globs introduced in 0.247.0 (#2723). The issue caused glob patterns to fail when using paths relative to a directory that is not the bundle root.
Dependency updates
- Upgraded Go SDK to 0.63.0 (#2716)
- Upgraded TF provider to 1.73.0 (#2728)
CLI
- Added an error when invalid subcommand is provided for CLI commands (#2655)
- Added dry-run flag support to sync command (#2657)
Bundles
- Do not use app config section in test templates and generated app configuration (#2599)
- Do not exit early when checking incompatible tasks for specified DBR (#2692)
- Removed include/exclude flags support from bundle sync command (#2718)
- Do not clean up Python artifacts dist and build folder in "bundle validate", do it in "bundle deploy". This reverts the behaviour introduced in 0.245.0 (#2722)
API Changes
- Added enable-export-notebook, enable-notebook-table-clipboard and enable-results-downloading workspace-level commands.
- Removed unused timeout and no-wait flags for clusters and pipelines

Changelog
- Fix git source regression introduced in v0.247.0 (#2699)

Release v0.247.0
CLI
- Added include/exclude flags support to sync command (#2650)
Bundles
- Added support for model serving endpoints in deployment bind/unbind commands (#2634)
- Added include/exclude flags support to bundle sync command (#2650)
- Added JSON schema for resource permissions (#2674)
- Removed pipeline 'deployment' field from jsonschema (#2653)
- Updated JSON schema for deprecated pipeline fields (#2646)
- The --config-dir and --source-dir flags for "bundle generate app" are now relative to CWD, not bundle root (#2683)
- Reverts #2549 to resolve issues with Web Terminal host mismatch (#2685)

Release v0.246.0
Notable Changes
Previously ".internal" folder under artifact_path was not cleaned up as expected. In this release this behaviour is fixed and now DABs cleans up this folder before uploading artifacts to it.Dependency updates
- Bump golangci-lint version to v2.0.2 from v1.63.4 (#2586).
CLI
- Include supported values for enum positional args in docs (#2557)
- Upgrade Go SDK to 0.61.0 (#2575)
- Fix databricks api command usage string to include PATH positional argument (#2591)
Bundles
- Fixed cleaning up artifact path .internal folder (#2572)
- Fixed sync include/exclude not working correctly on Windows (#2609)
- Added support for quality monitors in deployment bind/unbind commands (#2583)
- Comment out email_notifications section in builtin templates (#2565)
- New DATABRICKS_BUNDLE_RESTRICTED_CODE_EXECUTION environment variable that rejects running scripts and Python code when it is set (#2598)
- Upgrade TF provider to 1.71.0 (#2611)

Release v0.245.0
Bundles
- Processing 'artifacts' section is now done in "bundle validate" (adding defaults, inferring "build", asserting required fields) (#2526)
- When uploading artifacts, include relative path in log message (#2539)
- Added support for clusters in deployment bind/unbind commands (#2536)
- Added support for volumes in deployment bind/unbind commands (#2527)
- Added support for dashboards in deployment bind/unbind commands (#2516)
- Added support for registered models in deployment bind/unbind commands (#2556)
- Added a mismatch check when host is defined in config and as an env variable (#2549)
- New attribute on artifacts entries: dynamic_version. When set to true, it patches the wheel with dynamic version suffix so it is always used by Databricks environments, even if original wheel version is the same. Intended for development loop on interactive clusters. (#2520)

Release v0.244.0
CLI
- Fixed "can't evaluate field Name in type interface{}" for "databricks queries list" command (#2451)
- Fixed query-history list command failing with 'executing "command" at <.>: range cant iterate over' (#2506)
- Include tarballs in releases (#2515)
Bundles
- Support all version identifiers as per PEP440 in environment deps (#2522)
API Changes
- Added databricks genie execute-message-attachment-query command.
- Added databricks genie get-message-attachment-query-result command.
- databricks genie execute-message-query marked as Deprecated.
- databricks genie get-message-query-result-by-attachment marked as Deprecated.

CLI:
- Upgrade Go SDK to 0.59.0 (#2425).
Bundles:
- Added a warning when config section is used in apps (#2416).
- Switch to use GET workspaces-files/{name} instead of workspace/export for state files to avoid 10MB limit (#2423).
- Use schema field for pipeline in builtin template (#2347).
- Add warning when variable interpolation is used for auth fields (#2399).
- Add warning when include is used in config files other than databricks.yml (#2389).
- Add support for schemas in deployment bind/unbind commands (#2406).
- Do not modify/create .gitignore in bundle root (#2429).
- Raise an error when there are multiple local libraries with the same basename used (#2382).
- Upgrade TF provider to 1.68.0 (#2426).
API Changes:
- Changed databricks experiments log-inputs command with new required argument order.
- Added databricks genie get-space command.
- Added databricks providers list-provider-share-assets command.
- Changed databricks shares update-permissions command return type to become non-empty.
OpenAPI commit (2025-03-03)

[Release] Release v0.242.0
Notable changes:
Starting this version CLI does not load bundle auth information when CLI command is executed inside the bundle directory with explicitly provided via -p flag profile.
For more details see the related GitHub issue #1358CLI:
- Do not load host from bundle for CLI commands when profile flag is used (#2335).
- Fixed accessing required path parameters in CLI generation when --json flag (#2373).
Bundles:
- Provide instructions for testing in the default-python template (#2355).
- Remove run_as from the built-in templates (#2044).
- Change warning about incomplete permissions section into a recommendation (#2043).
- Refine mode: production diagnostic output (#2236).
- Support serverless mode in default-python template (explicit prompt) (#2377).
- Set default data_security_mode to "SINGLE_USER" in bundle templates (#2372).
- Fixed spark version check for clusters defined in the same bundle (#2374).
API Changes:
- Added databricks genie get-message-query-result-by-attachment command.
OpenAPI commit (2025-02-11)

This is a bugfix release to address an issue where jobs with tasks with a libraries section with PyPI packages could not be deployed.
Bundles:
- Revert changes related to basename check for local libraries (#2345).

Bundles:
- Added support for double underscore variable references (#2203).
- Do not wait for app compute to start on bundle deploy (#2144).
- Remove bundle.git.inferred (#2258).
- libs/python: Remove DetectInterpreters (#2234).
API Changes:
- Added databricks access-control command group.
- Added databricks serving-endpoints http-request command.
- Changed databricks serving-endpoints create command with new required argument order.
- Changed databricks serving-endpoints get-open-api command return type to become non-empty.
- Changed databricks recipients update command return type to become non-empty.
OpenAPI commit (2025-01-22)
Dependency updates:
- Bump github.com/databricks/databricks-sdk-go from 0.55.0 to 0.56.1 (#2238).
- Upgrade TF provider to 1.64.1 (#2247).

- Added text output templates for apps list and list-deployments (#2175).
- Fix duplicate "apps" entry in help output (#2191).
- Allow yaml-anchors in schema (#2200).
- Show an error when non-yaml files used in include section (#2201).
- Set WorktreeRoot to sync root outside git repo (#2197).
- fix: Detailed message for using source-linked deployment with file_path specified (#2119).
- Allow using variables in enum fields (#2199).
- Add experimental-jobs-as-code template (#2177).
- Reading variables from file (#2171).
- Fixed an apps message order and added output test (#2174).
- Default to forward slash-separated paths for path translation (#2145).
- Include a materialized copy of built-in templates (#2146).

- Filter out system clusters in cluster picker (#2131).
- Process all the fields in top level request object even if it contains request body (#2155).
- Added support for Databricks Apps in DABs (#1928).
- Allow artifact path to be located outside the sync root (#2128).
- Retry app deployment if there is an active deployment in progress (#2153).
- Resolve variables in a loop (#2164).
- Improve resolution of complex variables within complex variables (#2157).
- Added output message to warn about slower deployments with apps (#2161).
- Patch references to UC schemas to capture dependencies automatically (#1989).
- Format default-python template (#2110).
- Encourage the use of root_path in production to ensure single deployment (#1712).
- Log warnings to stderr for "bundle validate -o json" (#2109).
- Move merge fix-ups after variable resolution (#2125).
- Enable linter 'unconvert' and fix the issues found (#2136).
- Coverage for acceptance tests (#2123).
- Add acceptance tests for builtin templates (#2135).
- Add a unique schema for recreate pipeline test (#2159).
- Migrate resolution tests to acceptance tests (#2143).
- Update runner for the publish-winget job (#2105).
- Add a test for complex variable resolution with 3 levels (#2163).
- Changed databricks account federation-policy update command with new required argument order.
- Changed databricks account service-principal-federation-policy update command with new required argument order.
- Upgrade TF provider to 1.63.0 (#2162).
- Bump golangci-lint version to v1.63.4 from v1.63.1 (#2114).
- Bump astral-sh/setup-uv from 4 to 5 (#2116).
- Bump golang.org/x/oauth2 from 0.24.0 to 0.25.0 (#2080).
- Bump github.com/hashicorp/hc-install from 0.9.0 to 0.9.1 (#2079).
- Bump golang.org/x/term from 0.27.0 to 0.28.0 (#2078).
- Bump github.com/databricks/databricks-sdk-go from 0.54.0 to 0.55.0 (#2126).

- Fix finding Python within virtualenv on Windows (#2034).
- Include missing field descriptions in JSON schema (#2045).
- Add validation for volume referenced from artifact_path (#2050).
- Handle ${workspace.file_path} references in source-linked deployments (#2046).
- Set the write bit for files written during template initialization (#2068).

- Allow overriding compute for non-development mode targets (#1899).
- Avoid panic if Config.
Workspace.
CurrentUser.
User is not set (#1993).
- Show an error when using a cluster override with 'mode: production' (#1994).
- Added databricks account federation-policy command group.
- Added databricks account service-principal-federation-policy command group.
- Added databricks aibi-dashboard-embedding-access-policy delete command.
- Added databricks aibi-dashboard-embedding-approved-domains delete command.
- Upgrade TF provider to 1.62.0 (#2030).
- Upgrade Go SDK to 0.54.0 (#2029).
- Bump TF codegen dependencies to latest (#1961).
- Bump golang.org/x/term from 0.26.0 to 0.27.0 (#1983).
- Bump golang.org/x/sync from 0.9.0 to 0.10.0 (#1984).
- Bump github.com/databricks/databricks-sdk-go from 0.52.0 to 0.53.0 (#1985).
- Bump golang.org/x/crypto from 0.24.0 to 0.31.0 (#2006).
- Bump golang.org/x/crypto from 0.30.0 to 0.31.0 in /bundle/internal/tf/codegen (#2005).

- Add DABs support for Unity Catalog volumes (#1762).
- Support lookup by name of notification destinations (#1922).
- Extend "notebook not found" error to warn about missing extension (#1920).
- Skip sync warning if no sync paths are defined (#1926).
- Add validation for single node clusters (#1909).
- Fix segfault in bundle summary command (#1937).
- Add the bundle_uuid helper function for templates (#1947).
- Add default value for volume_type for DABs (#1952).
- Properly read Git metadata when running inside workspace (#1945).
- Upgrade TF provider to 1.59.0 (#1960).
- Breakout variable lookup into separate files and tests (#1921).
- Add golangci-lint v1.62.2 (#1953).
- Bump golang.org/x/term from 0.25.0 to 0.26.0 (#1907).
- Bump github.com/Masterminds/semver/v3 from 3.3.0 to 3.3.1 (#1930).
- Bump github.com/stretchr/testify from 1.9.0 to 1.10.0 (#1932).
- Bump github.com/databricks/databricks-sdk-go from 0.51.0 to 0.52.0 (#1931).

- Make TableName field part of quality monitor schema (#1903).
- Do not prepend paths starting with ~ or variable reference (#1905).
- Fix workspace extensions filer accidentally reading notebooks (#1891).
- Fix template initialization when running on Databricks (#1912).
- Source-linked deployments for bundles in the workspace (#1884).
- Added integration test to deploy bundle to /Shared root path (#1914).
- Update filenames used by bundle generate to use .<resource-type>.yml (#1901).
- Extract functionality to detect if the CLI is running on DBR (#1889).
- Consolidate test helpers for io/fs (#1906).
- Use fs.
FS interface to read template (#1910).
- Use filer.
Filer to write template instantiation (#1911).

- Do not execute build on bundle destroy (#1882).
- Add support for non-Python ipynb notebooks to DABs (#1827).
- Added databricks credentials command group.
- Changed databricks lakeview create command with new required argument order.
- Upgrade TF provider to 1.58.0 (#1900).
- Bump golang.org/x/sync from 0.8.0 to 0.9.0 (#1892).
- Bump golang.org/x/text from 0.19.0 to 0.20.0 (#1893).
- Bump golang.org/x/mod from 0.21.0 to 0.22.0 (#1895).
- Bump golang.org/x/oauth2 from 0.23.0 to 0.24.0 (#1894).
- Bump github.com/databricks/databricks-sdk-go from 0.49.0 to 0.51.0 (#1878).

- Clean host URL in the auth login command (#1879).
- Fix bundle run when run interactively (#1880).
- Fix relative path resolution for dashboards on Windows (#1881).
- Address goreleaser deprecation warning (#1872).
- Update actions/github-script to v7 (#1873).
- Use Go 1.23 (#1871).
- [Internal] Always write message for manual integration test trigger (#1874).
- Add cmd-exec-id to user agent (#1808).
- Added E2E test to run Python wheels on interactive cluster created in bundle (#1864).
- Bump github.com/hashicorp/terraform-json from 0.22.1 to 0.23.0 (#1877).

- Fixed adding /Workspace prefix for resource paths (#1866).

- Add privacy notice to README (#1841).
- Add support for AI/BI dashboards (#1743).
- Added validator for folder permissions (#1824).
- Add bundle generate variant for dashboards (#1847).
- Use SetPermissions instead of UpdatePermissions when setting folder permissions based on top-level ones (#1822).
- Attempt to reduce test flakiness on Windows (#1845).
- Reuse resource resolution code for the run command (#1858).
- [Internal] Automatically trigger integration tests on PR (#1857).
- [Internal] Add test instructions for external contributors (#1863).
- Add libs/dyn/jsonsaver (#1862).
- Bump github.com/fatih/color from 1.17.0 to 1.18.0 (#1861).

- Added JSON input validation for CLI commands (#1771).
- Support Git worktrees for sync (#1831).
- Add bundle summary to display URLs for deployed resources (#1731).
- Added a warning when incorrect permissions used for /Workspace/Shared bundle root (#1821).
- Show actionable errors for collaborative deployment scenarios (#1386).
- Fix path to repository-wide exclude file (#1837).
- Fixed typo in converting cluster permissions (#1826).
- Ignore metastore permission error during template generation (#1819).
- Handle normalization of dyn.
KindTime into an any type (#1836).
- Added support for pip options in environment dependencies (#1842).
- Fix race condition when restarting continuous jobs (#1849).
- Fix pipeline in default-python template not working for certain workspaces (#1854).
- Add "output" flag to the bundle sync command (#1853).
- Move utility functions dealing with IAM to libs/iamutil (#1820).
- Remove unused IS_OWNER constant (#1823).
- Assert SDK version is consistent in the CLI generation process (#1814).
- Fixed unmarshalling json input into interface{} type (#1832).
- Fix TestAccFsMkdirWhenFileExistsAtPath in isolated Azure environments (#1833).
- Add behavioral tests for examples from the YAML spec (#1835).
- Remove Terraform conversion function that's no longer used (#1840).
- Encode assumptions about the dashboards API in a test (#1839).
- Add script to make testing of code on branches easier (#1844).
- Added databricks disable-legacy-dbfs command group.
- Upgrade TF provider to 1.54.0 (#1852).
- Bump github.com/databricks/databricks-sdk-go from 0.48.0 to 0.49.0 (#1843).

- Add an error if state files grow bigger than the export limit (#1795).
- Always prepend bundle remote paths with /Workspace (#1724).
- Add resource path field to bundle workspace configuration (#1800).
- Add validation for files with a .(resource-name).yml extension (#1780).
- Remove deprecated or readonly fields from the bundle schema (#1809).
- Changed databricks git-credentials create, databricks git-credentials delete, databricks git-credentials get, databricks git-credentials list, databricks git-credentials update commands .
- Changed databricks repos create, databricks repos delete, databricks repos get, databricks repos update command .
- Upgrade TF provider to 1.53.0 (#1815).
- Bump golang.org/x/term from 0.24.0 to 0.25.0 (#1811).
- Bump golang.org/x/text from 0.18.0 to 0.19.0 (#1812).
- Bump github.com/databricks/databricks-sdk-go from 0.47.0 to 0.48.0 (#1810).

- Added support for creating all-purpose clusters (#1698).
- Reduce time until the prompt is shown for bundle run (#1727).
- Use Unity Catalog for pipelines in the default-python template (#1766).
- Add verbose flag to the "bundle deploy" command (#1774).
- Fixed full variable override detection (#1787).
- Add sub-extension to resource files in built-in templates (#1777).
- Fix panic in apply_presets.go (#1796).
- Assert tokens are redacted in origin URL when username is not specified (#1785).
- Refactor jobs path translation (#1782).
- Add JobTaskClusterSpec validate mutator (#1784).
- Pin Go toolchain to 1.22.7 (#1790).
- Modify SetLocation test utility to take full locations as argument (#1788).
- Simplified isFullVariableOverrideDef implementation (#1791).
- Sort tasks by task_key before generating the Terraform configuration (#1776).
- Trim trailing whitespace (#1794).
- Move trampoline code into trampoline package (#1793).
- Rename RootPath -> BundleRootPath (#1792).
- Changed databricks apps delete command to return .
- Changed databricks apps deploy command with new required argument order.
- Changed databricks apps start command to return .
- Changed databricks apps stop command to return .
- Added databricks temporary-table-credentials command group.
- Added databricks serving-endpoints put-ai-gateway command.
- Added databricks disable-legacy-access command group.
- Added databricks account disable-legacy-features command group.
- Upgrade to Go SDK 0.47.0 (#1799).
- Upgrade to TF provider 1.52 (#1781).
- Bump golang.org/x/mod from 0.20.0 to 0.21.0 (#1758).
- Bump github.com/hashicorp/hc-install from 0.7.0 to 0.9.0 (#1772).

- Added listing cluster filtering for cluster lookups (#1754).
- Expand library globs relative to the sync root (#1756).
- Fixed generated YAML missing 'default' for empty values (#1765).
- Use periodic triggers in all templates (#1739).
- Use the friendly name of service principals when shortening their name (#1770).
- Fixed detecting full syntax variable override which includes type field (#1775).
- Pass copy of dyn.
Path to callback function (#1747).
- Make bundle JSON schema modular with $defs (#1700).
- Alias variables block in the Target struct (#1748).
- Add end to end integration tests for bundle JSON schema (#1726).
- Fix artifact upload integration tests (#1767).
- Added databricks quality-monitors regenerate-dashboard command.
- Bump golang.org/x/term from 0.23.0 to 0.24.0 (#1757).
- Bump golang.org/x/oauth2 from 0.22.0 to 0.23.0 (#1761).
- Bump golang.org/x/text from 0.17.0 to 0.18.0 (#1759).
- Bump github.com/databricks/databricks-sdk-go from 0.45.0 to 0.46.0 (#1760).

- Do not error if we cannot prompt for a profile in auth login (#1745).
- Pass along $AZURE_CONFIG_FILE to Terraform process (#1734).
- Add prompt when a pipeline recreation happens (#1672).
- Use materialized views in the default-sql template (#1709).
- Update templates to latest LTS DBR (#1715).
- Make lock optional in the JSON schema (#1738).
- Do not suppress normalisation diagnostics for resolving variables (#1740).
- Include a permissions section in all templates (#1713).
- Fixed complex variables are not being correctly merged from include files (#1746).
- Fixed variable override in target with full variable syntax (#1749).
- Consider serverless clusters as compatible for Python wheel tasks (#1733).
- PythonMutator: explain missing package error (#1736).
- Add dyn.
Time to box a timestamp with its original string value (#1732).
- Fix streaming of stdout, stdin, stderr in cobra test runner (#1742).
- Bump github.com/Masterminds/semver/v3 from 3.2.1 to 3.3.0 (#1741).

- Disable prompt for storage-credentials get command (#1723).
- Do not treat empty path as a local path (#1717).
- Correctly mark PyPI package name specs with multiple specifiers as remote libraries (#1725).
- Improve error handling for /Volumes paths in mode: development (#1716).
- Ignore CLI version check on development builds of the CLI (#1714).
- Added databricks resource-quotas command group.
- Added databricks policy-compliance-for-clusters command group.
- Added databricks policy-compliance-for-jobs command group.
- Bump github.com/databricks/databricks-sdk-go from 0.44.0 to 0.45.0 (#1719).
- Revert hc-install version to 0.7.0 (#1711).

- Added filtering flags for cluster list commands (#1703).
- Allow users to configure paths (including outside of the bundle root) to synchronize to the workspace. (#1694).
- Add configurable presets for name prefixes, tags, etc. (#1490).
- Add support for requirements libraries in Job Tasks (#1543).
- Remove reference to "dbt" in the default-sql template (#1696).
- Pause continuous pipelines when 'mode: development' is used (#1590).
- Report all empty resources present in error diagnostic (#1685).
- Improves detection of PyPI package names in environment dependencies (#1699).
- Add import option for PyDABs (#1693).
- Make fileset take optional list of paths to list (#1684).
- Pass through paths argument to libs/sync (#1689).
- Correctly mark package names with versions as remote libraries (#1697).
- Share test initializer in common helper function (#1695).
- Make pydabs/venv_path optional (#1687).
- Use API mocks for duplicate path errors in workspace files extensions client (#1690).
- Fix prefix preset used for UC schemas (#1704).

- Add command line autocomplete to the fs commands (#1622).
- Add trailing slash to directory to produce completions for (#1666).
- Fix ability to import the CLI repository as module (#1671).
- Fix host resolution order in auth login (#1370).
- Print text logs in import-dir and export-dir commands (#1682).
- Expand and upload local wheel libraries for all task types (#1649).
- Clarify file format required for the config-file flag in bundle init (#1651).
- Fixed incorrectly cleaning up python wheel dist folder (#1656).
- Merge job parameters based on their name (#1659).
- Fix glob expansion after running a generic build command (#1662).
- Upload local libraries even if they don't have artifact defined (#1664).
- Fix python wheel task integration tests (#1648).
- Skip pushing Terraform state after destroy (#1667).
- Enable Spark JAR task test (#1658).
- Run Spark JAR task test on multiple DBR versions (#1665).
- Stop tracking file path locations in bundle resources (#1673).
- Update VS Code settings to match latest value from IDE plugin (#1677).
- Use service.
NamedIdMap to make lookup generation deterministic (#1678).
- [Internal] Remove dependency to the openapi package of the Go SDK (#1676).
- Upgrade TF provider to 1.50.0 (#1681).
- Upgrade Go SDK to 0.44.0 (#1679).
- Changed databricks account budgets create command .
New request type is .
- Changed databricks account budgets create command to return .
- Changed databricks account budgets delete command .
New request type is .
- Changed databricks account budgets delete command to return .
- Changed databricks account budgets get command .
New request type is .
- Changed databricks account budgets get command to return .
- Changed databricks account budgets list command to require request of .
- Changed databricks account budgets list command to return .
- Changed databricks account budgets update command .
New request type is .
- Changed databricks account budgets update command to return .
- Added databricks account usage-dashboards command group.
- Changed databricks model-versions get command to return .
- Changed databricks cluster-policies create command with new required argument order.
- Changed databricks cluster-policies edit command with new required argument order.
- Added databricks clusters update command.
- Added databricks genie command group.
- Changed databricks permission-migration migrate-permissions command .
New request type is .
- Changed databricks permission-migration migrate-permissions command to return .
- Changed databricks account workspace-assignment delete command to return .
- Changed databricks account workspace-assignment update command with new required argument order.
- Changed databricks account custom-app-integration create command with new required argument order.
- Changed databricks account custom-app-integration list command to require request of .
- Changed databricks account published-app-integration list command to require request of .
- Removed databricks apps command group.
- Added databricks notification-destinations command group.
- Changed databricks shares list command to require request of .
- Changed databricks alerts create command .
New request type is .
- Changed databricks alerts delete command .
New request type is .
- Changed databricks alerts delete command to return .
- Changed databricks alerts get command with new required argument order.
- Changed databricks alerts list command to require request of .
- Changed databricks alerts list command to return .
- Changed databricks alerts update command .
New request type is .
- Changed databricks alerts update command to return .
- Changed databricks queries create command .
New request type is .
- Changed databricks queries delete command .
New request type is .
- Changed databricks queries delete command to return .
- Changed databricks queries get command with new required argument order.
- Changed databricks queries list command to return .
- Removed databricks q

- Add resource for UC schemas to DABs (#1413).
- Use dynamic walking to validate unique resource keys (#1614).
- Regenerate TF schema (#1635).
- Add upgrade and upgrade eager flags to pip install call (#1636).
- Added test for negation pattern in sync include exclude section (#1637).
- Use precomputed terraform plan for bundle deploy (#1640).

- Add UUID function to bundle template functions (#1612).
- Upgrade TF provider to 1.49.0 (#1617).
- Upgrade TF provider to 1.49.1 (#1626).
- Support multiple locations for diagnostics (#1610).
- Split artifact cleanup into prepare step before build (#1618).
- Move to a single prompt during bundle destroy (#1583).
- Add tests for the Workspace API readahead cache (#1605).
- Update Python dependencies before install when upgrading a labs project (#1624).

- Do not buffer files in memory when downloading (#1599).
- Allow artifacts (JARs, wheels) to be uploaded to UC Volumes (#1591).
- Upgrade TF provider to 1.48.3 (#1600).
- Fixed job name normalisation for bundle generate (#1601).
- Add UUID to uniquely identify a deployment state (#1595).
- Track multiple locations associated with a dyn.
Value (#1510).
- Attribute Terraform API requests the CLI (#1598).
- Implement readahead cache for Workspace API calls (#1582).
- Add read-only mode for extension aware workspace filer (#1609).
- Bump github.com/databricks/databricks-sdk-go from 0.43.0 to 0.43.2 (#1594).

- Override complex variables with target overrides instead of merging (#1567).
- Rewrite local path for libraries in foreach tasks (#1569).
- Change SetVariables mutator to mutate dynamic configuration instead (#1573).
- Return early in bundle destroy if no deployment exists (#1581).
- Let notebook detection code use underlying metadata if available (#1574).
- Remove schema override for variable default value (#1536).
- Print diagnostics in 'bundle deploy' (#1579).
- Update actions/upload-artifact to v4 (#1559).
- Use Go 1.22 to build and test (#1562).
- Move bespoke status call to main workspace files filer (#1570).
- Add new template (#1578).
- Add regression tests for CLI error output (#1566).
- Bump golang.org/x/mod from 0.18.0 to 0.19.0 (#1576).
- Bump golang.org/x/term from 0.21.0 to 0.22.0 (#1577).

- Fix logic error in #1532 (#1564).

- Fix non-default project names not working in dbt-sql template (#1500).
- Improve bundle validate output (#1532).
- Fixed resolving variable references inside slice variable (#1550).
- Fixed bundle not loading when empty variable is defined (#1552).
- Use vfs.
Path for filesystem interaction (#1554).
- Replace vfs.
Path with extension-aware filer when running on DBR (#1556).
- merge.Override: Fix handling of dyn.
NilValue (#1530).
- Compare .
Kind() instead of direct equality checks on a dyn.
Value (#1520).
- PythonMutator: register product in user agent extra (#1533).
- Ignore dyn.
NilValue when traversing value from dyn.
Map (#1547).
- Add extra tests for the sync block (#1548).
- PythonMutator: add diagnostics (#1531).
- PythonMutator: support omitempty in PyDABs (#1513).
- PythonMutator: allow insert 'resources' and 'resources.jobs' (#1555).

- Add link to documentation for Homebrew installation to README (#1505).
- Fix databricks configure to use DATABRICKS_CONFIG_FILE environment variable if exists as config file (#1325).
- Fix conditional in query in default-sql template (#1479).
- Remove user credentials specified in the Git origin URL (#1494).
- Serialize dynamic value for bundle validate output (#1499).
- Override variables with lookup value even if values has default value set (#1504).
- Pause quality monitors when "mode: development" is used (#1481).
- Return fs.
ModeDir for Git folders in the workspace (#1521).
- Upgrade TF provider to 1.48.0 (#1527).
- Added support for complex variables (#1467).
- Add randIntn function (#1475).
- Avoid multiple file tree traversals on bundle deploy (#1493).
- Clean up unused code (#1502).
- Use dyn.
InvalidValue to indicate absence (#1507).
- Add ApplyPythonMutator (#1430).
- Set bool pointer to disable lock (#1516).
- Allow the any type to be set to nil in convert.
FromTyped (#1518).
- Properly deal with nil values in convert.
FromTyped (#1511).
- Return dyn.
InvalidValue instead of dyn.
NilValue when errors happen (#1514).
- PythonMutator: replace stdin/stdout with files (#1512).
- Add context type and value to path rewriting (#1525).
- Added schedule CRUD commands to databricks lakeview.
- Added subscription CRUD commands to databricks lakeview.
- Added databricks apps start command.
- Bump golang.org/x/text from 0.15.0 to 0.16.0 (#1482).
- Bump golang.org/x/term from 0.20.0 to 0.21.0 (#1483).
- Bump golang.org/x/mod from 0.17.0 to 0.18.0 (#1484).
- Bump golang.org/x/oauth2 from 0.20.0 to 0.21.0 (#1485).
- Bump github.com/briandowns/spinner from 1.23.0 to 1.23.1 (#1495).
- Bump github.com/spf13/cobra from 1.8.0 to 1.8.1 (#1496).
- Bump github.com/databricks/databricks-sdk-go from 0.42.0 to 0.43.0 (#1522).

- Fix SQL schema selection in default-sql template (#1471).
- Copy-editing for SQL templates (#1474).
- Upgrade TF provider to 1.47.0 (#1476).
- Use latest version of goreleaser action (#1477).

- Publish Docker images (#1353).
- Add support for multi-arch Docker images (#1362).
- Do not prefill https:// in prompt for Databricks Host (#1364).
- Add better documentation for the auth login command (#1366).
- Add URLs for authentication documentation to the auth command help (#1365).
- Fix compute override for foreach tasks (#1357).
- Transform artifact files source patterns in build not upload stage (#1359).
- Convert between integer and float in normalization (#1371).
- Disable locking for development mode (#1302).
- Resolve variable references inside variable lookup fields (#1368).
- Added validate mutator to surface additional bundle warnings (#1352).
- Upgrade terraform-provider-databricks to 1.40.0 (#1376).
- Print host in bundle validate when passed via profile or environment variables (#1378).
- Cleanup remote file path on bundle destroy (#1374).
- Add docs URL for run_as in error message (#1381).
- Enable job queueing by default (#1385).
- Added support for job environments (#1379).
- Processing and completion of positional args to bundle run (#1120).
- Add legacy option for run_as (#1384).
- Changed databricks lakehouse-monitors cancel-refresh command with new required argument order.
- Changed databricks lakehouse-monitors create command with new required argument order.
- Changed databricks lakehouse-monitors delete command with new required argument order.
- Changed databricks lakehouse-monitors get command with new required argument order.
- Changed databricks lakehouse-monitors get-refresh command with new required argument order.
- Changed databricks lakehouse-monitors list-refreshes command with new required argument order.
- Changed databricks lakehouse-monitors run-refresh command with new required argument order.
- Changed databricks lakehouse-monitors update command with new required argument order.
- Changed databricks account workspace-assignment update command to return response.
- Bump github.com/databricks/databricks-sdk-go from 0.37.0 to 0.38.0 (#1361).
- Bump golang.org/x/net from 0.22.0 to 0.23.0 (#1380).

- Add allow list for resources when bundle run_as is set (#1233).
- Make bundle validation print text output by default (#1335).
- Added auth describe command (#1244).
- Fixed message for successful auth describe run (#1336).
- Use UserName field to identify if service principal is used (#1310).
- Allow unknown properties in the config file for template initialization (#1315).
- Remove support for DATABRICKS_BUNDLE_INCLUDES (#1317).
- Make bundle.deployment optional in the bundle schema (#1321).
- Fix the generated DABs JSON schema (#1322).
- Make bundle loaders return diagnostics (#1319).
- Add bundle debug terraform command (#1294).
- Allow specifying CLI version constraints required to run the bundle (#1320).
- Retain location information of variable reference (#1333).
- Define dyn.
Mapping to represent maps (#1301).
- Return diag.
Diagnostics from mutators (#1305).
- Fix flaky test in libs/process (#1314).
- Move path field to bundle type (#1316).
- Load bundle configuration from mutator (#1318).
- Return diagnostics from config.
Load (#1324).
- Return warning for nil primitive types during normalization (#1329).
- Include dyn.
Path in normalization warnings and errors (#1332).
- Make normalization return warnings instead of errors (#1334).

- Propagate correct User-Agent for CLI during OAuth flow (#1264).
- Add usage string when command fails with incorrect arguments (#1276).
- Include dyn.
Path as argument to the visit callback function (#1260).
- Inline logic to set a value in dyn.
SetByPath (#1261).
- Add assertions for the dyn.
Path argument to the visit callback (#1265).
- Add dyn.
MapByPattern to map a function to values with matching paths (#1266).
- Filter current user from resource permissions (#1262).
- Retain location annotation when expanding globs for pipeline libraries (#1274).
- Added deployment state for bundles (#1267).
- Do CheckRunningResource only after terraform.
Write (#1292).
- Rewrite relative paths using dyn.
Location of the underlying value (#1273).
- Push deployment state right after files upload (#1293).
- Make Append function to dyn.
Path return independent slice (#1295).
- Move bundle tests into bundle/tests (#1299).
- Upgrade Terraform provider to 1.38.0 (#1308).
- Add integration test for mlops-stacks initialization (#1155).
- Update actions/setup-python to v5 (#1290).
- Update codecov/codecov-action to v4 (#1291).
- Changed databricks catalogs list command.
- Changed databricks online-tables create command.
- Changed databricks lakeview publish command.
- Added databricks lakeview create command.
- Added databricks lakeview get command.
- Added databricks lakeview get-published command.
- Added databricks lakeview trash command.
- Added databricks lakeview update command.
- Moved settings related commands to databricks settings and databricks account settings.
- Bump golang.org/x/oauth2 from 0.17.0 to 0.18.0 (#1270).
- Bump golang.org/x/mod from 0.15.0 to 0.16.0 (#1271).
- Update Go SDK to v0.35.0 (#1300).
- Update Go SDK to v0.36.0 (#1304).

- The SDK update fixes fs cp calls timing out when copying large files.
- Fix summary command when internal Terraform config doesn't exist (#1242).
- Configure cobra.
NoArgs for bundle commands where applicable (#1250).
- Fixed building Python artifacts on Windows with WSL (#1249).
- Add --validate-only flag to run validate-only pipeline update (#1251).
- Only transform wheel libraries when using trampoline (#1248).
- Return application_id for service principal lookups (#1245).
- Support relative paths in artifact files source section and always upload all artifact files (#1247).
- Fix DBConnect support in VS Code (#1253).
- Added test to verify scripts.
Execute mutator works correctly (#1237).
- Added databricks permission-migration command group.
- Updated nesting of the databricks settings and databricks account settings commands
- Changed databricks vector-search-endpoints delete-endpoint command with new required argument order.
- Changed databricks vector-search-indexes create-index command with new required argument order.
- Changed databricks vector-search-indexes delete-data-vector-index command with new required argument order.
- Changed databricks vector-search-indexes upsert-data-vector-index command with new required argument order.
- Bump github.com/stretchr/testify from 1.8.4 to 1.9.0 (#1252).
- Update Go SDK to v0.34.0 (#1256).

- Improved error message when no .databrickscfg (#1223).
- Use Go SDK Iterators when listing resources with the CLI (#1202).
- Only set ComputeID value when --compute-id flag provided (#1229).
- Add correct tag value for models in dev mode (#1230).
- Upgrade Terraform provider to 1.37.0 (#1235).
- Fix CLI nightlies on our UC workspaces (#1225).
- Handle alias types for map keys in toTyped conversion (#1232).

- Add support for UC Volumes to the databricks fs commands (#1209).
- Use dynamic configuration model in bundles (#1098).
- Allow use of variables references in primitive non-string fields (#1219).
- Add an experimental default-sql template (#1051).
- Add an experimental dbt-sql template (#1059).
- Add fork-user to winget release workflow (#1214).
- Use any as type for data sources and resources in tf/schema (#1216).
- Avoid infinite recursion when normalizing a recursive type (#1213).
- Fix issue where interpolating a new ref would rewrite unrelated fields (#1217).
- Use dyn.
Value as input to generating Terraform JSON (#1218).
- Changed databricks lakehouse-monitors update command with new required argument order.
- Added databricks online-tables command group.
- Bump Terraform provider to v1.36.2 (#1215).
- Bump github.com/databricks/databricks-sdk-go from 0.32.0 to 0.33.0 (#1222).

- Prompt for account profile only for account-level command execution instead of during databricks labs install flow (#1128).
- Bring back --json flag for workspace-conf set-status command (#1151).
- Set run_as permissions after variable interpolation (#1141).
- Add functionality to visit values in dyn.
Value tree (#1142).
- Add dynvar package for variable resolution with a dyn.
Value tree (#1143).
- Add support for anyOf to skip_prompt_if (#1133).
- Added bundle generate pipeline command (#1139).
- Use MockWorkspaceClient from SDK instead of WithImpl mocking (#1134).
- Bump github.com/databricks/databricks-sdk-go from 0.29.0 to 0.29.1 (#1137).
- Bump github.com/hashicorp/terraform-json from 0.20.0 to 0.21.0 (#1138).
- Update actions/setup-go to v5 (#1148).
- Update codecov/codecov-action to v3 (#1149).
- Use latest patch release of Go toolchain (#1152).

- Fix windows style file paths in fs cp command (#1118).
- Do not require positional arguments if they should be provided in JSON (#1125).
- Always require path parameters as positional arguments (#1129).
- Add debug log line for when bundle init is run from non-TTY interface (#1117).
- Added databricks bundle generate job command (#1043).
- Support passing job parameters to bundle run (#1115).
- Bump golang.org/x/oauth2 from 0.15.0 to 0.16.0 (#1124).

- Tweak command groups in CLI help (#1092).
- Fixed storage-credentials list command in text output (#1094).
- Allow account client auth with environment variables when no .databrickscfg file present (#1097).
- Always log with text format by default (#1096).
- Added exec.
NewCommandExecutor to execute commands with correct interpreter (#1075).
- Use resource key as name in permissions code (#1087).
- Add support for reprompts if user input does not match template schema (#946).
- Improve experience for multiple builtin templates (#1052).
- Improve error when bundle root is not writable (#1093).
- Change recommended production deployment path from /Shared to /Users (#1091).
- Allow referencing bundle resources by name (#872).
- Make libs/exec fallback to sh if bash cannot be found (#1114).
- Functionality to walk a config.
Value tree (#1081).
- Rename libs/config -> libs/dyn (#1086).
- Added codecov integration on code push (#1095).
- Consolidate functions to convert dyn.
Value to native types (#1100).
- Define constant for the invalid dyn.
Value (#1101).
- Changed databricks serving-endpoints update-config command with new required argument order.
- Changed databricks account ip-access-lists create command with new required argument order.
- Changed databricks account ip-access-lists replace command with new required argument order.
- Changed databricks account ip-access-lists update command with new required argument order.
- Changed databricks ip-access-lists create command with new required argument order.
- Changed databricks ip-access-lists replace command with new required argument order.
- Changed databricks ip-access-lists update command with new required argument order.
- Bump github.com/hashicorp/terraform-exec from 0.19.0 to 0.20.0 (#1088).
- Bump go.uber.org/mock from 0.3.0 to 0.4.0 (#1089).
- Bump github.com/hashicorp/terraform-json from 0.18.0 to 0.20.0 (#1090).
- Bump golang.org/x/term from 0.15.0 to 0.16.0 (#1103).
- Bump github.com/cloudflare/circl from 1.3.3 to 1.3.7 (#1105).
- Bump golang.org/x/sync from 0.5.0 to 0.6.0 (#1104).
- Upgrade golang.org/x/crypto to v0.17.0 in internal module (#1110).
- Upgrade Go SDK to v0.29.0 (#1111).