Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions .nextchanges/bundles/dbt-sql-classic-dbr-16-4.md
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
The `dbt-sql` bundle template now uses Databricks Runtime 16.4 LTS (up from 15.4 LTS) for classic (non-serverless) compute.
7 changes: 7 additions & 0 deletions acceptance/bundle/templates/dbt-sql-classic/input.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
{
"project_name": "my_dbt_sql",
"http_path": "/sql/2.0/warehouses/f00dcafe",
"default_catalog": "main",
"personal_schemas": "yes",
"serverless": "no"
}
2 changes: 2 additions & 0 deletions acceptance/bundle/templates/dbt-sql-classic/out.test.toml

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

45 changes: 45 additions & 0 deletions acceptance/bundle/templates/dbt-sql-classic/output.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,45 @@

>>> [CLI] bundle init dbt-sql --config-file ./input.json --output-dir output

Welcome to the dbt template for Declarative Automation Bundles!

A workspace was selected based on your current profile. For information about how to change this, see https://docs.databricks.com/dev-tools/cli/profiles.html.
workspace_host: [DATABRICKS_URL]

📊 Your new project has been created in the 'my_dbt_sql' directory!
If you already have dbt installed, just type 'cd my_dbt_sql; dbt init' to get started.
Refer to the README.md file for full "getting started" guide and production setup instructions.


>>> diff.py [TESTROOT]/bundle/templates/dbt-sql-classic/../dbt-sql/output/my_dbt_sql/resources/my_dbt_sql.job.yml output/my_dbt_sql/resources/my_dbt_sql.job.yml
--- [TESTROOT]/bundle/templates/dbt-sql-classic/../dbt-sql/output/my_dbt_sql/resources/my_dbt_sql.job.yml
+++ output/my_dbt_sql/resources/my_dbt_sql.job.yml
@@ -16,5 +16,4 @@
tasks:
- task_key: dbt
- environment_key: default
dbt_task:
project_directory: ../
@@ -27,8 +26,16 @@
- 'dbt run --target=${bundle.target} --vars "{ dev_schema: ${workspace.current_user.short_name} }"'

- environments:
- - environment_key: default
- spec:
- environment_version: "5"
- dependencies:
- - dbt-databricks>=1.8.0,<2.0.0
+ libraries:
+ - pypi:
+ package: dbt-databricks>=1.8.0,<2.0.0
+
+ new_cluster:
+ spark_version: 16.4.x-scala2.12
+ node_type_id: [NODE_TYPE_ID]
+ data_security_mode: DATA_SECURITY_MODE_AUTO
+ num_workers: 0
+ spark_conf:
+ spark.master: "local[*, 4]"
+ spark.databricks.cluster.profile: singleNode
+ custom_tags:
+ ResourceClass: SingleNode
7 changes: 7 additions & 0 deletions acceptance/bundle/templates/dbt-sql-classic/script
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
# With serverless: no, the dbt-sql job runs on a classic new_cluster instead of a
# serverless environment. Only the job resource differs from the serverless dbt-sql
# variant, so we diff just that file against the dbt-sql golden. This locks in the
# new_cluster spark_version (latest_lts_dbr_version).
trace $CLI bundle init dbt-sql --config-file ./input.json --output-dir output
trace diff.py $TESTDIR/../dbt-sql/output/my_dbt_sql/resources/my_dbt_sql.job.yml output/my_dbt_sql/resources/my_dbt_sql.job.yml
rm -fr output
7 changes: 1 addition & 6 deletions libs/template/templates/dbt-sql/library/versions.tmpl
Original file line number Diff line number Diff line change
@@ -1,10 +1,5 @@
{{define "latest_lts_dbr_version" -}}
15.4.x-scala2.12
{{- end}}

{{/* TODO: unused — no dbt-sql template references this macro. Remove it. */}}
{{define "latest_lts_db_connect_version_spec" -}}
>=16.4,<16.5
16.4.x-scala2.12
{{- end}}

{{/* The serverless environment version to use.
Expand Down
Loading