Skip to content

Document conservative DB Connect / serverless env upgrade rule - #6407

Open
rugpanov wants to merge 1 commit into
mainfrom
serverless-upgrade-guidance
Open

Document conservative DB Connect / serverless env upgrade rule#6407
rugpanov wants to merge 1 commit into
mainfrom
serverless-upgrade-guidance

Conversation

@rugpanov

@rugpanov rugpanov commented Aug 27, 2026

Copy link
Copy Markdown
Contributor

Changes

Follow-up to #6378 — documents the conservative DB Connect upgrade rule reviewers asked for, so the next serverless env bump goes smoothly.

  • Tightened the comment above conservative_db_connect_version_spec into a crisp upgrade rule
  • Added .agents/rules/template-versions.md: keep the DB Connect pin conservative (bump only when the pinned DBR falls out of support, not to match the newest serverless env), keep env-version / Python / DB Connect mutually compatible, and only keep serverless_environment_version in sync across templates

Why

Tests

  • Docs only — the comment lives in a {{/* */}} block, so rendered output and acceptance goldens are unchanged

Follow-ups in separate PRs: a bump-serverless-env-version skill, and dead-macro cleanup in dbt-sql.

This pull request and its description were written by Isaac.

@rugpanov
rugpanov force-pushed the serverless-upgrade-guidance branch from 7b018ef to baf5cb3 Compare August 27, 2026 20:40
Follow-up to #6378. Tightens the comment above
conservative_db_connect_version_spec into crisp upgrade guidance, and adds
an .agents/rules doc capturing the conservative DB Connect upgrade rule and
the env-version / Python / DB Connect consistency invariant so the next
serverless environment bump is smoother.

Co-authored-by: Isaac <no-reply@databricks.com>
@rugpanov
rugpanov force-pushed the serverless-upgrade-guidance branch from baf5cb3 to 507d261 Compare August 27, 2026 20:42
@eng-dev-ecosystem-bot

Copy link
Copy Markdown
Collaborator

Integration test report

Commit: 507d261

Run: 33114713770

Env 💚​RECOVERED 🙈​SKIP ✅​pass 🙈​skip Time
💚​ aws linux 1 1 274 1194 3:53
💚​ aws windows 1 1 276 1192 3:35
💚​ azure linux 1 1 273 1194 3:55
💚​ azure windows 1 1 275 1192 3:35
💚​ gcp linux 1 1 274 1194 4:24
💚​ gcp windows 1 1 276 1192 3:35
Test Name aws linux aws windows azure linux azure windows gcp linux gcp windows
💚​ TestAccept 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
🙈​ TestAccept/ssh/connection 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
Top 3 slowest tests (at least 2 minutes):
duration env testname
3:32 aws windows TestAccept
3:32 azure windows TestAccept
3:32 gcp windows TestAccept

@rugpanov
rugpanov marked this pull request as ready for review August 27, 2026 21:03
@rugpanov

Copy link
Copy Markdown
Contributor Author

@yiweidai-db @Hangzhi — follow-up to #6378 addressing your review requests: this documents the conservative DB Connect upgrade rule and the env-version / Python / DB Connect consistency invariant. Couldn't add you as formal reviewers (GitHub requires repo collaborator access), so flagging here — would appreciate your eyes. cc @lennartkats-db

`default_python_version`; the SQL templates (`dbt-sql`, `default-sql`) define
only a subset.

**RULE: Keep `conservative_db_connect_version_spec` (in `default/`) at the lowest version that still works. Bump it only when the pinned DBR release falls out of support — never just to match the newest serverless environment version.** The DB Connect client is only forward-compatible: it reaches compute of its own version and higher. The lowest working pin therefore maximizes the range of DBR versions a customer can connect to, whereas a high pin rules out customers on older DBR. Customers can upgrade themselves after initializing the template. This is why the pin typically lags the newest release. See PR #3897 and PR #6378 for prior history.

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

[suggestion]

Let's link the DBR support matrix docs for agents to search https://docs.databricks.com/aws/en/release-notes/runtime/

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants