Repository navigation
[DPS-2427] Document Databricks support in the data quality dashboard - #1966
Conversation
Add Databricks (Iceberg REST catalog) alongside Snowflake and BigQuery on the monitoring page, note that Databricks support is AWS only, and add troubleshooting for error codes 31000, 31001, and 32xxx. Add a release note. Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Missing SEO metadataThe following markdown files are missing required metadata fields:
Required fieldsThe file metadata is important for SEO and marketing. All markdown files, except for those with filenames starting with
Please add the missing metadata. |
Deploying with
|
| Status | Name | Latest Commit | Preview URL | Updated (UTC) |
|---|---|---|---|---|
| ✅ Deployment successful! View logs |
documentation | 3c344bc | Commit Preview URL Branch Preview URL |
Oct 15 2026, 10:34 AM |
|
Style review Overall this PR is well-written and follows repo conventions. The frontmatter, the release note fields ( 1. Avoid "currently"
Rule: style guide, Writing style: "Stay in the present tense. Never use 'currently', 'now'…" Fix: "Databricks support in the data quality dashboard is available only for pipelines running on AWS." The same applies to the release note: "Databricks support is currently available for pipelines running on AWS." → "Databricks support is available only for pipelines running on AWS." (Adding "only" also makes it match the docs page.) 2. Passive voice in the Databricks permissions section
Rule: CLAUDE.md, Writing style: "Use active voice." Fix: "If the service principal lacks the 3. Databricks-specific example in a shared, warehouse-agnostic list
This list applies to all warehouses, so a Databricks-only example looks out of place, and the sentence now has a run of trailing clauses. Suggestion: drop the addition, or move it into the Databricks tab above as a separate sentence, for example "To increase capacity, scale up your Databricks SQL warehouse." If you keep it inline, add a comma: "for example, by scaling up…". External link check: https://docs.databricks.com/aws/en/admin/system-tables/ loads successfully. |
Scope Databricks support to AWS-hosted workspaces and the Iceberg REST loader, add a Databricks setup section with the HTTP path and grants, explain idle SQL warehouse timeouts, and apply style fixes. Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Patricio (patofp)
left a comment
There was a problem hiding this comment.
LGTM!
Just one small correction to a previous suggestion: #1966 (comment)
Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Jira: DPS-2427
Summary
31000(Can use on the SQL warehouse) and31001(catalog or schema privileges), with the grant script used in Console32xxxto the query timeout codes, with a Databricks diagnostic query onsystem.query.historyTo check
system.query.historydiagnostic query haven't been run against a real Databricks workspace🤖 Generated with Claude Code