Skip to content

Conversation

@blturan
Copy link

@blturan blturan commented Dec 16, 2025

Check List

  • Tests have been run in packages where changes have been made if available
  • Linter has been run for changed code
  • Tests for the changes have been added if not covered yet
  • Docs have been added / updated if required

Issue Reference this PR resolves

N/A

Description of Changes Made

Databricks DESCRIBE output for partitioned tables includes metadata rows where the column name is # Partition Information and the data_type field is empty (docs.databricks). These rows were previously parsed as columns.

This change stops column parsing for the partition metadata section, ensuring that only actual table columns are returned. The check requires both the column name to match # Partition Information and*the data_type to be empty, as a real table column could legitimately have this name but would always include a non-empty data_type.

Issue Explanation

Selecting YAML for Generate Data Model causes a playground error because the generated YAML becomes invalid when partition metadata rows are included as columns.
image

Playground error.
image

Selecting JavaScript does not trigger a playground error, but the generated schema still includes col_name and # Partition Information, which should not be treated as table columns.
image

@blturan blturan requested a review from a team as a code owner December 16, 2025 18:20
@github-actions github-actions bot added javascript Pull requests that update Javascript code data source driver driver:databricks cubejs-jdbc-driver pr:community Contribution from Cube.js community members. labels Dec 16, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

cubejs-jdbc-driver data source driver driver:databricks javascript Pull requests that update Javascript code pr:community Contribution from Cube.js community members.

1 participant