Databricks: Unable to see all schemas and tables

New to Databricks. I have already set up my ODBC 64 Simba Spark ODBC Driver and testing is successful but when I connect to Databricks using the Input Data tool or inDB tools I do not see all of the schemas or tables in the Visual Query Builder that I see in the SQL Editor Catalog when I log into Databricks from a browser. Can anyone help with this? TIA

Input

In Database

In-Database

Accepted answers

All comments

apathetichell

first question - what is your catalog that you have set up in your ODBC? Can you confirm that is the catalog that you are seeing in your UI?

tbh - there are a whole slew of reasons that this could happen. 1) catalog differences 2) permission differences between the token user and you 3) clusters on/off. If it isn't one of these - it's very difficult to troublshoot.

BonusCup

@apathetichell, I'm using Simba Spark ODBC Driver v2.08.00.1002. I don't see where to enter a Catalog. Under 'Database', we have it set to "default". Is this where you would enter the catalog? In the browser, I see a "dev" schema but changing the database to that in the ODBC, did not change anything.

apathetichell

Database=Catalog. So that's fine assuming you are using a schema.table naming structure. The things I would look at are:

1) hit refresh.

2) don't use query builder (can you see the tables in general sql screen --- are the tables views? some views have issues in query builders).

3) Check permission. Recheck what was the permission granted to the token.

BonusCup

@apathetichell thanks for all the assistance. When I hit 'Load' on the query builder, I see all the schemas and tables that I see in the Tables view. Also, when I copy/paste a query that was built in the Query Editor in Databricks into the SQL Editor in Alteryx, that query runs fine and I get the expected results.

apathetichell

Are you saying that the only issue is with visual query builder in Alteryx - and not with the core SQL/tables screen? If so - I'd say ignore it.

BonusCup

@apathetichell so I shouldn't worry about not being able to see all the tables in the Table view or the Visual Query Builder that I see in the Query Builder in Databricks? I haven't had this issue with any other connections. Is it a bug or something? Just trying to get a better understanding.

apathetichell

what I said was if your issue is only with visual query builder - ignore it. Your last message was a bit opaque - so can you confirm:

1) you see tables in databricks.

2) you do not see the tables in table view (Table view and raw SQL are the only two DB screens you should care about here).

3) you can manually write a query referencing an unviewed table and the query will execute?

Is that where we are?

You have not mentioned anything about token permissions. Databricks operates on a very fine grained access model. It is possible to have access to a table to query - but not viewer accesss I believe. I do not think that is the problem. I would look into "what charaterstic do the tables I can query - but not see - have in common?" Are they all in DEFAULT? are they tables or views? Is there a different owner? Is there a different directory? When were they created?

Quick Links

This months top contributors

atcodedog05 19598

Qiu 15878

binu_acs 15708

MarqueeCrew 13708

apathetichell 13703