Comments (11)
Hi @lakechain , do you see anything about the Database Sync for this DB happening in /admin/troubleshooting/tasks
? It'd be helpful to know if the issue is the sync not running, the sync failing, or the sync allegedly succeeding but not populating things correctly.
from metabase.
@lakechain I tested syncing the test database we have for Spark on 0.50.8, and the tables are syncing fine, so this is likely something specific about your setup. Can you share the log messages during database sync?
- go to the Databases page for that database in Admin Settings and click "Sync database schema now"
- go to Admin Settings > Troubleshooting > Logs. The database logs for syncing database schema should start with something like this:
2024-07-03 18:04:53,996 INFO sync.util :: STARTING: Sync sparksql Database 1 ''test-data''
2024-07-03 18:04:53,997 INFO sync.util :: STARTING: Sync metadata for sparksql Database 1 ''test-data''
...
from metabase.
@calherries @tsmacdonald table sync is fine, but schemas are not. And I don't understand why Database name is required, in Spark SQL, Schema and Database are one, so when I enter database name as "default", no tables appear in the Database browser of metabase, but when I enter the name of a schema in the database name input, the tables of that schema appear in the Database browser.
How can I display all schemas (databases) in my warehouse on the database browser of Metabase?
from metabase.
Ah yes, now I understand your issue. Having to specify a single schema is indeed a limitation of the Spark driver. Can you confirm whether this issue represents the solution you'd like?
Specifically:
if you leave the database blank, the UI will show the metadata from all databases.
from metabase.
Maybe that's what I need.
But I read in the SparkSQL connector documentation. I see that the database name is not required. https://www.metabase.com/docs/latest/databases/connections/sparksql
from metabase.
@calherries I can't leave the database blank, it's required, Is this a bug?
from metabase.
I read in the SparkSQL connector documentation. I see that the database name is not required.
Can you point out exactly where you see that in the documentation?
I think this is definitely a limitation in the design of the Spark SQL driver. But it looks like it was intentionally designed this way, so I'm not sure it's a bug. As you said before:
when I enter the name of a schema in the database name input, the tables of that schema appear in the Database browser.
Is it a feasible workaround to create a database in Metabase for each database/schema in your Spark SQL database?
from metabase.
In the document I don't see anything that says I need to input a database name. I'll try some ways to see if I can get around it, thanks for your help.
from metabase.
Thanks, please update this issue if you find the workaround satisfactory. Given you and a few others are obviously having issues with this, I will see if there's an easy way to fix this limitation. No promises though! There might be a good reason for this
from metabase.
@lakechain did the workaround work for you?
from metabase.
@darksciencebase I am having to create a database for each schema in the data warehouse. This is probably the best way possible.
from metabase.
Related Issues (20)
- [FE] Automatically add count and open the summarize step
- [BE] Adjust checks for a metric being correct in can-run/can-save
- [FE] Hide non-datetime columns in breakouts
- We show all columns of the table in the GUI editor when the user is sandboxed
- Drop barrel files
- Use ensure-filter-stage from MLv2
- Add more e2e tests and testing plan for offset function
- App crashes when navigating between dashboards
- Date field filter broken when choosing after/before a date
- Application data not loaded after successful upgrade and migration with Postgres RDS HOT 4
- Add setting to make query analysis synchronous on card updates
- Set all namespaces to INFO and allow the admin to change the log level at runtime
- Cannot search within tables in "Pick your starting data" modal
- `Lib.isNumber` returns `false` for aggregation-based columns after join is removed
- Add a new SDK card setting
- [Epic] Simple Metrics Overview Page
- Wrong entity names and headings when X-raying Custom Expressions
- X-raying a Date field in an X-ray is broken
- Click to sum/average
- Using Azure Workload Identities to Rotate Database Credentials
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from metabase.