josephmachado / analytical_dp_with_sql Goto Github PK
View Code? Open in Web Editor NEWCode for my "Efficient Data Processing in SQL" book.
Home Page: https://josephmachado.gumroad.com/l/analyticalsql
Code for my "Efficient Data Processing in SQL" book.
Home Page: https://josephmachado.gumroad.com/l/analyticalsql
Hi, i followed the steps to run the docker container on mac m2 ,after make up command I cannot enter into trino cli.
When i looked up for the running containers i found that trino and minio containers are not running.
I opened up the logs for the trino container and found this below error message
2023-03-06T16:59:22.514Z ERROR main io.trino.server.Server No factory for connector 'hive_hadoop2'. Available factories: [hive, ignite, delta_lake, memory, kudu, blackhole, kinesis, redis, accumulo, gsheets, elasticsearch, jmx, postgresql, redshift, sqlserver, localfile, example_http, tpch, iceberg, mysql, bigquery, prometheus, mongodb, pinot, tpcds, hudi, oracle, mariadb, druid, cassandra, clickhouse, kafka, singlestore, atop, raptor_legacy, trino_thrift, phoenix5]
java.lang.IllegalArgumentException: No factory for connector 'hive_hadoop2'. Available factories: [hive, ignite, delta_lake, memory, kudu, blackhole, kinesis, redis, accumulo, gsheets, elasticsearch, jmx, postgresql, redshift, sqlserver, localfile, example_http, tpch, iceberg, mysql, bigquery, prometheus, mongodb, pinot, tpcds, hudi, oracle, mariadb, druid, cassandra, clickhouse, kafka, singlestore, atop, raptor_legacy, trino_thrift, phoenix5]
at com.google.common.base.Preconditions.checkArgument(Preconditions.java:435)
at io.trino.connector.DefaultCatalogFactory.createCatalog(DefaultCatalogFactory.java:118)
at io.trino.connector.LazyCatalogFactory.createCatalog(LazyCatalogFactory.java:45)
at io.trino.connector.StaticCatalogManager.lambda$loadInitialCatalogs$1(StaticCatalogManager.java:158)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:31)
at java.base/java.util.concurrent.ExecutorCompletionService.submit(ExecutorCompletionService.java:184)
at io.trino.util.Executors.executeUntilFailure(Executors.java:41)
at io.trino.connector.StaticCatalogManager.loadInitialCatalogs(StaticCatalogManager.java:152)
at io.trino.server.Server.doStart(Server.java:142)
at io.trino.server.Server.lambda$start$0(Server.java:90)
at io.trino.$gen.Trino_409____20230306_165916_1.run(Unknown Source)
at io.trino.server.Server.start(Server.java:90)
at io.trino.server.TrinoServer.main(TrinoServer.java:38)
2023-03-06T16:59:22.514Z INFO Thread-76 io.airlift.bootstrap.LifeCycleManager JVM is shutting down, cleaning up
2023-03-06T16:59:22.514Z INFO Thread-76 io.airlift.bootstrap.LifeCycleManager Life cycle stopping...
2023-03-06T16:59:22.514Z INFO Thread-76 io.airlift.bootstrap.LifeCycleManager Life cycle stopped
parvatheesamputikalapudi@parvathesamsMBP analytical_dp_with_sql %
Describe the bug
I have a macbook pro m1 pro and when i am trying to follow the setup instructions for I keep getting the following message when i do make up for invoking docker container. Please help:
To Reproduce
Steps to reproduce the behavior:
make up
on a Macbook pro m1Expected behavior
All the required containers must spin up.
Screenshots
Desktop (please complete the following information):
Describe the bug
I decided to use my home machine as development server for this project while sending commands via ssh from a client device. The setup went through until make trino
that it threw the following error below (pardon my lack of pasting, I am figuring out how to access clipboards in ssh)
Is there additional configurations to be setup with SSH ? I assume that it's missing port forwarding.
To Reproduce
Steps to reproduce the behavior:
Expected behavior
I can proceed to next steps with trino gui.
Screenshots
please see list of running containers:
Desktop (please complete the following information):
When trying to run first command make up
I receiving this output
make up
docker volume rm --force minio-data
minio-data
docker compose up -d --build
unknown shorthand flag: 'd' in -d
See 'docker --help'.
MacOS 13.4 M1,
Docker version 24.0.2, build cb74dfcd85
I am using colima for containers runtimes
Describe the bug
Hi, novice sql learner here - I appreciate your effort setting up the repo with seamless makefile steps to consume the book with practical code on hand.
The problem is that coming from other native SQL editors (SSMS, VS, notepad++ etc) I find that the CLI compared to them is much more cramped and unintuitive to edit / explore the input SQL code.
I think being able to do the following on an editor can massively help consume the code and thus the book core concept :
Expected behavior
would you suggest an alternative / some tips with the CLI to achieve the above?
Describe the bug
When using latest version of the MariaDB docker image, the hive-metastore container keep shutting down because of the following error : java.sql.SQLException : Unknown system variable 'transaction_isolation'
To Reproduce
Steps to reproduce the behavior:
make up
Expected behavior
All the required containers must spin up.
Desktop (please complete the following information):
Additional context
I've found this thread that mentions the error. They suggest that the error doesn't happen with version 10.3.32
of mariadb.
I've tried restricting the image to that version and haven't encountered any issues yet.
It also seems to be an open issue on MariaDB's repo.
I thought I'd let you know @josephmachado ๐
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.