dbt-labs / jaffle_shop_duckdb Goto Github PK
View Code? Open in Web Editor NEWGet started with dbt in less than 1 minute from `git clone` to `dbt docs serve` for free!
Home Page: https://bit.ly/3e0qtxo
License: Apache License 2.0
Get started with dbt in less than 1 minute from `git clone` to `dbt docs serve` for free!
Home Page: https://bit.ly/3e0qtxo
License: Apache License 2.0
Also got a bunch of 'wheel' is not installed, Would it make sense to add wheel to the requirements.txt ?
Collecting text-unidecode>=1.3
Using cached text_unidecode-1.3-py2.py3-none-any.whl (78 kB)
Using legacy 'setup.py install' for dbt-core, since package 'wheel' is not installed.
Using legacy 'setup.py install' for dbt-postgres, since package 'wheel' is not installed.
Using legacy 'setup.py install' for configobj, since package 'wheel' is not installed.
Notes from working through this:
Hello -- thanks for this repo! I noticed that currently this repo uses code on a fork by @dbeatty10 .
Are there plans to open a PR and move these changes back into https://github.com/jwills/dbt-duckdb ? It seems like this might be related to duckdb/dbt-duckdb#21
Git cloning from [email protected]:dbt-labs/jaffle_shop_duckdb.git
will create a folder named "jaffle_shop_duckdb" by default.
But if using a custom, non-default folder name in the git clone command, this will point to a folder that doesn't exist:
Line 14 in 8574cf7
Hi, I'm quite new to DBT and DuckDB. I'm still a bit confused about setting up primary and foreign keys in the models.
I saw that this is how it is being implemented in the models:
jaffle_shop_duckdb/models/schema.yml
Lines 36 to 48 in a6ea10d
When I open the resulting .db
file in DBeaver or Metabase, the constraints doesn't seem to be implemented.
My question is:
.sql
scripts?PS:
I also found these tools:
follow the readme toggles and copy them into github action format.
This will serve as auto checks too.
It'll be cool for new folks coming across this repo for the first time thinking, "Yeah right, no way I can get started that fast" then click through the github actions and go, "Oh they already proved it's that fast..."
Hi I've attempted to start the project by first copying the following instructions:
git clone https://github.com/dbt-labs/jaffle_shop_duckdb.git
cd jaffle_shop_duckdb
python3 -m venv venv
source venv/bin/activate
python3 -m pip install --upgrade pip
python3 -m pip install -r requirements.txt
source venv/bin/activate
dbt build
dbt docs generate
dbt docs serve
So then I tried by using the provided vscode dev container but then it somehow fails to find the csv seed files. (even tho they exist in the repo)
For example, the windows cmd instructions don't work. I tried in a github action the syntax was wrong.
Synced with @sungchun12 on some minor updates to the README to hopefully improve readability :)
The accepted values for payment_method
field for stg_customers
are defined in `models/staging/schema.yml'.
version: 2
models:
- name: stg_customers
columns:
- name: customer_id
tests:
- unique
- not_null
- name: stg_orders
columns:
- name: order_id
tests:
- unique
- not_null
- name: status
tests:
- accepted_values:
values: ['placed', 'shipped', 'completed', 'return_pending', 'returned']
- name: stg_payments
columns:
- name: payment_id
tests:
- unique
- not_null
- name: payment_method
tests:
- accepted_values:
values: ['credit_card', 'coupon', 'bank_transfer', 'gift_card']
These values are used in models/orders.sql
.
-- ...
order_payments as (
select
order_id,
{% for payment_method in payment_methods -%}
sum(case when payment_method = '{{ payment_method }}' then amount else 0 end)
as {{ payment_method }}_amount,
{% endfor -%}
sum(amount) as total_amount
from payments
group by order_id
),
Can payment_methods
defined once in `models/staging/schema.yml', so that we could avoid data inconsistencies in the future. If it is possible, how can I do it?
Currently, the README is a giant wall of text that is intimidating to me.
As a user, I always appreciate the main focus to be install instructions that help me get hands-on. Everything else is a distraction from that goal, in my opinion.
pip install --upgrade pip
Hi Team,
we would like to seed or read Parquet file from local storage and Azure Blob Storage in project , Can you please guide the configuration which we can do to read the file.
Regards,
Akash
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.