fivetran / dbt_apple_store_source Goto Github PK
View Code? Open in Web Editor NEWFivetran's Apple App Store source dbt package
Home Page: https://fivetran.github.io/dbt_apple_store_source/
License: Apache License 2.0
Fivetran's Apple App Store source dbt package
Home Page: https://fivetran.github.io/dbt_apple_store_source/
License: Apache License 2.0
Would it be possible to refresh the apple_store_country_codes to reflect the most recent version of ISO-3166 country codes?
The staleness seems to affect downstream data models such as [apple_store__territory_report](https://github.com/fivetran/dbt_apple_store/blob/9735693405f64101beae5ef8129681363ca8b8b4/models/apple_store__territory_report.sql)
, with territory_short
columns being NULL for certain countries such as the following:
I would be happy to update the country codes, if you can provide me with the source for the data ๐.
No response
Preferrably, the territory_short
column of the model [apple_store__territory_report](https://github.com/fivetran/dbt_apple_store/blob/9735693405f64101beae5ef8129681363ca8b8b4/models/apple_store__territory_report.sql)
should reflect the latest ISO-3166 country codes.
# Name your project! Project names should contain only lowercase characters
# and underscores. A good package name should reflect your organization's
# name or the intended use of these models
name: "droom_analytics_bq"
version: "1.0.0"
config-version: 2
# This setting configures which "profile" dbt uses for this project.
profile: "droom_analytics_bq"
# These configurations specify where dbt should look for different types of files.
# The `model-paths` config, for example, states that models in this project can be
# found in the "models/" directory. You probably won't need to change these!
model-paths: ["models"]
analysis-paths: ["analyses"]
test-paths: ["tests"]
seed-paths: ["seeds"]
macro-paths: ["macros"]
snapshot-paths: ["snapshots"]
docs-paths: ["docs"]
target-path: "target" # directory which will store compiled SQL files
clean-targets: # directories to be removed by `dbt clean`
- "target"
- "dbt_packages"
# Configuring models
# Full documentation: https://docs.getdbt.com/docs/configuring-models
# In this example config, we tell dbt to build all models in the example/
# directory as views. These settings can be overridden in the individual model
# files using the `{{ config(...) }}` macro.
models:
apple_store:
+schema: itunes_connect # leave blank for just the target_schema
apple_store_source:
+schema: itunes_connect # leave blank for just the target_schema
google_play:
+schema: google_play # leave blank for just the target_schema
google_play_source:
+schema: google_play # leave blank for just the target_schema
# Config indicated by + and applies to all files under models/example/
#
vars:
# enable subscriptions and earnings models (https://github.com/fivetran/dbt_app_reporting#step-4-disable-and-enable-source-tables)
apple_store__using_subscriptions: true # by default this is assumed to be false
google_play__using_subscriptions: true # by default this is assumed to be false
google_play__using_earnings: true # by default this is assumed to be false
packages:
- package: fivetran/apple_store
version: 0.2.0
- package: fivetran/google_play
version: 0.2.0
bigquery
Core:
- installed: 1.4.4
- latest: 1.4.5 - Update available!
Your version of dbt-core is out of date!
You can find instructions for upgrading here:
https://docs.getdbt.com/docs/installation
Plugins:
- bigquery: 1.4.0 - Update available!
At least one plugin is out of date or incompatible with dbt-core.
You can find instructions for upgrading here:
https://docs.getdbt.com/docs/installation
No response
Our fivetran_utils collect_freshness
macro was designed to override dbt's equivalent macro to allow for the enabling/disabling of variables when running dbt source snapshot-freshness
. Thus if a source table does not exist, dbt will not run (and error on) a freshness test on the table.
dbt has since updated its macro in recent versions to basically provide the same functionality. So warnings are being thrown to upgrade the package logic.
We will want to modify all versions of the meta: is_enabled
config in our src_apple_store.yml
package ([example here])(https://github.com/fivetran/dbt_apple_store_source/blob/main/models/src_apple_store.yml#L188-L189) to match the config: enabled
dbt logic. Once those dependencies are either updated or removed, we can further explore updates to our own internal collect_freshness
macro.
At the moment, we will be proceeding forward with updating dbt_fivetran_utils
to match the logic of dbt's collect_freshness
macro. That way customers will no longer experience that warning.
More details can be found in this ticket.
Customers raising this issue can be found in this dbt slack thread https://getdbt.slack.com/archives/C03SAHKKG2Z/p1683127164993329
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.