hugaertsdries / app-data-warehouse

Easily explore data

Data warehouse

Started from the mu-project template.

Simple mu-project that can be used to ingest and explore data.

Running and maintaining

General information on running, maintaining and installing the stack.

How to start the stack

Prerequisites

• docker, docker-compose and git are installed on your system
• you've cloned the repository

Start the system:

docker-compose -f docker-compose.yml -f docker-compose.dev.yml up

docker-compose up CLI reference.

Wait for everything to boot to ensure clean caches. You may choose to monitor the migration service in a separate terminal and wait for the overview of all migrations to appear:

docker-compose logs -f --tail=100 migrations

docker-compose logs CLI reference.

With environement variables

You might find the above docker-compose up command tedious. To simplify it's usage we can define the COMPOSE_FILE variable in our environment.

Create an .env file in the root of the project with the following contence:

COMPOSE_FILE=docker-compose.yml:docker-compose.dev.yml

docker-compose CLI env. vars. reference

Start the system:

docker-compose up

Providing data to be ingested

The toLoad folder

Migrations service