garden92 / air-flow

Air flow default template(Docker)

air-flow

Air flow default template(Docker With Compose)

env

docker: #todo write version
memem: 4G
docker-compose: 1.27.1(UP)

init-command

• config

mkdir ./dags ./logs ./plugins
echo -e "AIRFLOW_UID=$(id -u)\nAIRFLOW_GID=0" > .env
docker-compose up airflow-init

• start:

docker-compose -f docker-compose.yml up -d
# DEV docker-compose -f docker-compose-dev.yml up -d

air-flow's Issues

"invalid mount config for type "bind": bind source path does not exist:"

SOL1: create dags folder

mkdir dags

OOM

airflow-init_1 | WARNING!!!: Not enough memory available for Docker.
airflow-init_1 | At least 4GB of memory required. You have 2.0G
airflow-init_1 |
airflow-init_1 |
airflow-init_1 | WARNING!!!: You have not enough resources to run Airflow (see above)!

timeout reached before the port went into state "inuse"

docker-compose up -d # 실행 이후 스케줄러, Worker가 Down 될때
docker logs ${스케줄러} # 했을때 확인 가능

스케줄러, Worker내 Air-flow Host 정보가 없어 발생

# 스케줄러와 Worker 환경변수 추가
- AIRFLOW_WEBSERVER_HOST=airflow