airflowdocker / airflow-docker Goto Github PK

The AWS Role Assumption extension should be configurable to either write a credentials file or set environment variables.

the __AIRFLOW_META folder always seems to be created by the root user but if our dockerfile sets USER to be another user... then that new user will not be able to write to say the sensor.txt file in the __AIRFLOW_META__ folder. Can we specify the user to create the __AIRFLOW_META__ folder?

In production, we sometimes see this issue:

with open(short_circuit_file_path, "wb") as f:
[2022-03-16 17:04:18,215] {operator.py:352} INFO - PermissionError: [Errno 13] Permission denied: '/tmp/airflow/__AIRFLOW_META__/short_circuit.txt'

in containers that specify another USER in their dockerfile

Acceptance Critera

1. The airflow-docker dropdown displaying the config.json file would include other configuration files found

Questions:

1. How will the plugin know what files to include?
2. How should the files be partitioned
3. How should it handle json decode errors