yanehi / postgres-filebeat-kubernetes

Postgres container with Filebeat sidecar for log shipping to Elasticsearch.

PostgreSQL Log shipping with Filebeat

PostgreSQL container with Filebeat sidecar for log shipping to Elasticsearch. The PostgreSQL logs from var/log/postgresql will be saved in in a persistent volume called pg-log. The Filebeat sidecar container mount the pg-log persistent volume into his filesystem on var/log/postgresql.

In the filebeat.yml (configuration file of filebeat) an input.type = log is defined, which points to the var/log/postgresql directory on the filebeat container. This log files from the directory will be shipped to an elasticsearch container on port 9200.

Requirements

• kubectl installed
• access to the K8s cluster
• running elasticsearch on port 9200 and for data visualization running kibana with access to elasticsearch

Start setup

• execute the create-deployment.sh file

./create-deployment.sh

Reset setup

• execute the remove-deployment.sh file

./remove-deployment.sh

Authors

• Yannic Nevado - Initial work - Github