Cortex Kustomize

Kustomize background

Kustomize is a CNCF project that is a part of Kubernetes. It's included in the kubectl in order to allow users to customize their configurations without introducing templates.

Usage

kustomize encourages defining multiple variants - e.g. dev, staging and prod, as overlays on a common base.

It’s possible to create an additional overlay to compose these variants together - just declare the overlays as the bases of a new kustomization.

cortex-kustomize provides a common base for Blocks Storage deployment to Kubernetes. People should Create variants using overlays to deploy Cortex in their own environment.

An overlay is just another kustomization, referring to the base, and referring to patches to apply to that base. This arrangement makes it easy to manage your configuration with git. The base could have files from an upstream repository managed by someone else. The overlays could be in a repository you own. Arranging the repo clones as siblings on disk avoids the need for git submodules (though that works fine, if you are a submodule fan).

Example

This is an example of monitoring Cortex by adding prometheus and grafana using kustomize

Create development Environment

mkdir -p deploy/overlays/dev

Create kustomization.yaml (note that this is not the complete file):

apiVersion: kustomize.config.k8s.io/v1beta1
kind: Kustomization

namespace: cortex-monitoring-system

resources:
- github.com/qclaogui/cortex-kustomize/deploy/base/blocks?ref=main
- add-grafana-dep.yaml
- add-grafana-svc.yaml
- add-retrieval-dep.yaml
- add-retrieval-svc.yaml

patchesStrategicMerge:
- patch-nginx-svc.yaml

images:
- name: quay.io/cortexproject/cortex
 newTag: master-b6eea5f
- name: minio/minio
 newTag: RELEASE.2021-06-17T00-10-46Z

File structure:

└── deploy
   └── overlays
       └── dev
           ├── add-grafana-dep.yaml
           ├── add-grafana-svc.yaml
           ├── add-retrieval-dep.yaml
           ├── add-retrieval-svc.yaml
           ├── kustomization.yaml
           └── patch-nginx-svc.yaml

Deploy to a cluster

kustomize build deploy/overlays/dev | kubectl apply -f -

More example detailed https://github.com/qclaogui/cortex-kustomize-demo.

Happy Cortex

ycyr / cortex-kustomize Goto Github PK