voytechnology / homelab

Homelab configuration

Homelab

Homelab running on k3s

---

Tools

Necessary tools and their versions are managed using mise, This way we only have to run one command to install all the necessary tooling.

mise install

Creating new Cluster

1. Provision individual machine with Debian
   • Ensure that the root user can be logged into using the SSH key
   • Change the hostname to match the naming scheme (s{n}-{cluster})
   • Install, start and enable Tailscale on each node
2. Create a new folder in inventory named {cluster}, add the group_vars and hosts.ini file. Refer to each machine using the hostname
3. Run the site.yml on the cluster to initialize the initial state

---

Running a single playbook on the cluster

This is done via Github Actions. The action will connect to the cluster with Ephemeral Key (this will expire one day, make sure to update). Then run it by providing the cluster name, and the playbook name to run (include the _ in the name, but exclude the .yml extension)

homelab's Issues

s2-dub1: Provision OS

Provision OS on the s2-dub1 server (laptop)

s1-dub1: Provision k3s

charts: External Secrets

Create a external secrets metachart which will create the ClusterExternalStore so we can pull secrets from it where needed rather than relying on creating them using Ansible.

s2-dub1: Provision Tailscale

s3-dub1: Provision k3s

s1-dub1: Silent fans

Replace the existing fans with silent PWM fans which can run with 0 RPM mode

s1-dub1: Provision ZFS

s1-dub1: Silent CPU Fan

The CPU fan should be quieter as its currently the only audible part of the computer.

dub1: Hardware Provisioning

Provision hardware for dub1

s2-dub1: Provision k3s

dub1: NFS Persistent Storage

Have a persistent storage set using ZFS and expose it as an NFS volume which can be mounted for access.

Depends on #5

charts: Deploy Kubechecks

Deploy Kubechecks so that we can see a diff of what will change in an application.

This will have to be vetted for secrets.

charts: Migrate ingress-internal to Ansible

Since this is one of the core services, it should probably move to Ansible, as templating is hard

s3-dub1: Provision OS

s1-dub1: 250GB NVMe ZFS Cache Drive

Use the 250GB NVMe drive as the ZFS cache drive.

charts: External Proxy

Use Cloudflare Tunnels to expose applications using external proxy.

dub1: k3s provisioning

Provision K3s across the cluster

• #11
• #12
• #13

s1-dub: Provision Tailscale

Provision Tailscale on the s1-dub1 server so that the host is always accessible.

charts: Publish Charts

Those charts might be useful to other people, so they can be published.

dub1: Vault

Deploy vault so that we can have a safe place to keep all configuration.

The secrets would probably still be stored in this repo but the values will be set in Vault and populated from there.

charts: Make the charts generic

Some of the configuration right now has hardcoded values for things like hostnames. These should be changed so that its easier to create new clusters.

github: Automatically run ansible

Automatically run ansible if the configuration has changed inside the ansible folder.

s1-dub1: Large capacity HDDs

Get large capacity HDDs for the main storage server s1-dub1. They would probably have to be the same capacity and maybe 8TB+ for future proof and a good price/capacity ratio.

s3-dub1: Provision Tailscale

s1-dub1: 120GB boot SSD

Use the 120GB SSD for the boot drive. Since we will have a dedicated ZFS cache we can dedicate the whole drive just for the boot drive.

charts: ArgoCD Webhook notification

Send a webhook notification to Argo when the charts directory has changed.

We can also just tell Argo about any changes.

s2-dub1: 480GB boot SSD

Install the 480GB SSD as the boot device. Hopefully we will not be using this storage as all data will be stored on s1-dub1, but its still better to have more than less.

s1-dub1: Provision OS

argo/apps/monitoring: Shared minio

Rather than running multiple minio instances, we can run just one for all of monitoring, so we can also enable the admin console.