From Duct Tape to Bulletproof

Battle-tested homelab scripts, configs, and guides. Born from real failures on the worst cluster on the internet. If it survived our setup, it'll survive yours.

Browse the Shop
$ sudo ./fix-everything.sh
fix-everything.sh: line 1: lol: command not found

Products

Scripts, configs, and guides from a real 2-node cluster. Tested on duct tape, shipped to you.

Health Check Generator

A customizable health check script framework. Enter your services, get a tailored monitoring script with Discord/webhook alerts. Covers pods, mounts, DNS, HTTPS endpoints, VPN, backups, and more.

bash monitoring k3s discord

Incident Playbook: 10 Real Failures

10 real failure modes from a production 2-node cluster, with root cause analysis and step-by-step recovery procedures. DNS outages, disk failures, VPN breaks, NFS stalls, and more.

documentation recovery k3s troubleshooting

mergerfs + NFS Cross-Node Storage

Complete config templates for mergerfs pools spanning multiple nodes via NFS. Includes fstab entries, NFS exports, systemd dependencies, graceful degradation, and recovery scripts.

storage mergerfs nfs fstab

k3s 2-Node Cluster Setup Kit

Everything you need to stand up a 2-node k3s cluster from scratch. Control plane config, worker join, flannel networking, UFW rules, Longhorn storage, and the gotchas nobody warns you about.

k3s kubernetes longhorn networking

Traefik + Let's Encrypt + Cloudflare

Reverse proxy setup with automatic HTTPS via DNS-01 challenge. HelmChartConfig, IngressRoute CRDs, HTTP-to-HTTPS redirect, multi-namespace routing, and certificate troubleshooting.

traefik https cloudflare certificates

Automated Backup System

Encrypted nightly backups with age encryption, local + remote retention, Google Drive sync via rclone, multi-service database dumps, and staleness alerting. Set it and forget it.

backup encryption rclone cron

Cluster Monitor + Discord Alerts

Cron-based monitoring that checks both nodes every 5 minutes. Disk mounts, NFS, k3s pods, HTTPS endpoints, VPN, backup freshness. State-change Discord alerts so you only hear about new problems.

monitoring discord cron multi-node

USB Auto-Remount + NFS Recovery

Scripts that automatically detect and recover from USB drive disconnects and NFS mount failures. udev triggers, systemd timers, mergerfs rebuilds, and service restarts. The duct tape that holds it together.

usb recovery nfs systemd

Arr Stack k3s Manifests Bundle

Complete k3s deployment manifests for a media automation stack: Sonarr, Radarr, Prowlarr, qBittorrent + Gluetun VPN, Jellyfin, Jellyseerr. Longhorn PVCs, resource limits, and node scheduling.

media sonarr radarr k3s

What Is This?

The Story

We run a 2-node homelab cluster that started as "just Docker on a Raspberry Pi" and evolved into a k3s cluster spanning a Pi 5 and an i7 desktop. Along the way, everything that could break did break. USB drives disconnected. NFS mounts went stale. VPNs died silently. DNS stopped resolving. Longhorn webhooks deadlocked the cluster on boot.


Every product in this shop was born from a real failure and a real fix. We document the journey — from duct tape to bulletproof — and sell the scripts and configs that got us there.

What You Get

  • Battle-tested scripts from a real production cluster
  • Honest documentation including what went wrong
  • Full source code under Personal Use License
  • Configs you can actually read and understand
  • No enterprise bloat, no vendor lock-in

What You Don't Get

  • Enterprise support or SLAs
  • Guarantees it'll work on your setup
  • Polished marketing speak

The Duct Tape Dispatch

Weekly updates from the worst homelab on the internet. New products, cluster improvements, things we broke, and how we fixed them.