Why

• The homelab allows me to experiment on various things like LLMs, malwares, tinkering with stuff etc.
• Works as a "proxy" of a small company for me to play around with. Cosplaying as a SysAdmin
• Helps me learn a LOT of things (from various services like hashicorp vault, terraform to k3s or CUDA)

Setup

• Hardware Specifications for the various nodes in the home (and cloud) lab
• Storage Layout details
• k3s cluster documentation
• Network Infrastructure - Details about the global network setup
• Exploring LLMs - Diving into self hosting & using Large Language Models

Services

Here are some services that I run in my homelab:

• Forgejo as self-hosted github alternative
• Jenkins for CI / CD of various services
• vLLM for running large language models on the GPU
• llama.cpp for running LLMs on CPU + GPU
• immich as google photos alternative
• SeaweedFS for exposing storage as an S3 API
• PostgreSQL for storing relational data
• Grafana for observability / metrics
• Pyroscope for runtime profiling of custom services
• Metabase for dashboarding
• registry as a private docker registry using S3 backend (with seaweedfs S3 API)
• Temporal for some workflows