Serving LLMs Isn't Serving Web Apps: A Production Kubernetes Playbook
How AI infrastructure evolved from raw GPUs to vLLM, LLM-D, and AI gateways — and how a self-hosted model actually wires into K Gateway on production Kubernetes.
Posts tagged: kubernetes
2 posts
Running AI Agents Safely: Building Isolated Sandboxes on Kubernetes
How we solved the multi-tenant code execution problem for autonomous AI agents using Kubernetes, gVisor, and dynamic volume isolation.