Serving LLMs Isn't Serving Web Apps: A Production Kubernetes Playbook
How AI infrastructure evolved from raw GPUs to vLLM, LLM-D, and AI gateways — and how a self-hosted model actually wires into K Gateway on production Kubernetes.
1 post
How AI infrastructure evolved from raw GPUs to vLLM, LLM-D, and AI gateways — and how a self-hosted model actually wires into K Gateway on production Kubernetes.