Blog
posts tagged civo
- So you want to run Inference on Kubernetes?
Running CPU and GPU inference on Kubernetes with vLLM, Agentgateway and Prometheus, with measured throughput comparisons.
Running CPU and GPU inference on Kubernetes with vLLM, Agentgateway and Prometheus, with measured throughput comparisons.