ai-gateway

🏗️ Fine-tune, build, and deploy open-source LLMs easily!

⚡️ Open-source AI Gateway — Use any SDK to call 100+ LLMs. Built-in failover, load balancing, cost control & end-to-end tracing.

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

AI Inference Operator for Kubernetes. The easiest way to serve ML models in production. Supports VLMs, LLMs, embeddings, and speech-to-text.