🏗️ Fine-tune, build, and deploy open-source LLMs easily!
Manages Unified Access to Generative AI Services built on Envoy Gateway
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.
Giving Kubernetes Superpowers to everyone
A programmable Mixture-of-Models router for heterogeneous LLM inference