aikit

Manages Unified Access to Generative AI Services built on Envoy Gateway

:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more. Features: Generate Text, MCP, Audio, Video, Images, Voice Cloning, Distributed, P2P and decentralized inference

Giving Kubernetes Superpowers to everyone

Use LLMs and LLM Vision (OCR) to handle paperless-ngx - Document Digitalization powered by AI