Rapid-MLX

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

Community maintained hardware plugin for vLLM on Apple Silicon

High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code support.

Fine-tune LLMs on your Mac with Apple Silicon. SFT, DPO, GRPO, Vision, TTS, STT, Embedding, and OCR fine-tuning — natively on MLX. Unsloth-compatible API.