← Back to List
⚠
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
Pythonwaybarrios/vllm-mlx

vllm-mlx

High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code support.

83.8/100
★ 1.6KForks: 229
View on GitHub →Homepage →
Loading report...

Similar Projects

vllm-metal

83

Community maintained hardware plugin for vLLM on Apple Silicon

Python★ 1.8K

omlx

89

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

Python★ 22.5K

mlx-vlm

84

MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.

Python★ 5.6K

Rapid-MLX

87

Rapid-MLX is an open-source (Apache 2.0) OpenAI- and Anthropic-compatible LLM inference server and Mac app for Apple Silicon, built on MLX, focused on reliable tool calling for coding agents. Release-gated with Claude Code, Codex CLI, Aider, Hermes and DeepSeek Harness.

Python★ 3.9K
← Back to List