Back to List
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
Pythonmadroidmaq/mlx-omni-server

mlx-omni-server

MLX Omni Server is a local inference server powered by Apple's MLX framework, specifically designed for Apple Silicon (M-series) chips. It implements OpenAI-compatible API endpoints, enabling seamless integration with existing OpenAI SDK clients while leveraging the power of local ML inference.

72.9/100
707Forks: 86
View on GitHubHomepage →
Loading report...

Similar Projects

sgr-agent-core

75

Schema-Guided Reasoning (SGR) has agentic system design created by neuraldeep community

Python1.1K

bedrock-access-gateway

64

OpenAI-Compatible RESTful APIs for Amazon Bedrock

Python966

gpt4free

94

The official gpt4free repository | various collection of powerful language models | opus 4.6 gpt 5.3 kimi 2.5 deepseek v3.2 gemini 3

Python66.1K

parlant

92

The interaction control harness for customer-facing AI agents - optimized for building controlled, consistent, and predictable customer interactions with LLMs.

Python18.0K
Back to List