Back to List
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
Pythonmadroidmaq/mlx-omni-server

mlx-omni-server

MLX Omni Server is a local inference server powered by Apple's MLX framework, specifically designed for Apple Silicon (M-series) chips. It implements OpenAI-compatible API endpoints, enabling seamless integration with existing OpenAI SDK clients while leveraging the power of local ML inference.

69.3/100
735Forks: 91
View on GitHubHomepage →
Loading report...

Similar Projects

sgr-agent-core

79

Schema-Guided Reasoning (SGR) has agentic system design created by neuraldeep community

Python1.1K

bedrock-access-gateway

56

OpenAI-Compatible RESTful APIs for Amazon Bedrock

Python1.0K

gpt4free

94

The official gpt4free repository | various collection of powerful language models | opus 4.6 gpt 5.3 kimi 2.5 deepseek v3.2 gemini 3

Python66.5K

parlant

89

Build reliable customer-facing AI agents with Parlant: an interaction control harness optimized for controlled, consistent, and predictable LLM interactions.

Python18.2K
Back to List