Back to List
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
Pythonmadroidmaq/mlx-omni-server

mlx-omni-server

MLX Omni Server is a local inference server powered by Apple's MLX framework, specifically designed for Apple Silicon (M-series) chips. It implements OpenAI-compatible API endpoints, enabling seamless integration with existing OpenAI SDK clients while leveraging the power of local ML inference.

75.2/100
723Forks: 89
View on GitHubHomepage →
Loading report...

Similar Projects

sgr-agent-core

71

Schema-Guided Reasoning (SGR) has agentic system design created by neuraldeep community

Python1.1K

bedrock-access-gateway

64

OpenAI-Compatible RESTful APIs for Amazon Bedrock

Python986

gpt4free

94

The official gpt4free repository | various collection of powerful language models | opus 4.6 gpt 5.3 kimi 2.5 deepseek v3.2 gemini 3

Python66.3K

parlant

93

Build reliable customer-facing AI agents with Parlant: an interaction control harness optimized for controlled, consistent, and predictable LLM interactions.

Python18.1K
Back to List