Back to List
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
Pythonmadroidmaq/mlx-omni-server

mlx-omni-server

MLX Omni Server is a local inference server powered by Apple's MLX framework, specifically designed for Apple Silicon (M-series) chips. It implements OpenAI-compatible API endpoints, enabling seamless integration with existing OpenAI SDK clients while leveraging the power of local ML inference.

83.8/100
674Forks: 83
View on GitHubHomepage →
Loading report...

Similar Projects

sgr-agent-core

82

Schema-Guided Reasoning (SGR) has agentic system design created by neuraldeep community

Python1.0K

bedrock-access-gateway

62

OpenAI-Compatible RESTful APIs for Amazon Bedrock

Python951

gpt4free

94

The official gpt4free repository | various collection of powerful language models | opus 4.6 gpt 5.3 kimi 2.5 deepseek v3.2 gemini 3

Python65.7K

parlant

93

The conversational control layer for customer-facing AI agents - Parlant is a context-engineering framework optimized for controlling customer interactions.

Python17.8K
Back to List