← Back to List
⚠
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
SwiftSharpAI/SwiftLM

SwiftLM

⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache compression, MACOS + iOS iPhone app.

79.9/100
★ 777Forks: 54
View on GitHub →
Loading report...

Similar Projects

turbo-fieldfare

79

Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook

Swift★ 6.9K

osaurus

88

Own your AI. The native macOS harness for AI agents -- any model, persistent memory, autonomous execution, cryptographic identity. Built in Swift. Fully offline. Open source.

Swift★ 8.0K

enchanted

68

Enchanted is iOS and macOS app for chatting with private self hosted language models such as Llama2, Mistral or Vicuna using Ollama.

Swift★ 6.0K

hermex

75

Native iPhone app for your Hermes agent

Swift★ 1.5K
← Back to List