← Back to List
⚠
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
C++invergent-ai/surogate

surogate

Train and serve LLMs at extreme speed and massive throughput.

81.9/100
★ 849Forks: 11
View on GitHub →Homepage →
Loading report...

Similar Projects

lemonade

85

Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk

C++★ 5.8K

unsloth

95

Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.

Python★ 77.2K

MNN

88

MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.

C++★ 16.2K

PowerInfer

54

High-speed Large Language Model Serving for Local Deployment

C++★ 9.8K
← Back to List