← Back to List
⚠
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
C++kvcache-ai/Mooncake

Mooncake

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

87.2/100
★ 6.7KForks: 1.3K
View on GitHub →Homepage →
Loading report...

Similar Projects

runanywhere-sdks

85

Production ready toolkit to run AI locally

C++★ 10.3K

tiny-vllm

65

Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM

C++★ 1.1K

BigMoeOnEdge

75

Run MoE models bigger than your RAM. Frontier-size MoE on a 12 GB phone, lossless, on stock llama.cpp

C++★ 607

whisper.cpp

88

Port of OpenAI's Whisper model in C/C++

C++★ 54.1K
← Back to List