Back to List
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
C++kvcache-ai/Mooncake

Mooncake

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

84.2/100
4.9KForks: 586
View on GitHubHomepage →
Loading report...

Similar Projects

runanywhere-sdks

84

Production ready toolkit to run AI locally

C++10.2K

whisper.cpp

85

Port of OpenAI's Whisper model in C/C++

C++47.3K

MNN

94

MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.

C++14.5K

BrowserOS

87

🌐 The open-source Agentic browser; alternative to ChatGPT Atlas, Perplexity Comet, Dia.

C++9.6K
Back to List