← Back to List
⚠
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
C++alibaba/MNN

MNN

MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.

93.9/100
★ 15.0KForks: 2.3K
View on GitHub →Homepage →
Loading report...

Similar Projects

serving

90

A flexible, high-performance serving system for machine learning models

C++★ 6.4K

nndeploy

85

一款简单易用和高性能的AI部署框架 | An Easy-to-Use and High-Performance AI Deployment Framework

C++★ 1.8K

deeplake

79

Deeplake is AI Data Runtime for Agents. It provides serverless postgres with a multimodal datalake, enabling scalable retrieval and training.

C++★ 9.1K

LeanCopilot

71

LLMs as Copilots for Theorem Proving in Lean

C++★ 1.3K
← Back to List