← Back to List
⚠
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
C++Helldez/BigMoeOnEdge

BigMoeOnEdge

Run MoE models bigger than your RAM. Frontier-size MoE on a 12 GB phone, lossless, on stock llama.cpp

75.2/100
★ 607Forks: 67
View on GitHub →
Loading report...

Similar Projects

jev

78

jevos is an open-source alternative to Jev for yes/no decisions that runs on your laptop.

C++★ 1.2K

runanywhere-sdks

85

Production ready toolkit to run AI locally

C++★ 10.3K

llamafile

88

Distribute and run LLMs with a single file.

C++★ 26.2K

sherpa-onnx

87

Speech-to-text, text-to-speech, speaker diarization, speech enhancement, source separation, and VAD using next-gen Kaldi with onnxruntime without Internet connection. Support embedded systems, Android, iOS, HarmonyOS, Raspberry Pi, RISC-V, RK NPU, Axera NPU, Ascend NPU, x86_64 servers, websocket server/client, support 12 programming languages

C++★ 15.1K
← Back to List