Back to List
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
C++timmyy123/LLM-Hub

LLM-Hub

Local AI Assistant on your phone

77.3/100
503Forks: 104
View on GitHubHomepage →
Loading report...

Similar Projects

PowerInfer

59

High-speed Large Language Model Serving for Local Deployment

C++9.6K

cactus

85

Tiny AI for tiny devices

C++5.5K

lemonade

85

Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk

C++5.0K

tt-metal

78

:metal: TT-NN operator library, and TT-Metalium low level kernel programming model.

C++1.6K
Back to List