Back to List
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
C++lemonade-sdk/lemonade

lemonade

Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk

84.8/100
5.1KForks: 420
View on GitHubHomepage →
Loading report...

Similar Projects

FastFlowLM

83

Run LLMs on AMD Ryzen™ AI NPUs in minutes. Just like Ollama - but purpose-built and deeply optimized for the AMD NPUs.

C++1.6K

PowerInfer

58

High-speed Large Language Model Serving for Local Deployment

C++9.7K

ZhiLight

55

A highly optimized LLM inference acceleration engine for Llama and its variants.

C++905

surogate

80

Training/Fine-tuning at the speed of light

C++806
Back to List