Back to List
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
Pythonharleyszhang/llm_note

llm_note

LLM notes, including model inference, transformer model structure, and llm framework code analysis notes.

60.3/100
878Forks: 87
View on GitHub
Loading report...

Similar Projects

LMCache

87

Supercharge Your LLM with the Fastest KV Cache Layer

Python8.1K

litgpt

87

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

Python13.3K

OpenLLM

90

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

Python12.3K

lmdeploy

85

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

Python7.8K
Back to List