Back to List
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
Pythonharleyszhang/llm_note

llm_note

LLM notes, including model inference, transformer model structure, and llm framework code analysis notes.

46.1/100
866Forks: 87
View on GitHub
Loading report...

Similar Projects

LMCache

87

Supercharge Your LLM with the Fastest KV Cache Layer

Python7.6K

litgpt

89

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

Python13.2K

OpenLLM

89

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

Python12.1K

lmdeploy

85

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

Python7.7K
Back to List