Back to List
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
Pythonharleyszhang/llm_note

llm_note

LLM notes, including model inference, transformer model structure, and llm framework code analysis notes.

54.0/100
882Forks: 87
View on GitHub
Loading report...

Similar Projects

LMCache

88

LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

Python8.5K

vllm-cli

56

A command-line interface tool for serving LLM using vLLM.

Python500

litgpt

89

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

Python13.4K

OpenLLM

91

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

Python12.4K
Back to List