← Back to List
⚠
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
Pythondatawhalechina/zero-to-sglang

zero-to-sglang

Official SGLang x Datawhale course on LLM inference: understand inference, build a mini-sglang from scratch, then read the real SGLang source and land your first PR. Available in English and Chinese.

64.2/100
★ 1.4KForks: 106
View on GitHub →Homepage →
Loading report...

Similar Projects

LMCache

89

LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

Python★ 12.0K

kvcached

77

Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond

Python★ 1.5K

llm_note

51

LLM notes, including model inference, transformer model structure, and llm framework code analysis notes.

Python★ 892

vllm

93

A high-throughput and memory-efficient inference and serving engine for LLMs

Python★ 93.2K
← Back to List