Back to List
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
Pythondatawhalechina/zero-to-sglang

zero-to-sglang

Official SGLang × Datawhale course on LLM inference (中英双语): understand inference, build a mini-sglang from scratch, then read the real SGLang source and land your first PR. 《从零手搓SGLang》:读懂推理,手搓 mini-sglang,吃透 SGLang 源码。

63.9/100
633Forks: 46
View on GitHubHomepage →
Loading report...

Similar Projects

LMCache

89

LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

Python11.7K

llm_note

56

LLM notes, including model inference, transformer model structure, and llm framework code analysis notes.

Python890

vllm

93

A high-throughput and memory-efficient inference and serving engine for LLMs

Python91.4K

hello-agents

84

📚 《从零开始构建智能体》——从零开始的智能体原理与实践教程

Python78.1K
Back to List