← Back to List
⚠
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
Pythonsgl-project/sglang

sglang

SGLang is a high-performance serving framework for large language models and multimodal models.

91.1/100
★ 36.8KForks: 9.3K
View on GitHub →Homepage →
Loading report...

Similar Projects

vllm

93

A high-throughput and memory-efficient inference and serving engine for LLMs

Python★ 93.2K

gpustack

83

A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

Python★ 5.8K

tokenspeed

78

TokenSpeed is a speed-of-light LLM inference engine.

Python★ 2.2K

Automodel

74

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

Python★ 991
← Back to List