← Back to List
⚠
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
Pythonsgl-project/sglang

sglang

SGLang is a high-performance serving framework for large language models and multimodal models.

90.8/100
★ 30.7KForks: 7.4K
View on GitHub →Homepage →
Loading report...

Similar Projects

vllm

93

A high-throughput and memory-efficient inference and serving engine for LLMs

Python★ 87.1K

gpustack

84

A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

Python★ 5.4K

tokenspeed

77

TokenSpeed is a speed-of-light LLM inference engine.

Python★ 1.7K

Automodel

77

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

Python★ 765
← Back to List