← Back to List
⚠
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
Pythonsgl-project/sglang

sglang

SGLang is a high-performance serving framework for large language models and multimodal models.

91.0/100
★ 35.6KForks: 8.6K
View on GitHub →Homepage →
Loading report...

Similar Projects

vllm

93

A high-throughput and memory-efficient inference and serving engine for LLMs

Python★ 91.2K

gpustack

84

A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

Python★ 5.6K

tokenspeed

78

TokenSpeed is a speed-of-light LLM inference engine.

Python★ 2.1K

Automodel

74

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

Python★ 907
← Back to List