Back to List
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
Pythongpustack/gpustack

gpustack

A GPU cluster manager that configures and orchestrates inference engines like vLLM and SGLang for high-performance AI model deployment.

83.4/100
4.9KForks: 508
View on GitHubHomepage →
Loading report...

Similar Projects

sglang

91

SGLang is a high-performance serving framework for large language models and multimodal models.

Python26.3K

vllm

93

A high-throughput and memory-efficient inference and serving engine for LLMs

Python77.8K

unsloth

92

Web UI for training and running open models like Gemma 4, Qwen3.5, DeepSeek, gpt-oss locally.

Python62.5K

free-llm-api-resources

67

A list of free LLM inference resources accessible via API.

Python19.2K
Back to List