Back to List
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
Pythongpustack/gpustack

gpustack

Performance-optimized AI inference on your GPUs. Unlock superior throughput by selecting and tuning engines like vLLM or SGLang.

85.4/100
4.6KForks: 467
View on GitHubHomepage →
Loading report...

Similar Projects

sglang

90

SGLang is a high-performance serving framework for large language models and multimodal models.

Python24.2K

vllm

93

A high-throughput and memory-efficient inference and serving engine for LLMs

Python72.4K

unsloth

93

Fine-tuning & Reinforcement Learning for LLMs. 🦥 Train OpenAI gpt-oss, DeepSeek, Qwen, Llama, Gemma, TTS 2x faster with 70% less VRAM.

Python53.5K

parlant

93

The conversational control layer for customer-facing AI agents - Parlant is a context-engineering framework optimized for controlling customer interactions.

Python17.8K
Back to List