← Back to List
⚠
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
Pythonspark-arena/sparkrun

sparkrun

sparkrun - launch, manage, and stop LLM inference workloads on NVIDIA DGX Spark systems. Live support: https://discord.com/invite/GH5kRgv6ZD

81.8/100
★ 532Forks: 59
View on GitHub →Homepage →
Loading report...

Similar Projects

LMCache

89

LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

Python★ 12.0K

FastDeploy

82

High-performance Inference and Deployment Toolkit for LLMs and VLMs based on PaddlePaddle

Python★ 3.7K

vllm-ascend

79

Community maintained hardware plugin for vLLM on Huawei Ascend

Python★ 2.9K

InferenceX

75

Open Source Inference Research Platform Standard / 开源推理研究平台

Python★ 1.8K
← Back to List