← Back to List
⚠
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
Pythonspark-arena/sparkrun

sparkrun

sparkrun - launch, manage, and stop LLM inference workloads on NVIDIA DGX Spark systems. Live support: https://discord.com/invite/GH5kRgv6ZD

82.2/100
★ 500Forks: 53
View on GitHub →Homepage →
Loading report...

Similar Projects

LMCache

89

LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

Python★ 11.7K

FastDeploy

81

High-performance Inference and Deployment Toolkit for LLMs and VLMs based on PaddlePaddle

Python★ 3.7K

InferenceX

76

Open Source Continuous Inference Benchmark Research Platform — Kimi K3 2.8T, MiniMax M3, DeepSeekv4, GLM5 - GB200 NVL72 vs MI355X vs B200 vs GB300 NVL72 & soon™ TPUv6e/v7/Trainium2/3 | 开源持续推理基准研究平台 — Kimi K2.7-Code、MiniMax M3、DeepSeekv4、GLM5 - GB200 NVL72 vs MI355X vs B200 vs GB300 NVL72，即将推出™ TPUv6e/v7/Trainium2/3

Python★ 1.6K

auto-round

78

A SOTA quantization toolkit for high-accuracy low-bit LLM inference|简洁且高效的量化工具包

Python★ 1.6K
← Back to List