← Back to List
⚠
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
Pythonovg-project/kvcached

kvcached

Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond

73.5/100
★ 1.1KForks: 129
View on GitHub →
Loading report...

Similar Projects

InferenceX

73

Open Source Continuous Inference Benchmark Research Platform — Kimi K2.7-Code, MiniMax M3, DeepSeekv4, GLM5 - GB200 NVL72 vs MI355X vs B200 vs GB300 NVL72 & soon™ TPUv6e/v7/Trainium2/3 | 开源持续推理基准研究平台 — Kimi K2.7-Code、MiniMax M3、DeepSeekv4、GLM5 - GB200 NVL72 vs MI355X vs B200 vs GB300 NVL72，即将推出™ TPUv6e/v7/Trainium2/3

Python★ 1.3K

PocketFlow-Tutorial-Codebase-Knowledge

65

Pocket Flow: Codebase to Tutorial

Python★ 12.5K

LMCache

89

LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

Python★ 10.9K

UltraRAG

85

A Low-Code MCP Framework for Building Complex and Innovative RAG Pipelines

Python★ 5.7K
← Back to List