⚠

Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.

Pythonsgl-project/SpecForge

SpecForge

Train speculative decoding models effortlessly and port them smoothly to SGLang serving.

70.7/100

★ 1.0KForks: 293

View on GitHub →Homepage →

Loading report...

Similar Projects

InferenceX

Open Source Continuous Inference Benchmark Research Platform — Kimi K2.7-Code, MiniMax M3, DeepSeekv4, GLM5 - GB200 NVL72 vs MI355X vs B200 vs GB300 NVL72 & soon™ TPUv6e/v7/Trainium2/3 | 开源持续推理基准研究平台 — Kimi K2.7-Code、MiniMax M3、DeepSeekv4、GLM5 - GB200 NVL72 vs MI355X vs B200 vs GB300 NVL72，即将推出™ TPUv6e/v7/Trainium2/3

Python★ 1.3K

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

Python★ 87.1K

peft

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

Python★ 21.4K

ml-engineering

Machine Learning Engineering Open Book

Python★ 18.5K

← Back to List