← Back to List
⚠
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
Pythonsgl-project/SpecForge

SpecForge

Train speculative decoding models effortlessly and port them smoothly to SGLang serving.

69.3/100
★ 724Forks: 172
View on GitHub →Homepage →
Loading report...

Similar Projects

InferenceX

69

Open Source Continuous Inference Benchmarking Qwen3.5, DeepSeek, GPTOSS - GB200 NVL72 vs MI355X vs B200 vs GB300 NVL72 vs H100 & soon™ TPUv6e/v7/Trainium2/3

Python★ 638

vllm

93

A high-throughput and memory-efficient inference and serving engine for LLMs

Python★ 72.4K

peft

91

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

Python★ 20.7K

ml-engineering

74

Machine Learning Engineering Open Book

Python★ 17.3K
← Back to List