Back to List
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
Pythonsgl-project/SpecForge

SpecForge

Train speculative decoding models effortlessly and port them smoothly to SGLang serving.

71.0/100
1.2KForks: 333
View on GitHubHomepage →
Loading report...

Similar Projects

vllm

93

A high-throughput and memory-efficient inference and serving engine for LLMs

Python91.2K

peft

91

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

Python21.6K

ml-engineering

77

Machine Learning Engineering Open Book

Python18.9K

nano-vllm

51

Nano vLLM

Python15.3K
Back to List