← Back to List
⚠
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
PythonFlashML-org/FreeToken

FreeToken

FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.

83.9/100
★ 14.2KForks: 1.4K
View on GitHub →Homepage →
Loading report...

Similar Projects

sglang

91

SGLang is a high-performance serving framework for large language models and multimodal models.

Python★ 36.8K

vllm

93

A high-throughput and memory-efficient inference and serving engine for LLMs

Python★ 93.2K

faster-whisper

86

Faster Whisper transcription with CTranslate2

Python★ 25.7K

nano-vllm

50

Nano vLLM

Python★ 15.7K
← Back to List