Back to List
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
PythonPaddlePaddle/FastDeploy

FastDeploy

High-performance Inference and Deployment Toolkit for LLMs and VLMs based on PaddlePaddle

84.7/100
3.7KForks: 740
View on GitHubHomepage →
Loading report...

Similar Projects

ERNIE

69

The official repository for ERNIE 4.5 and ERNIEKit – its industrial-grade development toolkit based on PaddlePaddle.

Python7.7K

vllm-ascend

78

Community maintained hardware plugin for vLLM on Ascend

Python2.0K

vllm

93

A high-throughput and memory-efficient inference and serving engine for LLMs

Python77.6K

LMCache

87

Supercharge Your LLM with the Fastest KV Cache Layer

Python8.1K
Back to List