Back to List
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
PythonGeeeekExplorer/nano-vllm

nano-vllm

Nano vLLM

50.9/100
15.3KForks: 2.6K
View on GitHub
Loading report...

Similar Projects

text-generation-inference

68

Large Language Model Text Generation Inference

Python10.9K

vllm

93

A high-throughput and memory-efficient inference and serving engine for LLMs

Python91.2K

llm-foundry

68

LLM training code for Databricks foundation models

Python4.4K

keras-hub

80

Pretrained model hub for Keras 3.

Python990
Back to List