← Back to List
⚠
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
PythonGeeeekExplorer/nano-vllm

nano-vllm

Nano vLLM

66.6/100
★ 13.1KForks: 2.0K
View on GitHub →
Loading report...

Similar Projects

text-generation-inference

78

Large Language Model Text Generation Inference

Python★ 10.8K

vllm

93

A high-throughput and memory-efficient inference and serving engine for LLMs

Python★ 77.8K

llm-foundry

80

LLM training code for Databricks foundation models

Python★ 4.4K

keras-hub

80

Pretrained model hub for Keras 3.

Python★ 976
← Back to List