Back to List
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
Python1CatAI/1Cat-vLLM

1Cat-vLLM

vLLM fork for Tesla V100 (SM70) with AWQ 4-bit support, CUDA 12.8 build flow, and validated Qwen3.5 27B/35B deployment on multi-GPU V100.

66.1/100
500Forks: 86
View on GitHub
Loading report...

Similar Projects

hermes-agent

91

The agent that grows with you

Python211.6K

AutoGPT

96

AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.

Python185.4K

markitdown

85

Python tool for converting files and office documents to Markdown.

Python164.1K

transformers

98

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Python162.4K
Back to List