auto-round

LLM model quantization (compression) toolkit with HW acceleration support for Nvidia, AMD, Intel GPU and Intel/AMD/Apple CPU via HF, vLLM, and SGLang.

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL)

The open source research environment for AI researchers to seamlessly train, evaluate, and scale models from local hardware to GPU clusters.