GPTQModel

A SOTA quantization algorithm for high-accuracy low-bit LLM inference, seamlessly optimized for CPU/XPU/CUDA, with multi-datatype support and full compatibility with vLLM, SGLang, and Transformers.

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL)