oat

A library with extensible implementations of DPO, KTO, PPO, ORPO, and other human-aware loss functions (HALOs).

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

Official release of InternLM series (InternLM, InternLM2, InternLM2.5, InternLM3).

MedicalGPT: Training Your Own Medical GPT Model with ChatGPT Training Pipeline. 训练医疗大模型，实现了包括增量预训练(PT)、有监督微调(SFT)、RLHF、DPO、ORPO、GRPO。