LightLLM

A high-throughput and memory-efficient inference and serving engine for LLMs

Nano vLLM

Large Language Model Text Generation Inference

MedicalGPT: Training Your Own Medical GPT Model with ChatGPT Training Pipeline. 训练医疗大模型，实现了包括增量预训练(PT)、有监督微调(SFT)、RLHF、DPO、ORPO、GRPO。