LlamaFactory

Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

Research of DeepSeek Engram Architecture based on Qwen-3 and Stable Diffusion series.