bitsandbytes

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

Machine Learning Engineering Open Book

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

Single-GPU LLM fine-tuning preflight: memory estimates, runnable LoRA/QLoRA recipes, and local measurements.