lighteval

The LLM Evaluation Framework

Data-Driven Evaluation for LLM-Powered Applications

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Easily fine-tune, evaluate and deploy Qwen, Gemma, or any open weight LLM!