MLServer

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Seamlessly integrate LLMs into scikit-learn.

Machine Learning inference engine for Microcontrollers and Embedded devices

📘 The experiment tracker for foundation model training