General technology for enabling AI capabilities w/ LLMs and MLLMs
Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.
EasyR1: An Efficient, Scalable, Multi-Modality RL Training Framework based on veRL
LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
A high-throughput and memory-efficient inference and serving engine for LLMs