AnglE

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

Retrieval and Retrieval-augmented LLMs

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

中文LLaMA-2 & Alpaca-2大模型二期项目 + 64K超长上下文模型 (Chinese LLaMA-2 & Alpaca-2 LLMs with 64K long context models)