llm_aided_ocr

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

LLM-Driven Extraction of Unstructured Data — Built for API Deployments & ETL Pipeline Workflows