Machine learning compiler based on MLIR for Sophgo TPU.
MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.
Production ready toolkit to run AI locally
High-speed Large Language Model Serving for Local Deployment
Deeplake is AI Data Runtime for Agents. It provides serverless postgres with a multimodal datalake, enabling scalable retrieval and training.