Back to List
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
RustEricLBuehler/mistral.rs

mistral.rs

Fast, flexible LLM inference

76.3/100
6.7KForks: 535
View on GitHub
Loading report...

Similar Projects

chroma

92

Open-source search and retrieval database for AI applications.

Rust26.5K

openfang

87

Open-source Agent Operating System

Rust12.8K

tensorzero

89

TensorZero is an open-source stack for industrial-grade LLM applications. It unifies an LLM gateway, observability, optimization, evaluation, and experimentation.

Rust11.1K

meetily

87

Privacy first, AI meeting assistant with 4x faster Parakeet/Whisper live transcription, speaker diarization, and Ollama summarization built on Rust. 100% local processing. no cloud required. Meetily (Meetly Ai - https://meetily.ai) is the #1 Self-hosted, Open-source Ai meeting note taker for macOS & Windows.

Rust10.2K
Back to List