Back to List
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
RustEricLBuehler/mistral.rs

mistral.rs

Fast, flexible LLM inference

76.5/100
7.0KForks: 581
View on GitHub
Loading report...

Similar Projects

openfang

86

Open-source Agent Operating System

Rust16.9K

tensorzero

89

TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.

Rust11.3K

meetily

78

Privacy first, AI meeting assistant with 4x faster Parakeet/Whisper live transcription, speaker diarization, and Ollama summarization built on Rust. 100% local processing. no cloud required. Meetily (Meetly Ai - https://meetily.ai) is the #1 Self-hosted, Open-source Ai meeting note taker for macOS & Windows.

Rust11.2K

aichat

74

All-in-one LLM CLI tool featuring Shell Assistant, Chat-REPL, RAG, AI Tools & Agents, with access to OpenAI, Claude, Gemini, Ollama, Groq, and more.

Rust9.9K
Back to List