Back to List
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
RustEricLBuehler/mistral.rs

mistral.rs

Fast, flexible LLM inference

78.8/100
7.3KForks: 621
View on GitHub
Loading report...

Similar Projects

CodeWhale

86

DeepSeek + MiMo coding agent in terminal

Rust37.7K

openfang

79

Open-source Agent Operating System

Rust17.8K

meetily

87

Privacy first, AI meeting assistant with 4x faster Parakeet/Whisper live transcription, speaker diarization, and Ollama summarization built on Rust. 100% local processing. no cloud required. Meetily (Meetly Ai - https://meetily.ai) is the #1 Self-hosted, Open-source Ai meeting note taker for macOS & Windows.

Rust12.6K

tensorzero

88

TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.

Rust11.5K
Back to List