Back to List
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
RustMichael-A-Kuykendall/shimmy

shimmy

⚡ Python-free Rust inference server — OpenAI-API compatible. GGUF + SafeTensors, hot model swap, auto-discovery, single binary. FREE now, FREE forever.

70.2/100
3.7KForks: 284
View on GitHub
Loading report...

Similar Projects

spiceai

84

A portable accelerated SQL query, search, and LLM-inference engine, written in Rust, for data-grounded AI apps and agents.

Rust2.8K

floneum

82

Instant, controllable, local pre-trained AI models in Rust

Rust2.2K

screenpipe

91

screenpipe turns your computer into a personal AI that knows everything you've done. record. search. automate. all local, all private, all yours.

Rust17.1K

memvid

89

Memory layer for AI Agents. Replace complex RAG pipelines with a serverless, single-file memory layer. Give your agents instant retrieval and long-term memory.

Rust13.3K
Back to List