← Back to List
⚠
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
RustMichael-A-Kuykendall/shimmy

shimmy

⚡ Python-free Rust inference server — OpenAI-API compatible. GGUF + SafeTensors, hot model swap, auto-discovery, single binary. FREE now, FREE forever.

75.9/100
★ 4.0KForks: 347
View on GitHub →
Loading report...

Similar Projects

spiceai

84

A portable accelerated SQL query, search, and LLM-inference engine, written in Rust, for data-grounded AI apps and agents.

Rust★ 2.9K

floneum

82

Instant, controllable, local pre-trained AI models in Rust

Rust★ 2.2K

rtk

89

CLI proxy that reduces LLM token consumption by 60-90% on common dev commands. Single Rust binary, zero dependencies

Rust★ 31.8K

llmfit

85

Hundreds of models & providers. One command to find what runs on your hardware.

Rust★ 24.2K
← Back to List