← Back to List
⚠
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
RustEricLBuehler/candle-vllm

candle-vllm

Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.

71.3/100
★ 721Forks: 88
View on GitHub →
Loading report...

Similar Projects

claw-code

68

An agent-managed museum exhibit, built in Rust with Gajae-Code / LazyCodex — developed and maintained with no human intervention.

Rust★ 195.2K

cc-switch

93

A cross-platform desktop All-in-One assistant for Claude Code, Codex, OpenCode, OpenClaw, Grok Build & Hermes Agent. Only official website: ccswitch.io

Rust★ 131.6K

codex

78

Lightweight coding agent that runs in your terminal

Rust★ 122.3K

RuView

95

π RuView turns commodity WiFi signals into real-time spatial intelligence, vital sign monitoring, and presence detection — all without a single pixel of video.

Rust★ 92.8K
← Back to List