⚠

Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.

Rustpegainfer-project/pegainfer

pegainfer

Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2

69.5/100

★ 651Forks: 99

View on GitHub →Homepage →

Loading report...

Similar Projects

openinterpreter

A coding agent for open models like Kimi K3

Rust★ 68.0K

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

Python★ 89.2K

CodeWhale

Open-source, community-driven agent harness

Rust★ 40.8K

EchoBird

One-click install + model switch:Claude Code,Codex CLI (OpenAI), Grok Build (xAI), DeepSeek Harness, Kimi Code (Moonshot) ,Qwen Code,Aider,OpenCode,MiMo Code (Xiaomi),ZCode (Z.AI),OpenClaw,Pi,OpenScience,Vibe-Trading,Claude Desktop (3P profile),ChatGPT desktop,OpenCode Desktop,

Rust★ 3.0K

← Back to List