← Back to List
⚠
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
Rustpegainfer-project/pegainfer

pegainfer

Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2

74.1/100
★ 713Forks: 110
View on GitHub →Homepage →
Loading report...

Similar Projects

openinterpreter

94

A coding agent for open models like Kimi K3 and GLM 5.3

Rust★ 68.5K

vllm

93

A high-throughput and memory-efficient inference and serving engine for LLMs

Python★ 93.0K

EchoBird

81

Manage ChatGPT, Codex CLI, and Claude Code accounts and track quota in one place. Use multi-model smart routing with priority and automatic failover. Install AI tools and deploy local LLMs in one click.

Rust★ 3.3K

deepwiki-rs

83

Turn code into clarity. Generate accurate technical docs and AI-ready context in minutes—perfectly structured for human teams and intelligent agents.

Rust★ 3.1K
← Back to List