← Back to List
⚠
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
C++flashrt-project/FlashRT

FlashRT

FlashRT is a high-performance realtime inference engine for small-batch, latency-sensitive AI workloads. The flagship integration is production VLA control for Pi0, Pi0.5, GROOT N1.6, and Pi0-FAST. Also support llm e.g, qwen3.6-27B

70.6/100
★ 597Forks: 85
View on GitHub →
Loading report...

Similar Projects

lucebox

73

LLM speculative inference server for heterogeneous hardware & consumer GPUs

C++★ 2.9K

surogate

82

Train and serve LLMs at extreme speed and massive throughput.

C++★ 817

lemonade

85

Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk

C++★ 5.8K

xllm

83

A high-performance inference engine for LLM, VLM, DiT and REC models, optimized for diverse AI accelerators. It is hosted in OpenAtom Foundation.

C++★ 1.6K
← Back to List