Back to List
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
C++flashrt-project/FlashRT

FlashRT

FlashRT is a high-performance realtime inference engine for small-batch, latency-sensitive AI workloads. The flagship integration is production VLA control for Pi0, Pi0.5, GROOT N1.6, and Pi0-FAST. Also support llm e.g, qwen3.6-27B

66.4/100
500Forks: 61
View on GitHub
Loading report...

Similar Projects

lucebox

73

LLM speculative inference server for consumer hardware & heterogeneous computing

C++2.7K

surogate

79

Training/Fine-tuning at the speed of light

C++806

lemonade

85

Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk

C++5.3K

sonar

82

Large-scale LLM inference engine

C++1.8K
Back to List