Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
Rustmichaelneale/mesh-llm
mesh-llm
reference impl with llama.cpp compiled to distributed inference across machines, with real end to end demo