Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
PythonNVIDIA/TensorRT-Edge-LLM
TensorRT-Edge-LLM
High-performance, light-weight C++ LLM and VLM Inference Software for Physical AI