Back to List
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
C++orailnoor/cross-platform-llm-client

cross-platform-llm-client

A unified cross-platform AI client supporting seamless transitions between standard cloud APIs and on-device, offline execution of custom and uncensored language models.

65.7/100
682Forks: 142
View on GitHub
Loading report...

Similar Projects

llama.cpp

89

LLM inference in C/C++

C++121.5K

whisper.cpp

81

Port of OpenAI's Whisper model in C/C++

C++52.3K

BitNet

69

Official inference framework for 1-bit LLMs

C++39.8K

rocksdb

88

A library that provides an embeddable, persistent key-value store for fast storage.

C++31.9K
Back to List