Back to List
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
C++orailnoor/cross-platform-llm-client

cross-platform-llm-client

A unified cross-platform AI client supporting seamless transitions between standard cloud APIs and on-device, offline execution of custom and uncensored language models.

54.0/100
1.1KForks: 218
View on GitHub
Loading report...

Similar Projects

llama.cpp

89

LLM inference in C/C++

C++127.5K

whisper.cpp

88

Port of OpenAI's Whisper model in C/C++

C++53.5K

BitNet

59

Official inference framework for 1-bit LLMs

C++40.2K

rocksdb

87

A library that provides an embeddable, persistent key-value store for fast storage.

C++32.1K
Back to List