← Back to List
⚠
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
C++ggml-org/llama.cpp

llama.cpp

LLM inference in C/C++

89.2/100
★ 130.3KForks: 24.1K
View on GitHub →Homepage →
Loading report...

Similar Projects

whisper.cpp

88

Port of OpenAI's Whisper model in C/C++

C++★ 54.1K

BitNet

56

Official inference framework for 1-bit LLMs

C++★ 40.4K

FinceptTerminal

91

FinceptTerminal is a modern finance application offering advanced market analytics, investment research, and economic data tools, designed for interactive exploration and data-driven decision-making in a user-friendly environment.

C++★ 32.2K

rocksdb

87

A library that provides an embeddable, persistent key-value store for fast storage.

C++★ 32.2K
← Back to List