← Back to List
⚠
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
TypeScriptwithcatai/node-llama-cpp

node-llama-cpp

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

86.3/100
★ 2.2KForks: 222
View on GitHub →Homepage →
Loading report...

Similar Projects

atomic-agent

85

Atomic Agent is a local-first AI agent. Runs open-weight models on your own machine via llama.cpp.

TypeScript★ 2.8K

mastra

88

Mastra is the modern TypeScript framework for AI-powered applications and agents.

TypeScript★ 28.6K

voltagent

88

AI Agent Engineering Platform built on an Open Source TypeScript AI Agent Framework

TypeScript★ 10.7K

ax

87

The pretty much "official" DSPy framework for Typescript

TypeScript★ 3.0K
← Back to List