Back to List
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
TypeScriptwithcatai/node-llama-cpp

node-llama-cpp

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

79.3/100
2.2KForks: 215
View on GitHubHomepage →
Loading report...

Similar Projects

atomic-agent

85

Atomic Agent is a local-first AI agent. Runs open-weight models on your own machine via llama.cpp.

TypeScript2.5K

mastra

90

Mastra is the modern TypeScript framework for AI-powered applications and agents.

TypeScript27.8K

voltagent

86

AI Agent Engineering Platform built on an Open Source TypeScript AI Agent Framework

TypeScript10.6K

ax

87

The pretty much "official" DSPy framework for Typescript

TypeScript2.9K
Back to List