Back to List
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
TypeScriptwithcatai/node-llama-cpp

node-llama-cpp

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

85.4/100
2.1KForks: 208
View on GitHubHomepage →
Loading report...

Similar Projects

atomic-agent

79

Local First Ai Agent. Optimized for Local Ai models. Long context window. Proper tools callings. Runs privately on your device.

TypeScript972

mastra

87

Mastra is the modern TypeScript framework for AI-powered applications and agents.

TypeScript26.5K

voltagent

86

AI Agent Engineering Platform built on an Open Source TypeScript AI Agent Framework

TypeScript10.1K

ax

87

The pretty much "official" DSPy framework for Typescript

TypeScript2.8K
Back to List