Back to List
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
TypeScriptwithcatai/node-llama-cpp

node-llama-cpp

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

88.6/100
1.9KForks: 175
View on GitHubHomepage →
Loading report...

Similar Projects

mastra

91

From the team behind Gatsby, Mastra is a framework for building AI-powered applications and agents with a modern TypeScript stack.

TypeScript21.8K

voltagent

87

AI Agent Engineering Platform built on an Open Source TypeScript AI Agent Framework

TypeScript6.5K

ax

87

The pretty much "official" DSPy framework for Typescript

TypeScript2.4K

maid

85

Maid is a free and open source application for interfacing with llama.cpp models locally, and with Anthropic, DeepSeek, Ollama, Mistral and OpenAI models remotely.

TypeScript2.4K
Back to List