node-llama-cpp

node-llama-cpp

withcatai

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

nodejs
View on GitHub Website
2k Stars
181 Forks
2k Watchers
TypeScript Language
mit License
100 SrcLog Score
Cost to Build
$1.08M
Market Value
$5.92M
How is this calculated?

Growth over time

2 data points  ·  2026-04-08 → 2026-04-15
Stars Forks Watchers
💬

How do you feel about this project?

Ask AI about node-llama-cpp

Question copied to clipboard

What is the withcatai/node-llama-cpp GitHub project? Description: "Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level". Written in TypeScript. Explain what it does, its main use cases, key features, and who would benefit from using it.

Question is copied to clipboard — paste it after the AI opens.

How to clone node-llama-cpp

Clone via HTTPS

git clone https://github.com/withcatai/node-llama-cpp.git

Clone via SSH

[email protected]:withcatai/node-llama-cpp.git

Download ZIP

Download master.zip

Found an issue?

Report bugs or request features on the node-llama-cpp issue tracker:

Open GitHub Issues

Similar to node-llama-cpp

freeCodeCamp electron node axios meteor express freecodecamp.cn pm2 awesome-nodejs hackathon-starter hexo 30-seconds-of-code standard react-starter-kit webtorrent nativefier mocha nodebestpractices ava node-lessons keystone-classic mysql N-blog sheetjs date-fns smartcrop.js pkg best-resume-ever wp-calypso svgo