prompt-cache

Cut LLM costs by up to 80% and unlock sub-millisecond responses with intelligent semantic caching.A drop-in, provider-agnostic LLM proxy written in Go with sub-millisecond response

performance

View on GitHub Website

216 Stars

21 Forks

216 Watchers

Go Language

mit License

100 SrcLog Score

Cost to Build

$637.7K

Market Value

$2.01M

How is this calculated?

Growth over time

2 data points · 2026-04-13 → 2026-04-20

Stars Forks Watchers

💬

How do you feel about this project?

Ask AI about prompt-cache

Question copied to clipboard

What is the messkan/prompt-cache GitHub project? Description: "Cut LLM costs by up to 80% and unlock sub-millisecond responses with intelligent semantic caching.A drop-in, provider-agnostic LLM proxy written in Go with sub-millisecond response". Written in Go. Explain what it does, its main use cases, key features, and who would benefit from using it.

Question is copied to clipboard — paste it after the AI opens.

How to clone prompt-cache

Clone via HTTPS

git clone https://github.com/messkan/prompt-cache.git

Clone via SSH

[email protected]:messkan/prompt-cache.git

Download ZIP

Download master.zip

Found an issue?

Report bugs or request features on the prompt-cache issue tracker:

Open GitHub Issues

Similar to prompt-cache

netdata gin ava inferno react-virtualized sharp lazysizes fastify marktext pinpoint Clusterize.js AndroidPerformanceMonitor Front-End-Performance-Checklist lozad.js k6 vibora neon orientdb android-tips-tricks FrameworkBenchmarks fuse-box cython happypack camerakit-android BenchmarkDotNet jruby guess Entitas objectbox-java Halide