Commit Graph
3 Commits
Author SHA1 Message Date
RCD 85267e7379 fix: resolve v6.9.22 cache metric cycles 2026-04-11 00:10:43 +07:00
Finessse f42cadf459 feat(cache): add max-bytes size limit for response cache 2026-01-09 23:39:57 +07:00
Finessse 30978f1f17 feat(cache): add response cache and prompt cache tracking
Response cache stores completions keyed by request hash.
Prompt cache tracking aggregates cache_read/cache_creation tokens.
WebUI CacheStats component shows hit rates and token savings.
2026-01-06 06:21:54 +07:00