Commit Graph
2 Commits
Author SHA1 Message Date
Finessse f42cadf459 feat(cache): add max-bytes size limit for response cache 2026-01-09 23:39:57 +07:00
Finessse 30978f1f17 feat(cache): add response cache and prompt cache tracking
Response cache stores completions keyed by request hash.
Prompt cache tracking aggregates cache_read/cache_creation tokens.
WebUI CacheStats component shows hit rates and token savings.
2026-01-06 06:21:54 +07:00