From 2f5bb3a501bc52c6af74cd71103f07166c981a6a Mon Sep 17 00:00:00 2001 From: Finessse Date: Wed, 17 Dec 2025 21:16:06 +0700 Subject: [PATCH] docs: note caching-friendly packed state --- docs/memory.md | 11 +++++++++++ 1 file changed, 11 insertions(+) diff --git a/docs/memory.md b/docs/memory.md index cf724d85..5956007c 100644 --- a/docs/memory.md +++ b/docs/memory.md @@ -69,3 +69,14 @@ Environment variables: - `CLIPROXY_TODO_ENABLED` (default: enabled) - `CLIPROXY_TODO_MAX_CHARS` (default: `4000`) + +## Prompt-cache friendly packing + +To preserve stable prompt prefixes for long sessions, CLIProxyAPI packs session state into the **last user message** (as a prepended block), instead of mutating `instructions` / system messages. + +Packed block format: + +- `` + - `` from `pinned.md` + - `` from `summary.md` + - `` from `todo.md`