docs: note caching-friendly packed state

This commit is contained in:
Finessse
2025-12-17 21:16:06 +07:00
parent 34082f2eef
commit 2f5bb3a501
+11
View File
@@ -69,3 +69,14 @@ Environment variables:
- `CLIPROXY_TODO_ENABLED` (default: enabled)
- `CLIPROXY_TODO_MAX_CHARS` (default: `4000`)
## Prompt-cache friendly packing
To preserve stable prompt prefixes for long sessions, CLIProxyAPI packs session state into the **last user message** (as a prepended block), instead of mutating `instructions` / system messages.
Packed block format:
- `<proxypilot_state>`
- `<pinned>` from `pinned.md`
- `<anchor>` from `summary.md`
- `<todo>` from `todo.md`