i dZddlZddlmZmZmZddedededdfd Z dd eee efd e dedeee effd Z dS)aaAnthropic prompt caching (system_and_3 strategy). Reduces input token costs by ~75% on multi-turn conversations by caching the conversation prefix. Uses 4 cache_control breakpoints (Anthropic max): 1. System prompt (stable across all turns) 2-4. Last 3 non-system messages (rolling window) Pure functions -- no class state, no AIAgent dependency. N)AnyDictListFmsg cache_markernative_anthropicreturncX|dd}|d}|dkr |r||d<dS||dkr||d<dSt|tr d||dg|d<dSt|tr&|r&|d }t|tr ||d<dSdSdSdS) zFAdd cache_control to a single message, handling all format variations.rolecontenttool cache_controlNtext)typerr)get isinstancestrlistdict)rrrr r lasts 9/home/ubuntu/.hermes/hermes-agent/agent/prompt_caching.py_apply_cache_markerrs 7762  Dggi  G v~~  0#/C 'R--+O'3W| L L I '4  1W1r{ dD ! ! 1$0D ! ! !1111 1 15m api_messages cache_ttlcxtj|sSddi}|dkrd|d<d}dddkrtd|||d z }d |z }fd t t D}|| d D]}t|||S) zApply system_and_3 caching strategy to messages for Anthropic models. Places up to 4 cache_control breakpoints: system prompt + last 3 non-system messages. Returns: Deep copy of messages with cache_control breakpoints injected. r ephemeral1httlrr system)rcRg|]#}|ddk!|$S)r r#)r).0imessagess r z1apply_anthropic_cache_control..Ds3VVVQ(1+//&2I2IX2U2Uq2U2U2UrN)copydeepcopyrrrangelen) rrrmarkerbreakpoints_used remainingnon_sysidxr)s @rapply_anthropic_cache_controlr4)s}\**H k "FDu {v(**HQKBRSSSSA$$IVVVV%H ..VVVG z{{#VVHSM6DTUUUUU Or)F)rF) __doc__r+typingrrrrboolrrr4rrr9s """"""""""11T111Z^11118"tCH~& $sCx. r