mirror of
https://github.com/mauriceboe/TREK.git
synced 2026-10-22 06:56:35 +00:00
Maurice
4abab7a777
The Anthropic request marked only the instructions and the trip card for the prompt cache, so every step of a turn paid the whole history again. It now also marks the end of the history, which the next step starts from, and the end of what came before the user's question, which every step of the turn sends unchanged, within the four marks a request takes. Every provider now reports how much of the input it read from its cache (Anthropic cache_read_input_tokens, OpenAI cached_tokens), the turn adds it up, and the usage log line says it, so the saving can be measured.