Prompt caching - Anthropic

Prompt caching is a powerful feature that optimizes your API usage by allowing resuming from specific prefixes in your prompts. This approach significantly reduces processing time and costs for repetitive tasks or prompts with consistent elements. Here’s an example of how to implement prompt caching with the Messages API using a cache_control block: In this example, the entire text of “Pride and P

[kiririmode]

anthropicのprompt caching。システムプロンプトやユーザープロンプトをキャッシュでき、どこまでキャッシュするかの指定も可能。ttl 5 mins. context retrievalやllm as a judgeと相性は良い