Effectively use prompt caching on Amazon Bedrock | Amazon Web ServicesAWS Machine Learning Blog Effectively use prompt caching on Amazon Bedrock Prompt caching, now generally available on Amazon Bedrock with Anthropic’s Claude 3.5 Haiku and Claude 3.7 Sonnet, along with Nova Micro, Nova Lite, and Nova Pro models, lowers response latency by up to 85% and reduces costs up to 90% by caching frequently used prompts across multiple API calls. With prompt caching, you can
