Evaluating AI Agents: A Production Template with Strands and AgentCore from AWS and Motorway
Motorway, a British online car marketplace, together with AWS, developed an AI agent evaluation pipeline for searching cars from dealers. The solution reduced incorrect results from 1 in 8 to 1 in 50 queries and cut problem identification time from several hours to a few minutes. At its core is a two-phase evaluation strategy using Strands Agents SDK and Amazon Bedrock AgentCore.
Amazon/AWS
Amazon Web Services
Anthropic
AWS ML blog23.07 · 23:49