AWS CB Spotlight 5 Timers Club-Mary Becken
Congratulations to Mary Becken on joining the 5 timers club!
Series: AWS Community Builders Spotlight-5 Timers Club (38 articles)
- …
- 25AWS CB Spotlight 5 Timers Club-Mary Becken This article
Congratulations Mary Becken !
Welcome to the Club Mary! Mary Becken walks through the full lifecycle of production-grade agentic AI on AgentCore, from distributed tracing and quality evaluation through architecture tradeoffs and cost-optimized routing to automated compliance assessment against 200+ regulatory frameworks. On their fictional plaque it reads:
Mary published five articles and each one builds directly on the last. She started by wiring OpenTelemetry into a multi-agent AgentCore system to trace inter-agent communication and flag security anomalies like prompt injection and unauthorized agent calls. From there she added a Critic agent that scores response quality in real time and triggers retries when answers fall short, then ran AgentCore's built-in evaluators (Helpfulness, GoalSuccessRate, ToolSelectionAccuracy) against the same workflow. That evaluation work exposed a real architectural problem: multi-runtime deployments give each agent its own session ID, which breaks span-based evals. She documented the tradeoffs between "tribbles" (separate runtimes) and "hive mind" (single runtime) and shipped a workaround that unifies spans by trace ID.
The last two articles shift from building agents to governing them. Her LLM Router uses AgentCore Gateway to route prompts to the cheapest model that meets a quality floor, with DynamoDB-backed routing policies, AppConfig kill switches, and transparency APIs that map to ISO 42001 controls for explainability and human oversight. She then applied that same compliance mindset to the Secure Controls Framework, building an agent that ingests all 1,534 SCF controls into S3 Vectors and DynamoDB, performs gap analysis and maturity assessments against frameworks like HIPAA and NIS2, and auto-updates when SCF publishes new versions. Taken together, the five pieces trace a clear path: instrument your agents, evaluate their output, understand the architecture constraints, optimize cost and routing, then prove compliance.
Read Mary's first five entries here:
Series: AWS Community Builders Spotlight-5 Timers Club (38 articles)
- …
- 25AWS CB Spotlight 5 Timers Club-Mary Becken This article
Enjoyed reading this content? Let the author know!
Your likes, comments, shares, and saves help creators reach more builders.
Loading recommendations
Loading article