AWS Builder Center
My Eyes in the Kitchen: AI-Powered Visual Autonomy for Cooking 👁️🍳

My Eyes in the Kitchen: AI-Powered Visual Autonomy for Cooking 👁️🍳

The kitchen is the heart of the home, but for individuals who are blind or have low vision, it can also present significant daily challenges, navigation barriers, and safety risks. Traditional cooking apps and smart kitchen tools rely heavily on complex visual interfaces, buttons, and text screens, which fail to provide true accessibility. ​How can we bridge this gap using generative AI and modern agentic architectures?

Series: Inclusive (1 article)

  1. 1
    My Eyes in the Kitchen: AI-Powered Visual Autonomy for Cooking 👁️🍳 This article
​The Solution:
Mis Ojos in the Kitchen ​"My Eyes in the Kitchen" is a voice-first, hands-free assistant built for the Agents for Humans Hackathon using the AWS Strands Agents SDK. Designed specifically for visually impaired users, the application eliminates screen dependency by turning the device's camera and voice into a seamless audio-visual guide.
​Key Capabilities ​Real-Time Visual Recognition: The user points the device camera at the kitchen counter or ingredients. The vision agent processes the feed to identify items (such as vegetables, spices, or packages) and reads them aloud.
​Intelligent Recipe Generator ("What Can I Cook Today?"): Based on the ingredients detected in real-time, the AI agent instantly suggests tailored recipes that the user can prepare right away.
​Favorite Recipes Memory: Stores frequent or preferred dishes, allowing users to recall and initiate their trusted recipes instantly via simple voice commands.
​Step-by-Step Audio Guidance: Acts as a patient, hands-free cooking companion, guiding the user sequentially through each step with natural speech and clear audio pacing.
​Architecture & Tech Stack ​The system is built on a cooperative multi-agent workflow using:
​AWS Strands Agents SDK for orchestrating agent interactions.
​Computer Vision and Generative AI models for item detection and recipe generation. ​Text-to-Speech / Speech-to-Text interfaces to ensure a friction-free, voice-first experience.
​By combining practical utility with empathetic design, My Eyes in the Kitchen proves how autonomous agents can empower individuals and foster true digital and physical inclusion.
​#AgentsforHumans #Accessibility #AWS #AI #uruguay

Series: Inclusive (1 article)

  1. 1
    My Eyes in the Kitchen: AI-Powered Visual Autonomy for Cooking 👁️🍳 This article
Any opinions in this article are those of the individual author and may not reflect the opinions of AWS.
Enjoyed reading this content? Let the author know!

Your likes, comments, shares, and saves help creators reach more builders.

Loading recommendations

Loading article