IEye — Project Story Inspiration
We noticed something simple: many parents and older adults don’t struggle with computers because they lack ability — they struggle because they lack confidence.
They hesitate before clicking anything, afraid they might delete something, send money, or break the device. Current AI tools require users to describe the problem, but confusion itself prevents explanation.
So we asked:
What if AI could just see what the user sees and guide them in real time?
That became IEye.
What We Built
IEye is a screen-aware conversational agent that lets users speak naturally while the system observes their interface and guides them step-by-step.
Instead of explaining the problem to AI, users simply show it.
IEye is also a self-improving agent — it observes user reactions (followed advice, hesitation, repeated questions) and adapts how it communicates: simpler explanations, slower pacing, or shorter responses.
Over time it learns how each person understands technology.
How It Works
Capture screen context and user voice
Understand the task and confusion point
Provide real-time guidance
Adapt communication strategy based on outcomes
Challenges
Understanding relevant UI elements without overwhelming the user
Keeping responses fast enough for real-time guidance
Avoiding excessive interruptions
Personalizing behavior without retraining the model
Why It Matters
Technology today forces humans to adapt to software. IEye makes software explanations adapt to humans.
We started with older adults, but the same need exists for students, employees, and anyone learning new tools.
IEye turns hesitation into confidence.