IEye — Project Story Inspiration

We noticed something simple: many parents and older adults don’t struggle with computers because they lack ability — they struggle because they lack confidence.

They hesitate before clicking anything, afraid they might delete something, send money, or break the device. Current AI tools require users to describe the problem, but confusion itself prevents explanation.

So we asked:

What if AI could just see what the user sees and guide them in real time?

That became IEye.

What We Built

IEye is a screen-aware conversational agent that lets users speak naturally while the system observes their interface and guides them step-by-step.

Instead of explaining the problem to AI, users simply show it.

IEye is also a self-improving agent — it observes user reactions (followed advice, hesitation, repeated questions) and adapts how it communicates: simpler explanations, slower pacing, or shorter responses.

Over time it learns how each person understands technology.

How It Works

Capture screen context and user voice

Understand the task and confusion point

Provide real-time guidance

Adapt communication strategy based on outcomes

Challenges

Understanding relevant UI elements without overwhelming the user

Keeping responses fast enough for real-time guidance

Avoiding excessive interruptions

Personalizing behavior without retraining the model

Why It Matters

Technology today forces humans to adapt to software. IEye makes software explanations adapt to humans.

We started with older adults, but the same need exists for students, employees, and anyone learning new tools.

IEye turns hesitation into confidence.

Share this project:

Updates

Submission history