Inspiration
OSAI β Active Accessibility Assistant
OSAI is an active accessibility assistant designed to operate at the system level, providing real-time support by interacting directly with accessibility services and device capabilities.
Rather than offering passive guidance, OSAI actively assists users by executing actions, adapting interaction flows, and reducing accessibility barriers as they occurs.
π§ What is OSAI?
OSAI is an operational accessibility agent.
It leverages system-level accessibility APIs to:
- Observe user interaction context
- Detect accessibility friction
- Perform assistive actions on behalf of the user
- Adapt interfaces and flows dynamically
The project reframes accessibility from a static feature into an active operational layer.
π‘ Inspiration
Most accessibility tools assume users can continuously issue commands, follow instructions, or adapt to predefined interaction models.
In reality, this creates cognitive overload and excludes users who need continuous, adaptive assistance.
OSAI was inspired by the gap between accessibility guidelines and real-world usability. The goal was to explore how accessibility could move from explanation to execution, using system-level capabilities to actively reduce friction instead of merely describing solutions.
π― Problem Statement
Traditional accessibility solutions are:
- Passive and instruction-based
- Highly dependent on user effort
- Limited to predefined flows
This results in repetitive interactions, increased cognitive load, and reduced autonomy for users with accessibility needs.
π Solution
OSAI introduces an active assistance model:
- System-aware via accessibility services
- Context-driven rather than command-driven
- Action-oriented instead of recommendation-based
- Designed to operate continuously and adaptively
The assistant works on behalf of the user, within explicit and controlled accessibility permissions.
π What Makes OSAI Different?
Most accessibility tools guide users.
OSAI acts for users.
Key differentiators:
- System-level operation through accessibility APIs
- Real-time execution of assistive actions
- Reduced dependency on precise user input
- Architecture prepared for AI-driven decision layers
Accessibility is treated as an operational process, not a checklist.
π₯ Who Is It For?
OSAI is designed for:
- Users with motor, visual, or cognitive accessibility needs
- Scenarios with high interaction complexity
- Environments where accessibility must be continuous and adaptive
The architecture supports multiple accessibility profiles and use cases.
π Impact
OSAI reduces interaction friction and cognitive load while increasing user autonomy.
Its impact lies in transforming accessibility into a living, adaptive system that adjusts to users, instead of forcing users to adapt to technology.
π£οΈ Whatβs Next?
Planned next steps include:
- Expanding assistive action modules
- Improving context detection
- Introducing AI-based decision layers
- Enhancing transparency and user control
The long-term vision is to evolve OSAI into a scalable accessibility platform.
π Privacy & Control
- Operates only within user-granted accessibility permissions
- No hidden background behavior
- Designed with transparency as a core principle
β¨ Vision
Accessibility should not require adaptation from users.
Accessibility should adapt to users.
OSAI exists to operationalize this principle.
Built With
- gemini3
- github
- javascript

Log in or sign up for Devpost to join the conversation.