Inspiration

Empower every person with disability to achieve more.

What it does

We apply the power of Microsoft Generative AI to build solutions to empower persons with disability.

Different challenges faced by persons with different types of disability in various scenarios are addressed by creative use of multimodal AI.

Video showcases the demos of solutions for different challenges faced by different personas.

How we built it

Pure love for humanity - Human centered AI product design (empathy , design thinking, rapid prototyping, Azure Gen AI )

Challenges we ran into

understanding the real pain point of end-users required lot of empathy and immersive visits

Accomplishments that we're proud of

1. That we will win this hackathon to get an opportunity to showcase to the broader community the power of responsible use of Microsoft Multimodal Generative AI for a positive impact on the world
2. multimodal apps (Vision, Text, Speech) and multimodal embeddings can be benefit persons with disability in many ways

What we learned

GPT4Vision is cooler than we initially guessed. Joint learning of Vision and Language (microsoft/git-large-vqav2) can translate content across modes (vision to text).

Built With

• gpt4vision
• microsoftvisionlanguagepretrainedaimodels