Hawkeye

Inspiration

Our team focuses on real-world problems. One of our own classmates is blind, and we've witnessed firsthand the difficulties he encounters during lectures, particularly when it comes to accessing the information presented on the board.

It's a powerful reminder that innovation isn't just about creating flashy technology; it's about making a tangible impact on people's lives. "Hawkeye" isn't a theoretical concept; it's a practical solution born from a genuine need.

What it does

"Hawkeye" utilizes Adhawk MindLink to provide essential visual information to the blind and visually impaired. Our application offers a wide range of functions:

Text Recognition: "Hawkeye" can read aloud whiteboard text, screens, and all text that our users would not otherwise see.
Object Identification: The application identifies text and objects in the user's environment, providing information about their size, shape, and position.
Answering Questions Hawkeye takes the place of Google for the visually impaired, using pure voice commands to search

How we built it

We built "Hawkeye" by combining state-of-the-art computer vision and natural language processing algorithms with the Adhawk MindLink hardware. The development process involved several key steps:

Data Collection: We used open-source AI models to recognize and describe text and object elements accurately.
Input System: We developed a user-friendly voice input system that can be picked up by anyone.
Testing and Feedback: Extensive testing and consultation with the AdHawk team was conducted to fine-tune the application's performance and usability.

Challenges we ran into

Building "Hawkeye" presented several challenges:

Real-time Processing: We knew that real-time processing of so much data on a wearable device was possible, but did not know how much latency there would be. Fortunately, with many optimizations, we were able to get the processing to acceptable speeds.
Model Accuracy: Ensuring high accuracy in text and object recognition, as well as facial recognition, required continuous refinement of our AI models.
Hardware Compatibility: Adapting our software to work effectively with Adhawk MindLink's hardware posed compatibility challenges that we had to overcome.

Accomplishments that we're proud of

We're immensely proud of what "Hawkeye" represents and the impact it can have on the lives of blind and visually impaired individuals. Our accomplishments include:

Empowerment: Providing a tool that enhances the independence and quality of life for visually impaired individuals. To no longer rely upon transcribers and assistants is something that real
Inclusivity: Breaking down barriers to education and employment, making these opportunities more accessible.
Innovation: Combining cutting-edge technology and AI to create a groundbreaking solution for a pressing societal issue.
User-Centric Design: Prioritizing user feedback and needs throughout the development process to create a genuinely user-friendly application.

What we learned

Throughout the development of "Hawkeye," we learned valuable lessons about the power of technology to transform lives. Key takeaways include:

Empathy: Understanding the daily challenges faced by visually impaired individuals deepened our empathy and commitment to creating inclusive technology.
Technical Skills: We honed our skills in computer vision, natural language processing, and hardware-software integration.
Ethical Considerations: We gained insights into the ethical implications of AI technology, especially in areas like facial recognition.
Collaboration: Effective teamwork and collaboration were instrumental in overcoming challenges and achieving our goals.

What's next for Hawkeye

The journey for "Hawkeye" doesn't end here. In the future, we plan to:

Expand Functionality: We aim to enhance "Hawkeye" by adding new features and capabilities, such as enhanced indoor navigation and support for more languages.
Accessibility: We will continue to improve the user experience, ensuring that "Hawkeye" is accessible to as many people as possible.
Partnerships: Collaborate with organizations and institutions to integrate "Hawkeye" into educational and workplace environments.
Advocacy: Raise awareness about the importance of inclusive technology and advocate for its widespread adoption.
Community Engagement: Foster a supportive user community for sharing experiences, ideas, and feedback to further improve "Hawkeye."

With "Hawkeye," our vision is to create a more inclusive and accessible world, where visual impairment is no longer a barrier to achieving one's dreams and aspirations. Together, we can make this vision a reality.