Inspiration
Snap Speil was born from the recognition that despite technological advancements, individuals with learning differences or processing disorders still face significant challenges in educational and professional settings. The project aims to level the playing field by providing real-time, discreet assistance for those who struggle with traditional note-taking methods, particularly individuals with auditory processing disorders, dyslexia, or ADHD.
What it does
Snap Speil is an innovative AR-based note-taking assistant that works seamlessly with SnapOS AR Glasses. It listens to lectures, meetings, or conversations and provides real-time support by:
- Transcribing spoken content into text
- Extracting and highlighting important keywords
- Generating concise summaries
- Displaying relevant images for visual context
The system presents this information through a discreet, live textbox in the user's field of vision, allowing them to follow along without interruption or needing clarification.
How we built it
Snap Speil integrates several cutting-edge technologies:
- AR Integration: Utilizing SnapOS AR Glasses for a seamless, hands-free user experience
- Speech Recognition: Implementing advanced audio processing to accurately transcribe spoken content
- Natural Language Processing: Employing AI algorithms to extract key information and generate summaries
- Image Recognition: Incorporating visual aids to enhance understanding of complex concepts
- User Interface Design: Creating an intuitive, non-intrusive AR display for optimal user comfort
Challenges we ran into
While developing Snap Speil, we encountered several challenges:
- Ensuring real-time processing and display of information without lag
- Balancing the amount of information shown to avoid overwhelming the user
- Designing a discreet system that doesn't draw unwanted attention to the user
- Optimizing battery life and processing power for extended use
- Addressing privacy concerns related to audio recording in various settings
Accomplishments that we're proud of
Our team is particularly proud of:
- Creating a tool that significantly enhances accessibility in educational and professional environments
- Developing a discreet, user-friendly interface that integrates seamlessly into daily life
- Successfully implementing real-time processing and display of complex information
- Designing a system that promotes inclusivity and empowers individuals with diverse learning needs
What we learned
Through the development of Snap Speil, we gained valuable insights into:
- The challenges faced by individuals with learning differences and processing disorders
- The potential of AR technology to bridge gaps in accessibility
- The importance of user-centered design in creating assistive technologies
- The complexities of integrating multiple advanced technologies into a single, cohesive system
What's next for Snap Speil
Moving forward, we plan to:
- Expand language support for international users
- Implement customizable features to cater to individual user needs
- Explore partnerships with educational institutions and corporations for wider adoption
- Conduct extensive user testing to refine and improve the system
- Investigate additional applications of the technology in various fields, such as healthcare and professional development
Built With
- lensstudio
- snapchat
Log in or sign up for Devpost to join the conversation.