Loops

the Loop team!
our glasses!
Rushil with the glasses on
Jacob with glasses on
team hard at work again
the team hard at work
testing out the software!

Inspiration

Our family member Neil, is part of the hearing impaired community. We wanted to make a tool to help hearing impaired people better communicate. From, there we realized that there were numerous other applications for our glasses such as breaking down language barriers.

What it does

So our project is a pair of ar-glasses that has live speech to text transcriptions and live language translation from many different languages. It does this by using an Arduino and a mini Oled display that uses a mirror to display it on the lens. From there we implemented the use of cheap apis to not only get our data, but also make it accessible for all.

How we built it

We used an Arduino, 3d printed housing unit, and hooked it up to an Oled display. From there, we used Python to code functions for live transcription and translations from different languages. From there we realized that our codebase was very user friendly, so any developer can create their own plugins!

Challenges we ran into

Software issues: Issues with Python compatibility, issues with pulling data from APIs, issues with speech recognition and microphone settings Hardware Issues: Issues with displaying the transcription and translation onto the lens, issues with making the glasses comfortable, issues with the mirror reflecting the text onto the lens.

Accomplishments that we're proud of

Software: Creating good functions so that it would be easy to create new features in the future, having a live stream word by word to make it work, successfully debugging after many hours Hardware: Successfully displaying the transcription and translation from the Oled screen onto the lens, custom Arduino housing with 3d modeling and 3d printing.

What we learned

How to debug code better by having a more organized workspace. Also created agents to respond naturally to people in the new world. Worked on communication skill show to design a compact housing unit for a Arduino, Oled screen, and a mirror, learning to connect software and hardware

What's next for Loops

create a developer community so that all developers can create their own plugins, implement a camera and other sensors to get better data for integrating realistic human experiences with technology, make a more compact and comfortable, and fix some usability issues.