Inspiration

We wanted to help people who are older and hard of sight who are not used to using computers and search engines be able to search the internet for answers to their questions.

What it does

Parse is a Speech to Text assistant which can record your questions and automatically search popular websites like Google, Bing, and Wikipedia. It can also open your favorite websites like Facebook, Twitter, and Reddit. Another feature is that Parse can recognize what you are holding so that you will be able to search it up easier.

How we built it

We started by building an interface based off of a futuristic, minimalistic look. We then wanted to brainstorm things it wanted to do. We wanted it to be able to search on google for you, without the need for typing long sentences and open your favorite websites. It can also open some default application on your computer like the calculator.

Challenges we ran into

A challenge we ran into was implementing WebKit Speech Recognition as we had no prior experience with it. We had to read a lot of Mozilla’s Documentation to understand and use it. Another problem we had was implementing a live video feed through OpenCV. While our camera feed is functional, it is quite choppy due to Python restrictions.

Accomplishments that we're proud of

We are proud of being able to learn and use Mozilla's WebKit Speech Recognition within 10 hours. We are also proud of being able to create a image recognition software with no prior knowledge.

What we learned

We learnt basic understanding of Mozilla’s WebKit Speech Recognition library, OpenCV video live feed, python, and GitHub publishing on their repository.

What's next for Parse

For the future, Parse will attempt to be able to recognize major landmarks or more specific items such as different types of trees using its image recognition feature. We will also try to enable keyboard presses to activate functions so that visibly impaired people will not have to search for the activation button. Finally, we would like to make it so that the top Google or Wikipedia search will be read out loud to the user.

Share this project:

Updates