We read about a major court case that reached the Supreme Court about a blind person who sued a major pizza chain because their app and website was not accessible. We wanted to fix that problem by creating a app which would be totally controlled by voice, and by eye tracking (in the future).

What it does

Users can use either clicks, taps or their voice to navigate the app and add the appropriate toppings to the pizza. For payment, we use facial recognition to make it easier for customers who need more accessibility.

How we built it

The front end was built with html/css using the bootstrap framework. The back end was built using python. We used flask and Ajax to link the front and back ends. The facial recognition and speech detection features were built using Amazon and Google provided APIs respectively.

Challenges we ran into

We did not know how to connect the web front end to the python back end.

Accomplishments that we're proud of

We successfully levaraged state of the art machine learning models to accomplish our goals.

What we learned

We learned how to use cloud computing services like AWS and GCP. We learned how to connect the front and back ends. We also learnt how eye tracking technology works.

What's next for Hey, Pizza!

We want to finish implementing the eye tracking feature so users can use their eyes just like a mouse. We would also like to expand beyond pizza and a single website and allow full web browsing with only voice or eye tracking. A feature we did not have time to implement was the "Pizza Portfolio", which is a social media spin on ordering pizza. In the pizza portal, users from all across the country can submit pizzas which can be voted on my the public. The top votes get featured on our website!

Share this project: