Inspiration
Inspired by Sunny Yang and Jerry Zhou's experience teaching primary school children geometry at a tuition centre.
What it does
Allows parents, students and teachers to take a screenshot of a question, upload it and makes all the shapes interactable.
How we built it
Using openCV to detect the shapes and generate new images/objects which can be interacted with. Using react native to create the frontend. Using express.js to store the files that we upload and pull from.
Challenges we ran into
One challenge in particular was storing the images and then uploading it again to be usable in the frontend.
Accomplishments that we're proud of
Using openCV to cleanly detect and mask out each shape then make their background transparent.
What we learned
How openCV can be used to detect and generate new images/crop out background. The requirement of a backend to store and retrieve images. Mobile app design and using xCode and ios simulator to aid with development.
What's next for ShapeQuest
We want to implement some more features. Currently we want to add in a reflection feature as it is simple and useful. We would also like to make the app a bit more seamless and polished.
In the far far future we would also like ShapeQuest to potentially be able to work with 3D shapes like nets, breaking apart a 3D shape to see what is inside.
Log in or sign up for Devpost to join the conversation.