-
-
LEARN WITH ANYBODY
Inspiration
100% of students struggle with homework at some point in time. But 0% of students get to be tutored by Spongebob.
What it does
Nova is a shapeshifting alien that brings learning to life by turning into your favorite character. She acts as your personal tutor, making homework feel less like a chore and more like a conversation.
How we built it
We built nova.ai with hard work, love, and Python. We used real-time event-based voice listeners through Google's speech recognizer to respond to live user voice-based input. Real-time webcam monitoring paired with a pix2text model allowed for text segmentation, before grouping text into questions using a modified k-nearest neighbors clustering algorithm. The grouped text is then passed question-wise into GPT-4o for it to answer. Customized celebrity voices were created using ElevenLabs API and fed GPT's answers post-reasoning.
Challenges we ran into
We iterated through a few developmental cycles as we initially struggled to settle on our project idea. We were not fully set on our plan until over halfway through the event, but worked tirelessly to finish our design.
Accomplishments that we're proud of
We are proud to have two of our members partake in the Hackathon experience for the first time. We are also proud of our ability to finish a product within a 24 hour time span.
What we learned
We learned and/or strengthened various skills such as collaboration, project development and management, working in separate roles, and general coding ability.
What's next for Nova.ai
For now, we would like to optimize the loading times in which the AI tutor responds. We would also like to improve the overall user experience of the app, and eventually deploy it to the public.
