Inspiration
We have seen people with dyslexia around us, and mentors often face difficulty identifying exactly where these learners struggle. JoyVerse is designed to help mentors assign personalized learning tasks to children. After logging in, children can take quizzes, and while solving them, the system detects their emotions—such as confusion, sadness, or neutrality—through facial expression analysis. This helps mentors understand how the child feels in real-time and provide the right guidance.
What it does
Allows mentors to assign personalized quizzes or learning modules to children. Children log in and attempt the quizzes. Captures real-time facial expressions while children solve tasks using emotion detection. Displays emotional feedback to mentors to identify confusion, frustration, or engagement. Provides actionable insights so mentors can guide children effectively.
How we built it
Frontend: Built using React.js for an interactive UI experience. Backend: Node.js and Express.js for handling API requests, storing user data, and quiz progress. Database: MongoDB to store user profiles, quizzes, and results. AI/ML: Python-based emotion detection model to analyze facial expressions from webcam feed during quizzes. Authentication: JWT-based login system to secure mentor and child accounts. UI/UX Design: Figma prototypes guided the development of a child-friendly and mentor-friendly interface.
Challenges we ran into
Integrating real-time emotion detection with the quiz platform. Ensuring accurate detection under different lighting conditions and facial orientations. Synchronizing the mentor’s dashboard with live emotional feedback from multiple children. Managing secure authentication while keeping the system simple for young users.
What's next for JoyVerse
Add detailed analytics for mentors to track progress over time. Improve emotion detection accuracy with larger datasets and more expressions. Include voice or speech recognition to capture verbal cues. Develop mobile apps so children can access quizzes on tablets or phones. Integrate gamification elements to increase engagement and motivation.
Log in or sign up for Devpost to join the conversation.