Teaching from Heart

welcome to webpage
Go to the Arithmetic section
Login using id and password
Open a book and read
Student Emotion Analysis

Inspiration

“The most important thing that the teachers can do while they are meeting online with the students is to connect with them emotionally” ~Ruxandra Mercea

Learning research indicates that people learn better in the presence of some emotional connection—to the content or to other people. Creating this emotional connection is particularly challenging in the online classroom, where most communication is asynchronous and lacks many of the emotional cues of the face-to-face environment. Teachers with autism can need special aid to recognize the emotions of their students. Similarly, students with autism and expressive introversion need aid to express themselves to the teachers in online classes. Also, women in STEM can be promoted by supporting our girls at the right time when they need help and clarity in these domains to grasp in-depth knowledge straight from elementary-level education.

What it does

This is a website empowered by Computer Vision based Sentiment Analysis to help assess the emotions and psychology of a child, especially when they attempt to solve challenging problems or try to understand advanced concepts. Based on the emotions of the child, if they show signs of under-confidence, irritation or anger, we provide systematic help by detailed analysis over a period of time set by the teacher and sending the detailed report of the student study session to the teacher. This helps the teacher understand the areas where the student was feeling uncomfortable in understanding and using the drill-down reports of the student study sessions the teachers can ensure that the student's learning rate does not fall down.

How we built it

The front end of the web application is built with HTML, CSS and Javascript. The emotion recognition is built using ml5.js face API to do real-time face detection through a webcam. I implement detection rectangle, face landmarks, and displaying emotion estimation. The detailed data analysis report is sent to the teacher on a timely basis(as decided by the teacher) via SMS which is implemented using Twilio SMS API using PHP. In EducateHacks 2023 I added the feature called Al Word Definition for students to get explanation of the terms they find hard to understand using the AI Word Definition API.

Challenges we ran into

The main challenge was to design the education portal for students to make them feel comfortable while studying in front of a camera. Hence, the use of face landmarks plot on the same page made it look fun and so the efforts did prove to be worth it.

Accomplishments that we're proud of

Learning about face-api and integrating it with the education portal was a technically interesting task. This was the first time I used p5.js and did a machine leaning/computer vision task in javascript instead of python. Building this empowering platform to help under-confident students gain their confidence back into STEM in a way that is systematic and fun, along with helping the teachers to better connect with their students is my biggest accomplishment.

What we learned

To never give up when the code is not working, and keep looking for the solution with patience. I also learnt a lot about face-api and twilio SMS API using PHP.