Personalized Adaptive Learning based on Cognitive Load

Main Screen for Educational Content
CustomVision Training Data
CustomVision Trained Model
Happy Status (Low Cognitive Load)
Tired Status (High Cognitive Load)

Inspiration

Students face ever-increasing challenges in improving information retention rate and learning management. Virtual environments often add in decreasing student performance.

What it does

Our solution uses CustomVision.AI to correlate body language with cognitive load and mental status and to adapt the educational content based on you cognitive load. This automated learning management to increase student performance.

How we built it

We utilized React for the front-end and used YouTube to present the educational videos. The browser polls for the camera through NodeJS and sends the picture to the CustomVision.AI for prediction. The returned results are analyzed and content is changed to adapt to the circumstances.

Challenges we ran into

Accessing camera and sending the correct images to CustomVision.AI.

Accomplishments that we're proud of

The automatic pausing and playing of video based on picture of someone's body language.

What we learned

How to use CustomVision.AI and to access camera. In addition, we learned how to control and manage video content.

What's next for Personalized Adaptive Learning based on Cognitive Load

Improve CustomVision.AI to be able to detect greater range of body language more accurately. Allow greater range of pre-recorded content and adaption settings to accommodate a diverse student groups and situations.