TOTO

What it does

We're building a revolutionary learning system for students on the spectrum. We created a friendly, interactive learning system that is able use specialized techniques to break down content into bite-sized steps and tasks, delivered conversationally with high emotional intelligence (powered by Hume.ai). A built-in reward system like our matching game keeps them engaged and motivate. Our tool is designed to make our project the go-to online tool that special education students can take advantage of.

How we built it

For the idea stage, as we are one of the first attempting to create a artificial intelligence model that students on the spectrum to learn from, it required lots of understanding on how we would approach our teaching. Through the event, we were able to connect with a behavioral technician where we asked about how they teach students on the spectrum. We learnt that it greatly depends on the student, however we decided to narrow our model in a way where we teach in small bite-tasks and using reward systems.

We built this primary using Next.js, React, Figma, tailwind css, gpt4o.

Challenges we ran into

We wanted to include Hume.ai expression measurement api with the empathic api however we had a bit difficult navigating both api's when trying to combine both technologies together.

In addition, we originally tried to work with the empathic api with streamlit, however we had soon decided to transition to next.js to build as it became a bit more easier.

Accomplishments that we're proud of

We are proud of integrating Hume into our own product.

What we learned

We learned about using Hume api, and on formatting with stream lit.

What's next for TOTO

Our next goal is being able to integrate the expression measurement model api, so our tool can view the students expression such as face confusion, and be able to follow up on that.

Built With

• figma
• gpt4o
• hume.ai
• next.js
• react
• tailwind