Inspiration:
ChatTeach.io was inspired by the need for a more personalized and interactive learning experience. As college students, something we have all faced is the dreaded two-hour lecture video, where it is quite literally impossible to pay attention completely and to not get distracted. This oftentimes leads to important content in the video being missed, and a usually unhappy student. We saw a gap in the market for a system that could provide customized content to each individual user and offer them the opportunity to learn from virtual teachers that look and talk like humans, making the learning process more engaging and fun.
What it Does:
ChatTeach.io is an online learning platform that uses advanced AI technologies such as GPT and deepfake to provide a more personalized and interactive learning experience for users. Users can input their questions and receive responses in natural language from virtual teachers that are created using deepfake technology. Imagine having Spiderman teaching you physics or Zendaya teaching you differential equations. In this way, students are less likely to get bored and are more inclined to pay attention to the video.
Accomplishments That We’re Proud Of:
We use advanced AI technologies like GPT and deepfake to create a personalized and engaging learning experience. Our speech-to-text and text-to-speech conversions enable natural conversations between users and virtual teachers. This approach benefits both children, who can learn from their favorite superhero, and college students, who can make long lectures more interesting. We are proud of our technology and the positive impact it can have on learners of all ages.
What We Learned:
We learned about the potential of AI in education and the importance of accurate speech-to-text and text-to-speech conversion. We also learned to integrate APIs and collaborate efficiently. Our experience gave us a deeper appreciation for AI's capabilities and the power of teamwork in bringing innovative ideas to work.
How We Built It:
Our project involved several steps. Firstly, we integrated a speech-to-text API that transcribed the user's voice input into text. Then, we implemented ChatGPT to generate a relevant response to the user's question based on the script. Finally, we utilized a text-to-speech API to convert the text output into verbal speech. Our ultimate goal was to provide users with the ability to choose the voice and appearance of the virtual teacher in the video, allowing for a more personalized and engaging learning experience.
Challenges We Ran Into:
Challenges we faced when building this project were uploading a visual character onto the video screen (we were not able to implement this due to the constrained time period, but plan to in the future). We also ran into issues with choosing which API to use as many of them only worked on Windows computers, and all four members of our team have Macbooks.
What is Next for Chat Teach:
We envision expanding our project to offer users the ability to input custom audio and character selections, providing even greater personalization to the learning experience. For instance, Spiderman could teach physics with Whitney Houston's voice. Additionally, our AI-generated content has the potential to not only deliver pre-existing information but also to tailor content to each user's needs.
By taking a simple quiz, a student watching an AP Calculus review video can indicate which chapters they already know, and the AI will generate a custom video without those sections. Our platform can also be used to conduct mock interviews by generating a random person for users to ask questions to.
Overall, our aim is to offer a highly customizable and interactive learning tool with a wide range of potential applications. We hope that ChatTeach can be used to make learning more fun and engaging for students worldwide.
Built With
- chatgpt
- google-web-speech-api
- javascript
- python
- pytorch
- speechtoanimation
- wav2lip

Log in or sign up for Devpost to join the conversation.