EmoBot

Inspiration

The EmoBot project is inspired by a combination of the growing awareness of mental health, the potential of technology to make a positive impact, the need for companionship in times of isolation, the importance of empathy in design, personal experiences, and the success of similar projects. It is a project driven by the desire to create a tool that can genuinely improve the emotional well-being of its users.

What it does

In essence, EmoBot acts as a virtual companion and emotional support system, leveraging advanced AI technologies to offer understanding, empathy, and guidance to individuals navigating their emotions.

How we built it

EmoBot combines Gemini API for emotional chat, Faster Whisper API for speech-to-text, and OpenCV for facial expression analysis. Users express emotions to their webcam, which detects facial expressions and converts speech to text. EmoBot's chatbot then provides empathetic responses based on emotions detected, offering real-time emotional support.

Key Features:

Emotional Chat (Gemini API) Speech-to-Text (Faster Whisper API) Facial Expression Recognition (OpenCV) User Interaction:

Express emotions to webcam Facial expressions analyzed Speech converted to text Chatbot provides empathetic responses Benefits:

Accessible and immediate support Confidentiality and privacy Empathetic and tailored responses Future Enhancements:

Multi-language support Improved emotion detection Voice-based responses Personalized recommendations EmoBot: Your Virtual Emotional Support Companion

Challenges we ran into

The speech to text transcription was kind of hard to do, considering the accuracy level and the time it took to convert into text

Accomplishments that we're proud of

We are proud to make it till the very end and strive hard to finish the project

What we learned

We got to learn a lot about speech recognition and facial expression detection

What's next for EmoBot

Emobot if done in a large scale has a lot of potential as today’s youth take a toll on mental health and it needs to be addressed

Built With

• gemini-api
• machine-learning
• opencv
• python
• whisper