Inspiration

  • Being Neurodivergent Myself as I have ADHD, there are many times in my life when I can't bring my personal issues with anyone maybe because I don't know how to word them or I don't feel open or comfortable enough to share with people.
  • My inspiration to develop Mally was to make a platform for people who go through the same stuff, when they're anxious at 2AM and have no one to express their thoughts to.

What it does

  • Mally is an AI powered mental help friend that you can use to chat and express your feelings.
  • It basically acts as a helping friend that hears you out, asks you why you feel a certain way and tries its best to comfort you.
  • It also contains a breathing section where the user can do breathing exercises to relax them.
  • Moreover, it contains an emotional calendar where you can choose how you feel each day and assess your mood over a period of time to see how the application impacts your mood.

How I built it

  • I built Mally using React for the frontend.
  • I used FastAPI in the backend.
  • I also used the ElevenLabs API to generate the AI voice.

Challenges we ran into

  • There were multiple challenges I ran into including things such as ElevenLabs not accepting audio inputs from my browser.
  • Choosing the right models to make sure the conversation mimics real-time conversation as much as possible.
  • Complex WebSocket code.
  • Many more issues along the way.

Accomplishments that I'm proud of

  • I'm genuinely proud of everything I've done at this hackathon.
  • Developing all the components of Mally.
  • Meeting new people.
  • Looking at new projects and gaining insight from them.

What we learned

  • I learned how to incorporate external APIs.
  • I learned socket programming.
  • I learned how LLMs and other AI programming interfaces take audio input.
  • I also learned how to incorporate different external frontend components to make my application user friendly.

What's next for Mally : Your AI - Mental Ally

  • I really want to take this project further into production by making this accessible to the public, most likely on a cheap subscription basis as it will cost some money to keep this website up and running.
  • I would also like to add more features such as a meditation section, where a user can meditate.
  • Preferably make this into an actual realtime AI voice chat using live sockets and the realtime OpenAI API. (I would've done it already if it wasn't this expensive...)

Built With

Share this project:

Updates