Inspiration
- Being Neurodivergent Myself as I have ADHD, there are many times in my life when I can't bring my personal issues with anyone maybe because I don't know how to word them or I don't feel open or comfortable enough to share with people.
- My inspiration to develop Mally was to make a platform for people who go through the same stuff, when they're anxious at 2AM and have no one to express their thoughts to.
What it does
- Mally is an AI powered mental help friend that you can use to chat and express your feelings.
- It basically acts as a helping friend that hears you out, asks you why you feel a certain way and tries its best to comfort you.
- It also contains a breathing section where the user can do breathing exercises to relax them.
- Moreover, it contains an emotional calendar where you can choose how you feel each day and assess your mood over a period of time to see how the application impacts your mood.
How I built it
- I built Mally using React for the frontend.
- I used FastAPI in the backend.
- I also used the ElevenLabs API to generate the AI voice.
Challenges we ran into
- There were multiple challenges I ran into including things such as ElevenLabs not accepting audio inputs from my browser.
- Choosing the right models to make sure the conversation mimics real-time conversation as much as possible.
- Complex WebSocket code.
- Many more issues along the way.
Accomplishments that I'm proud of
- I'm genuinely proud of everything I've done at this hackathon.
- Developing all the components of Mally.
- Meeting new people.
- Looking at new projects and gaining insight from them.
What we learned
- I learned how to incorporate external APIs.
- I learned socket programming.
- I learned how LLMs and other AI programming interfaces take audio input.
- I also learned how to incorporate different external frontend components to make my application user friendly.
What's next for Mally : Your AI - Mental Ally
- I really want to take this project further into production by making this accessible to the public, most likely on a cheap subscription basis as it will cost some money to keep this website up and running.
- I would also like to add more features such as a meditation section, where a user can meditate.
- Preferably make this into an actual realtime AI voice chat using live sockets and the realtime OpenAI API. (I would've done it already if it wasn't this expensive...)
