Persona

Inspiration

Current problems with chat apps:

Sending voice messages may not always be convenient. Text messages remain the main form of online communication today.
Texts lack the ability to effectively capture the depth and nuances of communication.
Visually impaired individuals are unable to read text messages. Text readers read these messages in a monotone manner, not delivering an accurate representation of the message.
My mother recently reached the age where she requires reading glasses every time she opens WhatsApp. She will be the first to benefit from this app

This notification app solves these problems by adding the human element to text messages. The text messages sent by your mother (for e.g.) can be heard in your mother's voice.

Why Persona?

The visually impaired will finally feel empowered and included in individual and group chats.
Prevents miscommunication.
Provide a much more personalised experience to mundane text messaging.

What it does

How we built it

Text Notification to Voice (TNV) server

Audio processing is done on our own flask server
We used ElevenLabs multilingual model v2 to carry out instant voice cloning. ### Persona App
For any person in your current contacts, save their voice same (< 30s) in our app.
Listens to text notifications
Post text and voice of sender to our TNV server
Reads back response (mp3) which is the received text dubbed by sender. ## Challenges we ran into
Clashes with Supervisions and degree deadlines meant that we needed to be as efficient as possible
Cross platform solutions such as an android app using python framework audio processing meant that we needed to plan out a proper full stack schematic ## Accomplishments that we're proud of
We have produced something that will improve our parent's lives starting today
We have ensured that no private information is retained while using our app ## What we learned
Generative AI, if used in the right circumstances, can improve lives on a global scale ## What's next for Persona ### Features
[x] Text-to-voice notification listener
[x] Saving Contacts
[x ] Multi-language Support
[ ] Use descriptions to support voice cloning
[ ] Add emoji and GIF support