Social Help

A project aimed to help the underserved and needy to make this world a better place to live

Comment 6

Inspiration

Since my childhood, I had dreams of transforming the social order of world. I want to create a world order in which underserved and poor sections of society can be uplifted at least to a level that they can get basic facilities and opportunities. They must not be deprived of those stuff which gives them opportunity to change the lives of themselves and their families. These include access to information of developments of modern world and how they can use them to uplift themselves and the other most important thing is Education.

Frederick Douglas said, "It is easier to build strong children than to repair broken men." This quote reflects that education is the strongest power for societal healing. So I thought of an idea that could generate an urge and hunger for more knowledge in people that were otherwise living in ignorance by giving them practical knowledge about emergency and health conditions.

Designing and dedicating this app to elderly and blind people became my priority in this project due to my real life incidents of dealing with these people.

I have been visiting old age homes near villages and the underprivileged schools of those villages from an early age. I have seen very closely the pain of those elders and the yearning of those children to study.

I have seen how old people and blind people are dependent on other people even for basic daily tasks and how people even specially appointed for their care do not talk to them with care and empathy, and consider them as daily burdens of job. Those old/blind people don't have access to changes of modern world.

Many times I saw patients dying there just because they didn't knew about symptoms of various diseases and what immediate steps need to be taken at those times of emergency and the staff didn't gave proper attention to them maybe they also lacked proper knowledge.

What it does

# Core Features of my Social Help app:

  • This app is built to work on all platforms to be accessible from everywhere but still specially its designed for mobiles so that anyone with a mobile can access it without any problems.
  • The core features of this web app require Signed in user account to give access to core features. For testing purposes Demo user email id can be used which is written below in this description. Any other email id can also be freely used to sign up in this web app.

🔊 1. Voice-Only Conversational AI Assistant (Data Saver mode) ---> Uses Gemini-1.5 Flash but I would like to use more advanced models to give precise advices when more funds are available. Works without video/avatars to save data, making it perfect for low-internet or rural regions.

🧑‍⚕️ 2. Multiple AI Personas Based on User Needs Each page has a dedicated AI persona tailored to the user's context:

  • Home Page Avatar: Emergency help, guidance in disasters (e.g., fire, flood).
  • Health Page Avatar: Provides basic health advice and checks symptoms.
  • Mental Health Page Avatar: Offers emotional support, listens to concerns, provides suggestions for stress or loneliness.

🦯 3. Accessibility-Focused Design Designed for visually impaired, elderly, or disabled users. No need to read or type — everything works through speech interaction. Large, simple UI with prominent mic button and voice feedback.

🌐 4. Data-Saver Mode App avoids video or avatar rendering in low-data mode. Uses only speech + Gemini API = minimal bandwidth usage. Ideal for rural or poor connectivity areas.

📝 5. Personalization Page Users can enter details about:

  • Health conditions
  • Medications
  • Emergency preferences (Emergency Contacts which can be called instantly using AI in danger situations) This information helps tailor AI responses more accurately and empathetically.

🧠 6. Conversational Memory / Flow AI follows up with thoughtful questions to keep the conversation alive. Makes the interaction feel natural and emotionally supportive.

📍🚨 7. Location based Threat Detection: App can use Location services to give warnings about natural calamities if they are publicly released by authorized authorities.

Credentials to Login in my app

  • Email: socialhelptest6@example.com (Demo id has preset settings for testing but you can create your own account also)
  • Password: 666666
  • If at any point, you find any issues with app please reset the site in your browser and try again.
  • If you want to test email verification mechanism of Supabase in my app please use any other email id on which verification email can be accepted.

How we built it

I decided to make a web based app and not native android/ios app because I wanted that my app can be easily accessed by anyone with any device, not by people of any particular platform. In this way the web app won't occupy any space even, in mobile memory. This was my first project of creating any web based app. Before this I had made only simple website projects using html and javascript but I had never built any such detailed web based app. I only knew java and python in core programming languages. I had never used React so I was little uncomfortable with such big coding but soon I adapted it. When I started using 'Bolt' I was such excited seeing AI building entire website for me on my commands. Each detailing I had decided was getting implemented perfectly. But issues started arising when different internal components of different pages of my web had to be interlinked, there I needed to prompt each logic more clearly and effectively. My millions of tokens of Bolt were used in replacing entire core features when Claude AI integration failed. Actually, I had planned to use Claude AI at backend for voice features of my app but due to some API errors that entire plan failed. Earlier with Claude, I had planned only Tavus avatars in mental therapy section of my app but when I saw Claude integration failing, I quickly switched my entire plan and decided to use Tavus AI avatars in each of 3 pages of Emergency, Health and Mental Therapy. Then few new problems came up, some 2-3 new errors were coming and I used Bolt to resolve them but either those errors were repeating in cyclic order or while resolving them my UI was messing a little. End result of all these errors was that I was left with very few tokens of Bolt so I decided to use ChatGPT to manually review the errors in my code and tried to resolve them using ChatGPT and finally my app was functioning correctly without errors. Bolt helped me a lot in making this entire process easier in comparison to complexities which I had thought before starting. One thing is definite that without Bolt and all the things included in builder pack I could not have made such a successful project with such diverse features.

Challenges we ran into

But then I felt that my app must be something that is accessible easily to everyone and these AI avatars are amazing but they are too resource-intensive, they require high internet bandwidth and high internet data usage, so they weren't easily accessible for people living in villages with poor network connectivity. So, I decided to add a Voice AI assistant that can work even in low network and don't use heavy internet data like video avatars.

I used browser native Web Speech API to use Speech to Text feature to convert user voice into text and then sent it to Gemini API and then again converted Gemini text response into voice for users to hear using Text to Speech feature. This also enabled easy accessibility of this feature to blind people with just a click on big mic button of voice chat directly on home page of my app. With this approach even if there is low network bandwidth, users will have to wait just a bit before getting response, but there will be no case of messy video and audio resulting in miscommunication and calm and proper instructions are very important in case of emergencies.

This all integration of Gemini API became extremely easy for me with the help of Edge Functions of Supabase, accessed using just a prompt on Bolt. I am using Supabase primarily for authentication and database in my project. All user data of medical conditions and medications is stored in Supabase using tables with Row Level Security implemented using RLS policies.

Accomplishments that we're proud of

1) Successfully making this app with its core features properly working is in itself an achievement, as this was my first project of making such full scale website, properly dealing with both frontend and backend.

2) Proper implementation of the innovative idea of making voice assistant that uses lesser internet bandwidth so that people can access that feature even in low network regions.

3) Making a smooth and quick web app that stores user health and medication data and provides responses in emergency situations based on stored data.

What we learned

# Skills Learnt:

--> The most important thing I learned while making this project I learnt the two most important skills:

  1. Time management
  2. Professionalism

I learnt managing quality within time constraints. Focusing for long hours straight on one particular thing was a thing I was weak at, but through this project, my passion for coding, professionalism and to serve humanity I pushed my limits of focus and did a rigorous research about everything I needed for this project. I also understood that while vibe-coding is good but without prior knowledge, making something for launch in market can be very difficult. As although I knew and studied basic coding but still at many places I needed to learn few things/concepts before moving forward. Finally, I would like to say that I enjoyed a lot in this project, learning professionalism of real world.

What's next for Social Help

As soon as I will get more funding for this project I hope to enhance this app and make it more scalable so that it reaches more and more number of people with a more robust approach in dealing real life situations. I also aim to add chat history feature in this app to make it more personalized. I want to integrate more advanced AI features in this app to make it more advanced, reliable and user-friendly. Our mission is to tackle more problems of humanity and together let's make this world a better place for each living being.

Built With

  • bolt
  • chatgpt
  • daily-co
  • daily-js
  • elevenlabs
  • entri
  • google-cloud
  • google-gemini-api
  • lucide-react
  • netlify
  • react
  • react-dom
  • supabase
  • tailwind
  • tavus
  • tavus-api
  • typescript
  • vite
  • web-speech-api
Share this project:

Updates