Inspiration
Access to reliable health information should not be limited by language or geography. In many parts of the world, especially in multilingual communities, people face difficulty understanding medical advice due to language barriers or lack of immediate access to doctors. This inspired us to create a Multilingual AI Health Assistant — an intelligent, voice-enabled assistant that can understand and respond to health-related queries in multiple languages, including English, Urdu, and Roman Urdu, with plans to scale globally.
What It Does
The Multilingual AI Health Assistant provides users with:
- Instant, AI-driven medical guidance for general health-related queries.
- Voice input support for more natural interaction.
- Multilingual support to remove language barriers in healthcare.
- Smart intent detection and conversational flow based on user language.
- Accurate, prompt responses using advanced LLM APIs (Groq + LLaMA 3).
It can be used for:
- Symptom checks
- General health education
- First-aid advice
- Preventative care suggestions
How We Built It
- Backend: Python + Flask
- Frontend: HTML, CSS, JavaScript (with a custom, responsive UI)
- AI Integration: Groq API + LLaMA 3 model for multilingual text generation
- Voice Input: JavaScript-based Speech Recognition
- Deployment: Local server with ngrok tunneling (mobile-ready)
- Multilingual NLP: Language detection and response routing logic
All responses are dynamically generated based on user queries in real-time, without hardcoded answers.
Challenges We Ran Into
- Handling accurate language detection between English, Urdu, and Roman Urdu in noisy environments.
- Ensuring AI-generated responses remain medically responsible and relevant.
- Designing a unified experience that works equally well across text, voice, and different languages.
- Implementing JSON error handling for LLM responses to prevent crashes.
- Balancing response speed and accuracy in multilingual contexts.
Accomplishments That We're Proud Of
- Successfully built a fully working multilingual AI chatbot that handles voice and text seamlessly.
- Integrated Groq + LLaMA 3 to deliver blazing-fast, context-aware responses.
- Developed a clean, accessible interface with a global user experience in mind.
- Made health information more inclusive and accessible to non-English speakers.
- Created a system that can be extended easily to add new languages or medical data sources.
What We Learned
- How to integrate large language models into real-world applications effectively.
- Deepened our understanding of multilingual NLP challenges and solutions.
- Improved in designing modular, scalable codebases for AI applications.
- Gained experience in error handling for unpredictable AI responses.
- Learned how to create AI systems with ethical considerations in healthcare.
What's Next for Multilingual AI Health Assistant
We envision this assistant evolving into a global health companion, capable of speaking dozens of languages and accessible from mobile devices worldwide.
Next steps include: Mobile App Development for Android & iOS (React Native) Adding more languages (e.g., Spanish, Arabic, Hindi) Medical Knowledgebase Integration with WHO guidelines Doctor-Verified Triage Layer for improved reliability Community Contribution Portal to improve regional health language support End-to-End Encryption for privacy-focused deployments
We're committed to making AI-powered health guidance inclusive, intelligent, and globally impactful.
Log in or sign up for Devpost to join the conversation.