Inspiration

Access to reliable health information should not be limited by language or geography. In many parts of the world, especially in multilingual communities, people face difficulty understanding medical advice due to language barriers or lack of immediate access to doctors. This inspired us to create a Multilingual AI Health Assistant — an intelligent, voice-enabled assistant that can understand and respond to health-related queries in multiple languages, including English, Urdu, and Roman Urdu, with plans to scale globally.

What It Does

The Multilingual AI Health Assistant provides users with:

  • Instant, AI-driven medical guidance for general health-related queries.
  • Voice input support for more natural interaction.
  • Multilingual support to remove language barriers in healthcare.
  • Smart intent detection and conversational flow based on user language.
  • Accurate, prompt responses using advanced LLM APIs (Groq + LLaMA 3).

It can be used for:

  • Symptom checks
  • General health education
  • First-aid advice
  • Preventative care suggestions

How We Built It

  • Backend: Python + Flask
  • Frontend: HTML, CSS, JavaScript (with a custom, responsive UI)
  • AI Integration: Groq API + LLaMA 3 model for multilingual text generation
  • Voice Input: JavaScript-based Speech Recognition
  • Deployment: Local server with ngrok tunneling (mobile-ready)
  • Multilingual NLP: Language detection and response routing logic

All responses are dynamically generated based on user queries in real-time, without hardcoded answers.

Challenges We Ran Into

  • Handling accurate language detection between English, Urdu, and Roman Urdu in noisy environments.
  • Ensuring AI-generated responses remain medically responsible and relevant.
  • Designing a unified experience that works equally well across text, voice, and different languages.
  • Implementing JSON error handling for LLM responses to prevent crashes.
  • Balancing response speed and accuracy in multilingual contexts.

Accomplishments That We're Proud Of

  • Successfully built a fully working multilingual AI chatbot that handles voice and text seamlessly.
  • Integrated Groq + LLaMA 3 to deliver blazing-fast, context-aware responses.
  • Developed a clean, accessible interface with a global user experience in mind.
  • Made health information more inclusive and accessible to non-English speakers.
  • Created a system that can be extended easily to add new languages or medical data sources.

What We Learned

  • How to integrate large language models into real-world applications effectively.
  • Deepened our understanding of multilingual NLP challenges and solutions.
  • Improved in designing modular, scalable codebases for AI applications.
  • Gained experience in error handling for unpredictable AI responses.
  • Learned how to create AI systems with ethical considerations in healthcare.

What's Next for Multilingual AI Health Assistant

We envision this assistant evolving into a global health companion, capable of speaking dozens of languages and accessible from mobile devices worldwide.

Next steps include: Mobile App Development for Android & iOS (React Native) Adding more languages (e.g., Spanish, Arabic, Hindi) Medical Knowledgebase Integration with WHO guidelines Doctor-Verified Triage Layer for improved reliability Community Contribution Portal to improve regional health language support End-to-End Encryption for privacy-focused deployments

We're committed to making AI-powered health guidance inclusive, intelligent, and globally impactful.

Built With

Share this project:

Updates

posted an update

Project Update: Multilingual AI Health Assistant Goes Global

We’re excited to share the latest progress on our project Multilingual AI Health Assistant – an AI-powered healthcare solution that breaks language barriers and provides instant health support across the globe.


New Features Added:

  • Smart Language Detection
    Instantly detects and responds in the user's native language (supports 10+ languages, with more coming soon).
  • Mobile App Integration (in progress)
    We’re actively planning a cross-platform app to bring AI health support right to your fingertips – anytime, anywhere.
  • Voice Interaction Improvements
    Users can now speak health queries in their language and get accurate, real-time responses.
  • Privacy-first Design
    No user data is stored – your health, your control.

Technologies Used:

  • Groq AI for ultra-fast LLM inference
  • Flask for backend integration
  • LangDetect, gTTS, and SpeechRecognition for multilingual input/output
  • Devpost Pandas Hackathon as our creative launchpad

"Building AI tools that serve everyone, regardless of language, is not just a mission — it's a necessity."
Ahmad Gul & Muqadass


What’s Next:

  • Launch on mobile platforms (Android & iOS)
  • Expand language support to underserved regions
  • Collaborate with global health orgs for wider impact

Stay tuned for more updates!
Follow the project for future improvements, feedback, and collaboration opportunities.

Log in or sign up for Devpost to join the conversation.