LoghatLingo

Inspiration

The inspiration for LoghatLingo stems from a "hidden in plain sight" challenge in Malaysia: The Healthcare Dialect Gap. Many elderly citizens in rural areas (such as Kelantan, Terengganu, or Sarawak) communicate using deep, localized dialects. When they seek medical help in urban centers, terms like "nyo-nyo" (throbbing) or "rasing" (dizzy) are often misunderstood by younger medical professionals. This language barrier doesn't just cause discomfort it leads to medical misdiagnosis. We wanted to ensure that cultural identity is never a barrier to quality healthcare.

What it does

LoghatLingo is an AI-powered cultural bridge that empowers inclusive healthcare through three core pillars:

Dialect-to-Medical Translation: Converts deep Malaysian dialects into formal medical terminology in both Bahasa Melayu and English.

Jawi & Script OCR: Utilizes Gemini Vision to transcribe and romanize handwritten medical notes or traditional prescriptions written in Jawi script, which many younger Malaysians can no longer read.

Doctor’s Empathy Guide: Suggests follow-up questions for doctors in the patient's native dialect, fostering trust and ensuring clinical accuracy.

How we built it

We architected a "High-Impact, Low-Latency" solution using the Google Cloud ecosystem:

Core Intelligence: Leveraged Gemini 3.0 Pro for high-speed multimodal inference (text and image).

Context Engineering: Utilized System Instructions in Google AI Studio to bake in deep Malaysian socio-linguistic knowledge.

Cloud Architecture: Deployed as a containerized application on Google Cloud Run to ensure serverless scalability and regional low latency.

Challenges we ran into

The primary challenge was the lack of formalized datasets for colloquial Malaysian dialects. As a developer, capturing the semantic difference between "Angin" (Gas/Wind) in a general context versus a rural medical context required rapid linguistic research. We overcame this by utilizing Gemini’s Long Context Window to provide the model with extensive cultural grounding through few-shot prompting.

Accomplishments that we're proud of

We successfully built a functional, multimodal prototype in just 2 hours. We are particularly proud of the Jawi-to-Medical feature, which demonstrates how modern AI can preserve and interpret "dying" scripts to solve critical, modern-day problems like healthcare safety.

What we learned

We learned that Multimodal AI is the ultimate tool for Inclusivity. To solve real-world problems in Malaysia, AI must "speak" like the locals. We also experienced the immense efficiency of the Google Cloud-to-Gemini pipeline, allowing us to move from an idea to a globally accessible URL in minutes.

What's next for LoghatLingo

Voice-to-Voice Integration: Enabling a "Walkie-Talkie" mode where elderly patients can simply speak, and the AI speaks back in their dialect.

Edge AI Optimization: Making the model lightweight enough to run in areas with zero internet connectivity.

National Integration: Partnering with the Ministry of Health (KKM) to deploy LoghatLingo as a standard tool in rural "Klinik Kesihatan" across Malaysia.