Inspiration

Medical reports are often difficult for ordinary people to understand. They contain technical terminology, numerical values, and reference ranges that can leave patients confused or anxious. We wanted to build something that helps bridge the gap between medical information and everyday understanding.

That idea inspired ARTH AI (AI Report Translator for Health) — a student-built application designed to make medical reports easier to understand through AI-powered explanations and an interactive question-and-answer experience.

What it does

ARTH AI helps users understand the information presented in their medical reports through two core experiences:

  • Report Analysis: Upload a supported medical report in PDF, PNG, or JPEG format to receive an AI-generated explanation.
  • Understand Report Values: Present extracted report values and explanations, including reference ranges when available.
  • Ask ARTH: Ask health-related questions or clarify medical terminology through an interactive conversational interface.
  • Multilingual Support: Generate explanations in multiple languages, helping make medical information more accessible.
  • Safety First: Clearly communicates that AI-generated explanations are educational, may be inaccurate, and should not replace advice from qualified healthcare professionals.

Our goal is to make medical information more approachable without replacing medical expertise.

How we built it

ARTH AI uses a web-based architecture with a frontend, backend API, and hosted AI provider.

  • Frontend: Next.js and React provide the user interface for the home page, report analysis, and Ask ARTH.
  • Backend: Python and FastAPI handle API requests, report processing, and communication with the AI provider.
  • Document Processing: PyPDF supports PDF text extraction, while the frontend includes Tesseract.js for OCR-related functionality.
  • AI Integration: The backend uses the OpenAI Python SDK with an OpenRouter-compatible API to generate explanations and conversational responses.
  • Configuration: Environment variables keep API credentials separate from the source code.
  • Developer Experience: A startup script simplifies launching, checking, and stopping the local frontend and backend services.

We focused on creating a practical, modular application that can be extended with better report extraction, validation, accessibility, and privacy controls.

Challenges we ran into

One of the key challenges was making complex medical information easier to understand without losing important context. Medical reports can contain technical terms, numerical results, different reference ranges, and information that requires professional interpretation.

We also had to bring together document processing, a web interface, backend API handling, and AI-provider configuration into a usable end-to-end application.

Another important challenge was responsible AI usage. An explanation that sounds confident is not necessarily correct, especially in a healthcare context. We therefore emphasized clear safety messaging, professional medical review, and avoiding claims that the application can diagnose conditions or prescribe treatment.

Accomplishments that we're proud of

We are proud to have built an end-to-end AI application that combines medical report analysis with an interactive question-and-answer experience.

Our key accomplishments include:

  • Building a web interface with dedicated report-analysis and Ask ARTH experiences.
  • Integrating a Python backend with a hosted AI provider.
  • Supporting PDF and image-based report uploads in the application design.
  • Incorporating multilingual instructions to make explanations more accessible.
  • Adding medical-safety messaging throughout the user experience.
  • Publishing the project as an open, publicly accessible GitHub repository for review and future development.

Most importantly, we turned an everyday problem—understanding medical reports—into a working student project with a clear purpose and opportunities for meaningful improvement.

What we learned

Building ARTH AI helped us understand how multiple components must work together to create a useful AI application. We gained practical experience integrating a modern web frontend, a Python API backend, document processing, and an external AI service.

We also learned that building an AI application involves more than connecting a model to an interface. Input quality, extraction accuracy, prompt design, error handling, configuration management, privacy, and user trust all matter.

Healthcare-related applications require particular care: AI should help people understand information, communicate uncertainty, and encourage appropriate professional guidance rather than replace clinical judgment.

What's next for ARTH AI?

Our next goal is to make ARTH AI more reliable, accessible, and useful.

Planned improvements include:

  • Improving extraction and validation of medical report values.
  • Handling missing, ambiguous, unreadable, or poorly formatted information more gracefully.
  • Enhancing explanations of reference ranges and medical terminology.
  • Expanding language and accessibility options.
  • Strengthening automated testing, error handling, and privacy protections.
  • Evaluating AI-generated explanations for accuracy, consistency, and safety.
  • Improving deployment documentation and making the application easier to set up.

Our long-term vision is to make ARTH AI a trusted educational companion that helps people ask better questions about their medical reports and have more informed conversations with healthcare professionals. ARTH AI will remain a support tool—not a substitute for qualified medical care.

Built With

Share this project:

Updates

posted an update —

ARTH AI – From Medical Reports to Meaningful Insights

We are making progress on ARTH AI, an AI-powered healthcare assistant designed to make medical reports easier for everyone to understand.

Medical reports often contain complex terminology, numerical values and clinical observations that can be difficult for patients to interpret. ARTH AI aims to bridge this gap using Generative AI.

What's new?

We've implemented and demonstrated several key capabilities:

  • Medical Report Upload: Upload medical reports in PDF and image formats.
  • Text Extraction: Extract report content for AI-powered processing.
  • AI-Powered Analysis: Integrated NVIDIA Nemotron to analyse extracted medical information and generate understandable explanations.
  • Simplified Summaries: Translate complex medical findings into more accessible language.
  • Voice Narration: Listen to the complete report summary instead of having to read through lengthy medical documents.
  • Ask ARTH: Explore medical findings through follow-up questions.

Technology behind ARTH AI

  • Next.js and Python FastAPI
  • NVIDIA Nemotron 3 Ultra
  • OCR and document processing
  • Browser-based speech synthesis

What's next?

We plan to improve the user experience, strengthen the accuracy and reliability of report interpretation, and explore more conversational healthcare assistance capabilities.

Our goal is simple: Make medical information easier to understand, more accessible and less intimidating.

ARTH AI is a work in progress, and this is an exciting milestone in that journey!

ARTH AI is an informational assistant, not a replacement for professional medical advice or diagnosis.

ARTHAI #NVIDIA #Nemotron #GenerativeAI #HealthcareAI #NebiusGlobalAIHackathon

Log in or sign up for Devpost to join the conversation.

Submission history