Inspiration

This was inspired by the need from several people to translate the Gita into their respective languages. As I started to build it and talk to potential customers, I spotted more needs, the need to translate ancient Sanskrit commentaries, the need to hear the translations, the need to have a dialog, the need to get feedback on the audio recording, the need to create and finally a living spirtiual companion.

What it does

VishwaGita AI is a cutting-edge spiritual explorer designed to make the Bhagavad Gita accessible to a global audience. By leveraging Google's latest Gemini 3 reasoning models and the Multimodal Live API, the application goes beyond simple translation—it acts as a living spiritual companion.

It features Sarthi, a real-time voice guide for conversational wisdom, and Drishti, a multimodal AI doctor that prescribes verses based on your visual environment and emotional state. The interface is designed as an immersive "Digital Manuscript," blending the aesthetic of ancient vellum scriptures with the power of modern generative AI.

Key Features

  • Sarthi Live (New): A real-time, bidirectional voice agent powered by the Gemini Live API. Speak to "Krishna" directly to receive instant, spoken spiritual guidance for your specific life battles. Features a reactive "Chakra" visualizer.
  • Drishti Doctor (New): A multimodal diagnostic tool. Upload a photo of your environment, record a voice note, or type your symptoms. The AI diagnoses your dominant Guna (Sattva/Rajas/Tamas) and prescribes specific Gita verses and lifestyle protocols as remedies.
  • Mantra Coach: A real-time pronunciation analyzer that listens to your recitation, detects pitch accuracy (Svara), and provides granular feedback on diction.
  • Interactive Sanskrit Karaoke: Experience the scripture with word-by-word synchronized highlighting during audio playback. Includes variable playback speeds (0.5x - 1.5x) to aid pronunciation practice.
  • AI-Powered Spiritual Translation: Generates context-aware, reverent translations in over 20 languages (including Hindi, Kannada, Tamil, Spanish, French, and Japanese).
  • Chapter Synopsis & Visualization: Instantly generates comprehensive chapter summaries and vivid 6-panel comic strips narrating specific events using Gemini 3 Flash (Reasoning) and Gemini 3 Pro Image (High-Fidelity Visuals).
  • Deep Sanskrit Analysis:
    • Anvaya (Prose Order): Rearranges the poetic Sanskrit meter into logical prose syntax (Subject-Object-Verb).
    • Padartha (Word Meanings): Breaks down the verse into individual words with precise English definitions.
  • Scholarly Archives: Connects to external databases to provide traditional commentaries (Bhashya) and analyzes them using AI to provide English summaries of complex Sanskrit arguments.
  • Visual Meditation: Generates atmospheric, symbol-rich imagery based on the verse's meaning to aid in contemplation.
  • Social Content Studio: Auto-generates drafts for Substack, LinkedIn, and Twitter based on the verse's philosophy.
  • Modern Life Application: Converts ancient wisdom into 3 actionable steps for the modern professional.

How we built it

This was entirely built in Gemini Studio, in an interactive dialog.

Tech Stack

  • Frontend: React 19, TypeScript
  • Styling: Tailwind CSS
  • Audio: Web Audio API (ScriptProcessor & AudioWorklet for real-time PCM processing)
  • AI SDK: Google GenAI SDK (@google/genai)
  • State Management: React Context & LocalStorage Caching

Challenges we ran into

We faced numerous challenges. The first was the translation to languages was not accurate. Tightening the prompts significantly helped. The next was the accent for the audio. It was hard to change/control that.

Accomplishments that we're proud of

Over 10 users have used the Gita Mantra Coach and gotten feedback

What we learned

You can go from an idea to an quick working implementation in very little time with Google AI Studio. Also the Gemini capabilities are very easy to access through the Google AI Studio.

What's next for VishwaGita.AI

Built With

Share this project:

Updates