• 

  Landing page

• 

  Application

• 

  Implementation - with Translation, Chat Interaction and Fact Check

About the Project

Inspiration

With the rise of global content consumption, language barriers limit access to valuable videos. We wanted to build a seamless AI-powered solution that translates and dubs videos into multiple languages, making content more accessible and engaging worldwide.

What it Does

Our platform allows users to:

• Detect the original language of a video automatically also
• Transcribe spoken content with precise timestamps
  
• Translate the transcript into a selected language
  
• Generate high-quality voiceovers with ElevenLabs AI voices
  
• Sync and embed the new audio back into the original video
  
• Summarize video content and create AI-powered interactive Q&A
  

How We Built It

We used a powerful AI stack integrated with hackathon partner tools:

• ElevenLabs for realistic AI voice dubbing
  Different example- LLMs for transcription, translation, and summarization
  
• Supabase for Auth & Database and enabling AI chatbot queries
  
• OpenAI, Deepseek, and Fal API for optimizing AI workflows
  

Challenges We Ran Into

• Preserving background noise while ensuring clear speech detection
  
• Differentiating multiple speakers accurately
  
• Reducing processing latency for long videos
  
• Ensuring accurate and context-aware translations
  

Accomplishments That We're Proud Of

• High-quality AI dubbing with natural and expressive voices
  
• Seamless video processing with an automated end-to-end pipeline
  
• AI-powered chatbot allowing users to interact with video content in real time
  

What We Learned

• Fine-tuning AI for better accuracy in translation and dubbing
  
• Enhancing the AI chatbot experience with contextual memory
  
• Building a scalable infrastructure for large-scale video processing
  

What's Next for for ViewinNative

• Expanding to more languages and voice styles
  
• Developing real-time dubbing for live streaming
  
• Implementing AI-powered video summaries with key moments and sentiment analysis
  
• Adding integrations with platforms like YouTube and Instagram
  

Built With

• deepseek
• elevenlabs
• falsapi
• gpt
• lovable
• react
• supabase