🚀 Inspiration

In a world where seamless communication is essential, we were inspired to break language barriers using cutting-edge AI. With Qualcomm Snapdragon's AI acceleration capabilities, we envisioned an on-device translator that’s fast, reliable, and accessible anywhere—no internet needed.

💡 What it does

Snapdragon AI: Multilingual Translator allows users to translate between English, Japanese, Korean, and Chinese with both text and voice input. Using advanced ONNX models and fallback logic, it ensures accurate and culturally appropriate translations, even for nuanced phrases. All processing is done locally for enhanced speed, privacy, and accessibility.

🛠️ How we built it

We leveraged ONNX models for multilingual translation, optimized with quantization for Snapdragon devices to ensure high performance. Faster-Whisper powers real-time voice transcription, while Streamlit provides an intuitive, multilingual user interface. With parallel processing and memory-efficient pipelines, the system delivers rapid translations while maintaining quality.

⚡ Challenges we ran into

  • Ensuring accurate pivot translations without repetition or artifacts.
  • Optimizing large models to run efficiently on Snapdragon hardware.
  • Creating a user-friendly interface that is both multilingual and intuitive.
  • Implementing fallback mechanisms to maintain reliability across all language pairs.

🏅 Accomplishments that we're proud of

✅ Seamless translations between all four languages, with support for both text and voice.
✅ On-device performance that is fast, secure, and independent of internet access.
✅ Optimized resource usage, with reduced memory consumption and faster inference times.
✅ A polished and multilingual user interface designed for both desktop and mobile Snapdragon devices.

📚 What we learned

  • The importance of optimizing AI models for specific hardware to maximize performance.
  • Balancing accuracy and speed through quantization and efficient memory management.
  • Designing fallback systems that maintain translation quality in challenging cases.
  • The power of teamwork, iteration, and problem-solving under pressure.

🚀 What's next for Snapdragon AI: Multilingual Translator

✨ Expand language support to include more languages while maintaining on-device performance.
✨ Enhance voice input with real-time conversation mode for face-to-face communication.
✨ Integrate cultural tone adjustments to provide more contextually appropriate translations.
✨ Deploy the app on Snapdragon-powered devices globally, empowering users to connect without language barriers.

With Snapdragon AI: Multilingual Translator, we’re not just breaking language barriers—we’re creating a world where communication has no limits. 🌍

Built With

  • m2m100
  • marianmt
  • onnx
  • python
  • streamlit
+ 411 more
Share this project:

Updates