Inspiration
Millions of people in rural areas of India still don't have internet access. We wanted to build something that could help them using the most common technology they have—a basic phone.
What it does
- A user makes a phone call to the bot.
- The bot asks for the preferred language (Hindi, Telugu, or English).
- The user speaks naturally.
- The bot listens, understands using speech recognition, generates a smart reply using Groq’s LLaMA 3-based LLM, and speaks it back using text-to-speech.
- The bot continues the conversation or restarts if interrupted.
How we built it
- Twilio: Receives and handles voice calls.
- Flask: Hosts the backend server.
- Groq API: Uses LLaMA 3 for fast, smart AI responses.
- Google TTS: Speaks the response back to the user.
- Render: Hosts the Flask server on the cloud.
- GitHub: Version control and collaboration.
- Python: The glue behind it all.
Challenges we ran into
- Avoiding downtime on free cloud platforms.
- Handling speech recognition accuracy.
- Managing multilingual interactions with limited tools.
- Avoiding API key exposure in public repos (we learned the hard way!).
Accomplishments that we're proud of
Built and deployed a real-time multilingual AI voice bot that works over phone calls.
Used Groq + LLaMA 3 for fast, natural conversations.
Overcame issues like API key leakage, server limits, and deployment errors.
Learned and implemented Twilio, Flask, GitHub, Render, and environment management.
Did all this from scratch as a solo creator, while keeping it portable and cloud-ready.
What we learned
How to deploy scalable voice applications.
- Handling real-time AI on phone calls.
- Working with LLMs like LLaMA 3 using Groq API.
- Deploying on Render and managing API keys securely
What's next for NOXSEVA BOT
Add support for more Indian languages (like Tamil, Kannada, etc.)
Integrate custom voice cloning for personalized replies.
Enable offline fallback features using speech synthesis and local ML.
Improve speech recognition accuracy with domain-specific tuning.
Launch public version with an Indian number so everyone can call and try.
📞 Note for Judges: If you'd like to test the voice bot yourself, feel free to message me for the Twilio phone number. I'm happy to share it upon request for judging purposes.
Log in or sign up for Devpost to join the conversation.