Inspiration
With the rapid growth of AI and messaging platforms like WhatsApp, we observed how easily misinformation, harmful content, and manipulative prompts can spread. We were also inspired by the increasing number of AI jailbreak attempts, where users try to bypass AI safeguards to generate unsafe responses. This highlighted the need for a real-time AI safety layer that can protect users and ensure responsible AI usage. This motivated us to build ChainBreaker-AI, a system designed to detect and stop harmful AI interactions before they spread.
What it does
ChainBreaker-AI is a WhatsApp-based AI safety system that analyzes user messages in real time. It detects:
- Misinformation
- Harmful or toxic content
- Manipulative prompts
- AI jailbreak attempts
Once analyzed, the system classifies messages as:
- ✅ Safe
- ⚠️ Warning
- ❌ Blocked
It then sends an appropriate response back to the user, ensuring safe and trustworthy AI conversations.
How we built it
We built ChainBreaker-AI using a multi-layer architecture:
- Frontend: React-based interface for testing and monitoring
- Backend: Node.js / Python API for handling requests
- AI Layer: NLP-based analysis for detecting harmful content
- Integration: WhatsApp API for real-time message handling
- Deployment: Cloud hosting for real-time accessibility
Workflow:
User → WhatsApp → Backend → AI Analysis → Decision Engine → Response
This modular design allows scalability and future expansion.
Challenges we ran into
- Integrating WhatsApp APIs and handling webhook responses
- Detecting jailbreak prompts effectively
- Managing deployment issues between frontend and backend
- Ensuring real-time response speed
- Handling different types of harmful content accurately
These challenges helped us refine the architecture and improve system performance.
Accomplishments that we're proud of
- Built a real-time WhatsApp AI safety system
- Successfully implemented jailbreak detection
- Designed a scalable architecture
- Created a user-friendly interface
- Developed a responsible AI safety solution
## What we learned - Full-stack AI application development
- WhatsApp API integration
- NLP-based content classification
- Deployment and API management
- Importance of AI safety and responsible AI development
This project helped us understand how AI safety systems are becoming critical in modern applications.
What's next for Chainbreaker-AI
- Browser extension integration
- Enterprise-level AI safety solutions
- Real-time analytics dashboard
ChainBreaker-AI aims to become a comprehensive AI safety layer for multiple platforms, ensuring safe and responsible AI usage.
Built With
- express.js
- fastapi
- javascript
- node.js
- openai-api
- python
- react
- render
- rest-apis
- tailwind-css
- twilio
- vercel
- whatsapp-cloud-api
Log in or sign up for Devpost to join the conversation.