Oratix

Inspiration

Our project was inspired by the need to automate complex customer service tasks, especially in finance, like loan transactions. We saw an opportunity to combine AI, such as OpenAI's Real-time API to streamline customer interactions. By automating routine inquiries and intelligently routing customers, we aim to improve efficiency and enhance the overall customer experience.

What it does (Planned Features)

AI-Powered Speech-to-Text and Text-to-Speech Interactions: Aims to allow customers to interact naturally using voice queries, processed in real-time using AI-driven responses.
Omnichannel Support: Plans to integrate multiple customer service channels including web-based voice chat, text chat, and potentially email and social media into a single platform.
Efficient Query Routing: Designed to automatically route customer queries to the appropriate AI workflow or human agent based on complexity and urgency.
Human Agent Escalation: Intended to seamlessly escalate queries to human agents when AI responses are insufficient, ensuring personalized support for complex issues.
Real-Time Analytics and Insights: Aims to provide real-time insights into agent performance, response times, and resolution rates through a customizable analytics dashboard.

How we built it

The project was built using Next.js as the framework, with plans to integrate OpenAI's API for AI-powered interactions. We implemented WebSocket functionality for real-time communication, and used Tailwind CSS and ShadCN for styling the user interface.2

Challenges we ran into

Regulatory Hurdles: We faced challenges with Indian voice and call regulations, which forced us to reconsider our initial plan of using a Twilio-based phone system.
Real-time Audio Processing: Implementing real-time audio processing and integrating it with the OpenAI API presented significant technical challenges that we're still working to overcome.
WebSocket Management: Ensuring stable and efficient WebSocket connections for real-time communication between the client, server, and OpenAI API proved complex and is still in progress.
Time Constraints: Due to the a deadline, we weren't able to fully implement all planned features, including the database integration and fully functional recording capabilities considering the complexity of the project.

Accomplishments that we're proud of

Responsive Dashboard Design: We created a comprehensive dashboard layout for managing customer interactions across multiple channels.
Scalable Architecture Planning: Our use of Next.js and planned WebSocket implementation lays the groundwork for a scalable and efficient application architecture.
Adaptive Solution: We quickly adapted our solution concept to work around regulatory challenges by pivoting to a web-based voice chat feature design.

What we learned

AI Integration Complexity: We gained insights into the challenges of integrating advanced AI models for real-time applications.
Real-time Web Technologies: We deepened our understanding of WebSocket concepts and their potential for real-time communication.
Regulatory Compliance: We learned the importance of considering local regulations when developing global communication solutions.
Project Scoping: We learned valuable lessons about project scoping and the importance of prioritizing core features within tight deadlines.

What's next for Oratix

Complete Core Functionality: Finish implementing the recording features, database integration, and establish a working connection with the OpenAI API.
Enhanced AI Training: Train the AI model on industry-specific data to improve response accuracy and relevance.
Advanced Analytics: Develop analytics and reporting features to provide insights into customer interactions and agent performance.
Integration with More Channels: Expand support to include more communication channels like social media platforms and messaging apps.
Customizable AI Personas: Allow businesses to create and customize AI personas to better align with their brand voice and customer expectations.
Explore Alternative Telephony Solutions: Research and implement telephony solutions that comply with Indian regulations to potentially introduce phone-based interactions.