Voice2Task

AI helper that increases your call center efficiency by 50%!

Comment

Inspiration

The inspiration for Voice2Task came from the growing need for efficient follow-up task management in traditional CRM settings. With the advent of generative AI, we aimed to alleviate the burden on sales and customer service staff by automating repetitive tasks such as taking notes, inputting call information into databases, and managing follow-up actions. This solution aims to enhance productivity and allow staff to focus on more critical aspects of their roles.

What it does

  • Record Simulated Phone Conversations: Allows users to record simulated phone conversations directly on their computers.
  • Save Audio Files on AWS S3: Stores recorded audio files securely in an AWS S3 bucket.
  • Transcribe Audio to Text: Utilizes AWS Transcribe to convert audio recordings into text format.
  • Summarize Text and Generate Actions: Uses Claude AI to summarize the transcribed text and generate a list of actionable items.
  • Send Summaries and Actions to Users: Delivers the generated summaries and action lists to the users.
  • Query Summary History of Clients: Provides a feature to query and review the summary history of clients.
  • Streamlined Operations: Simplifies operations such as adding new summaries to existing or new clients with a single button click.

How we built it

We built Voice2Task using a combination of modern web development technologies and powerful AI services:

Backend - Services

  • Node.js: Utilized for server-side scripting and handling backend logic.
  • Express.js: Employed to create a RESTful API for managing requests and routing.
  • AWS SDK: Integrated for interaction with various AWS services, such as S3 and Transcribe.
  • Claude AI: Used to generate summaries and action items from transcribed text.

Database

  • MySQL: Utilized MySQL for the database.

Frontend

  • React: Developed a dynamic and responsive user interface for an intuitive user experience.
  • MUI (Material-UI): Designed the UI with Material-UI for a consistent and attractive design.

AWS Cloud Services

  • AWS S3: Used for highly durable and available storage of audio files.
  • AWS Transcribe: Employed for accurate and efficient speech-to-text conversion.
  • AWS RDS MySQL: Utilized for a highly available and durable relational database.

Challenges we ran into

  • Integrating Real Phone Calling: We faced challenges in finding an ideal solution to integrate real phone calling into the application. As a workaround, we opted to simulate phone calls using recording functionality.
  • Handling Complex API Calls: We encountered difficulties in integrating large API calls that perform multiple tasks simultaneously. This required extensive troubleshooting and optimization to ensure smooth functionality.

Accomplishments that we're proud of

  • Seamless Integration: Successfully integrated all layers of the application, resulting in a comprehensive solution that can generate summaries and action lists from recorded conversations.
  • Complex Function Implementation: Managed to implement complex functions that handle large API calls, performing multiple tasks depending on the situation. This significantly simplifies the workflow for CRM staff.
  • Enhanced User Experience: Developed a feature that streamlines operations for CRM staff. For instance, after a summary is generated, the user inputs the client's name and phone number. If the client exists, the system updates the summary; if the client doesn't exist, it creates a new client and updates the summary—all with a single button click. This greatly enhances efficiency and reduces manual effort.

What we learned

  • AWS SDK Integration in Node.js: Gained a deeper understanding of how to effectively integrate AWS SDK into a Node.js application.
  • Application Development Best Practices: Improved our approach to developing complex applications. For instance, when implementing a complicated button that initiates a large API call, we learned the importance of clearly writing out its functionality and the functions it involves.

What's next for Voice2Task

  • Capture Internal Audio: Develop functionality to capture internal audio on the computer regardless of the software source. This will enhance the flexibility and capability of the application in diverse environments.
  • Expand Functionality: Introduce new features to provide CRM managers with tools to visualize team performance. This could include dashboards, performance metrics, and analytics, enabling better oversight and decision-making.
Share this project:

Updates