EchoPay

[1:57 PM]EchoPay solves a real problem in hospitality and payments: taking orders is often slow, repetitive, and dependent on staff availability, especially during busy periods. Customers who know what they want should be able to order quickly, while customers who are uncertain should still get help without creating friction for the business. Traditional ordering flows either require constant staff involvement or force everyone through the same rigid self-service experience. Our solution is an AI voice waiter that can directly handle customer ordering, convert the conversation into a structured payment-ready order, and escalate to a real server when needed. Users can complete their order smoothly through natural voice interaction, while operations staff can monitor each live order as a separate table in the business dashboard. AI is the core of the system. It transcribes spoken input, interprets the conversation, resolves corrections, identifies uncertainty, classifies the interaction as low-friction or needing support, and turns the result into a structured order and payment draft. It also helps determine whether the AI can continue independently or whether human support may be required, making the system adaptive rather than fixed. The main non-text modality is audio. Customers interact with EchoPay by speaking naturally, and the AI responds with spoken feedback through text-to-speech. Speech is therefore central on both input and output: audio is used to capture the order, and audio is used again to guide the customer through confirmation or escalation. For customers who prefer not to speak, text input is also available as an alternative interaction mode. In addition, we have explored beta functionality around speaker diarization, speaker uncertainty detection, and separate billing based on who said which order items. These capabilities have been prototyped and tested conceptually, but are not yet fully implemented as part of the live production flow. Together, this creates a multimodal, real-time ordering and payment experience that is faster for confident users, more supportive for uncertain users, and more operationally efficient for businesses.

Built With

• flutter
• python