Major Update: Mentus is live on Vercel
We have achieved a significant milestone in the development of Mentus. The application is now fully operational and hosted on Vercel, providing a stable environment for multimodal interaction.
Key improvements in this version:
- Cinematic Interface: We have implemented a new, minimalist UI that prioritizes the camera feed. The
interface uses a cinematic 95 percent viewport layout with floating glassmorphism elements, ensuring a
premium and focused user experience. - Integrated Multimodal Engine: The system now successfully combines computer vision and local speech
recognition. Mentus analyzes video snapshots and user transcripts simultaneously using Gemini 1.5 Flash to
provide contextual guidance. - Visual Feedback System: We added dedicated status indicators for Listening and Analyzing states. This
provides users with clear feedback on the AI's current activity without cluttering the screen. - Infrastructure Stability: The backend has been migrated to a robust serverless architecture. This change
resolved previous API quota issues and ensured reliable performance across different devices.
Live Demo: You can test the current version of the hands-free mentor at the following address: https://mentus.vercel.app/
We are now focusing on refining the AI's specialized knowledge and improving response latency for the upcoming final phases of the hackathon.
Log in or sign up for Devpost to join the conversation.