Major Update: Mentus is live on Vercel
We have achieved a significant milestone in the development of Mentus. The application is now fully operational and hosted on Vercel, providing a stable environment for multimodal interaction.
Key improvements in this version:
- Cinematic Interface: We have implemented a new, minimalist UI that prioritizes the camera feed. The
interface uses a cinematic 95 percent viewport layout with floating glassmorphism elements, ensuring a
premium and focused user experience. - Integrated Multimodal Engine: The system now successfully combines computer vision and local speech
recognition. Mentus analyzes video snapshots and user transcripts simultaneously using Gemini 1.5 Flash to
provide contextual guidance. - Visual Feedback System: We added dedicated status indicators for Listening and Analyzing states. This
provides users with clear feedback on the AI's current activity without cluttering the screen. - Infrastructure Stability: The backend has been migrated to a robust serverless architecture. This change
resolved previous API quota issues and ensured reliable performance across different devices.
Live Demo: You can test the current version of the hands-free mentor at the following address: https://mentus.vercel.app/
We are now focusing on refining the AI's specialized knowledge and improving response latency for the upcoming final phases of the hackathon.