posted an update —

Major Update: Mentus is live on Vercel

We have achieved a significant milestone in the development of Mentus. The application is now fully operational and hosted on Vercel, providing a stable environment for multimodal interaction.

Key improvements in this version:

  • Cinematic Interface: We have implemented a new, minimalist UI that prioritizes the camera feed. The interface uses a cinematic 95 percent viewport layout with floating glassmorphism elements, ensuring a
    premium and focused user experience.
  • Integrated Multimodal Engine: The system now successfully combines computer vision and local speech recognition. Mentus analyzes video snapshots and user transcripts simultaneously using Gemini 1.5 Flash to
    provide contextual guidance.
  • Visual Feedback System: We added dedicated status indicators for Listening and Analyzing states. This
    provides users with clear feedback on the AI's current activity without cluttering the screen.
  • Infrastructure Stability: The backend has been migrated to a robust serverless architecture. This change
    resolved previous API quota issues and ensured reliable performance across different devices.

Live Demo: You can test the current version of the hands-free mentor at the following address: https://mentus.vercel.app/

We are now focusing on refining the AI's specialized knowledge and improving response latency for the upcoming final phases of the hackathon.