JobMentor AR

InterVirtuoso is an AI-powered AR job interview simulator that helps users practice in realistic scenarios, offering emotional feedback and speech analysis to improve confidence and performance.

Comment

Inspiration

Job interviews are one of the most nerve-wracking parts of career growth. Many students and professionals struggle with confidence, communication, and anxiety. We wanted to create a solution that simulates a real interview experience using cutting-edge technology — helping users practice, receive feedback, and improve from anywhere, without needing expensive hardware or professional coaching.

What it does

JobMentor AR is an immersive AR-based job interview simulator powered by AI. It places users in a virtual interview environment using WebXR, where they answer interview questions using voice. The system analyzes tone, pace, and sentiment using AI and provides real-time feedback on emotions (nervous, confident, etc.). It stores session results, offers personalized improvement tips, and can dynamically generate follow-up questions — simulating a real-world interviewer experience.

How we built it

We used WebXR + A-Frame to build the AR environment, with a 3D virtual interview room and an interactive avatar. The backend is built using Python + Flask, integrating speech recognition and text analysis libraries (like OpenAI Whisper and TextBlob). We used SQL for storing session data. The web interface is built with HTML/CSS/JS, and WebGazer.js was explored for optional eye-tracking functionality.

Challenges we ran into

  • Getting real-time audio analysis and emotion detection to sync smoothly in-browser.
  • Integrating WebXR across browsers with consistent performance.
  • Managing latency between voice input and AI feedback.
  • Optimizing speech recognition for varying accents and noise levels.

Accomplishments that we're proud of

  • Built a fully functional AR interview simulation with realistic voice interaction.
  • Integrated emotional feedback and speech analysis for a better user experience.
  • Created a scalable architecture that works even without VR headsets.

What we learned

  • How to combine AR/VR (WebXR), AI/ML, and full-stack web development into a unified experience.
  • The importance of UX in emerging technologies like AR for accessibility.
  • Real-time systems design and managing async voice + AI processing.

What's next for JobMentor AR

  • Add GPT-powered avatars that ask contextual follow-up questions.
  • Enhance emotion tracking with facial expression and gaze detection.
  • Build a mobile-friendly version.
  • Partner with ed-tech or HR startups for real-world use.

Built With

Share this project:

Updates