Inspiration
Stage fear and public speaking anxiety are common challenges that many people face. Whether it's delivering a speech, presenting in front of an audience, or simply expressing oneself confidently, these fears can hinder personal and professional growth. We were inspired to create a solution that allows individuals to confront and overcome these fears in a safe, controlled, and measurable way.
What it does
LYF - Live Your Fears provides an end-to-end solution for tackling stage fright and public speaking anxiety. Our platform offers two types of environments for practice:
- Virtual/Meta Environments: Simulated scenarios for controlled practice.
- Real Environments: Real-world practice scenarios.
The platform allows users to rehearse a script while we record their speech, monitor physical movements (like head gestures), and capture stutters or tremors. Key functionalities include:
- Speech-to-text conversion using the Whisper model.
- A similarity index to compare spoken speech with the original script.
- Detailed performance evaluation based on stutters, pauses, adherence to the topic, and timing.
- A comprehensive feedback report with time-series signals that highlight areas of struggle.
How we built it
We developed LYF using the following technologies and methodologies:
- Virtual/Meta Environments: Leveraging VR platforms for immersive practice.
- Data Collection: Implementing sensors to record head movements, stutters, and other physical cues.
- Speech-to-Text Conversion: Integrating the Whisper model for accurate transcription.
- Performance Evaluation:
- Calculated similarity index for comparing scripts.
- Designed algorithms for point deductions (stutters, pauses) and bonuses (topic adherence, time limits).
- Feedback Report: Created detailed, user-friendly reports showcasing time-series signals and personalized improvement suggestions.
Challenges we ran into
- Sensor Calibration: Ensuring accurate data capture from physical movements was challenging.
- Speech-to-Text Accuracy: Fine-tuning the Whisper model for various accents and speaking styles required significant effort.
- Time-Series Signal Visualization: Designing a clear and meaningful way to represent speech struggles was tricky.
- User Engagement: Making the platform intuitive and motivating for users was a continuous process.
Accomplishments that we're proud of
- Successfully integrated VR environments with real-world data collection.
- Achieved a seamless workflow for speech-to-text conversion and performance evaluation.
- Delivered a comprehensive feedback system that highlights key areas for improvement.
- Created an engaging and user-friendly experience for overcoming stage fear.
What we learned
- The importance of understanding user psychology when addressing fears and phobias.
- Advanced techniques for speech processing and similarity evaluation.
- The potential of combining VR technology with AI for impactful solutions.
- How iterative testing and user feedback can significantly improve the user experience.
What's next for LYF - Live Your Fears
Live Your Fears is just the beginning. Here's what's next:
- Enhanced Virtual Scenarios: Introducing more realistic and varied practice environments, such as business meetings, interviews, and academic presentations.
- AI-Driven Insights: Leveraging advanced AI models to provide deeper insights into user behavior and progress.
- Gamification: Adding rewards, leaderboards, and challenges to keep users engaged.
- Mobile Integration: Expanding the platform to mobile devices for on-the-go practice.
- Community Support: Building a supportive community where users can share experiences and track collective progress.
We present LYF as a solution to help individuals rehearse fear and live with confidence, ultimately transforming their approach to public speaking and self-expression.
Built With
- python
- tensorflow
- unity
- unreal-engine
Log in or sign up for Devpost to join the conversation.