Inspiration
Our journey with "Sheldon's Whisper" began close to home, rooted in the struggles and challenges faced by my own family during job interviews.
Every time my daughter faced an interviewer, her words would freeze. The brilliant thoughts in her mind just wouldn't translate to her voice. And then there's my ex-wife, a strong and intelligent professional woman hindered by a hearing impairment. Each time she had to ask an interviewer to repeat a question, I saw a flicker of frustration in her eyes – a momentary lapse that distracted her from showcasing her true potential.
Watching my family grapple with these hurdles was heart-wrenching. It wasn't just about answering questions; it was about battling invisible barriers that stood between them and their dreams. That's when the idea of "Sheldon's Whisper" sparked – a tool not just to provide answers, but to break down these barriers, giving a better voice during the stressful moments.
What it does
🧠 Custom-Tailored AI Brain: Our AI is not just smart; it's personalized. It dives into your resume and job description, adapting its advice to fit your unique career path. Imagine having a career guru, molding responses perfectly suited to your goals. That's precision and personalization at its best!
📞 Ultra-Fast, Real-Time Response: We're breaking speed records here! With a response time under 500ms, our system ensures that you get sharp, concise recommendations in real-time.
How we built it
We used the latest technologies to be super efficient: Svelte for UI work, ElevenLabs for Voice Synthesis, ChatGPT for Recommendations and model fine-tuning, BoosterVoice AI for Phone Line Tapping.
Challenges we ran into
UI work takes time. Even if we used DailyIU template it is far from perfect. Another issue is that ChatGPT often hallucinates and provide weird answers. It forced us to add "review and fix auto-populated recommendations"
Accomplishments that we're proud of
It just feels awesome to see such impactful project taking its shape. Especially being a multimodal (voice and text). Also from moments, I paste job description, to seeing how fine-tuning reaching perfect alignment, to be excited when recommendations appear during the live call.
What's next for Sheldon Whispers
Hopefully my daughter's next interview will be easier :)) or maybe we will make it publicly available for all students and people with disabilities.
Log in or sign up for Devpost to join the conversation.