Inspiration
There is an obvious glass ceiling that is preventing talented and capable individuals from participating in the workforce. Eligible candidates may be dropped prematurely due to bias against their gender, race, etc.
We want to create equal employment and work opportunity to reduce bias, that may occur throughout the interviewing process.
What it does
MatchWithoutLimits is a video interviewing platform where candidates face and voice are masked during the interview. This will allow the interviewers to understand the candidate's experience and abilities while eliminating their identity from the evaluation process.
How we built it
React/Next.js : generate site, and help simplify some of our codebase
clmtracker: provides real-time facial feature detection
Three.js : to draw the face replacement
Tone.js : Manipulate the pitch of the candidate's voice
Socket.io: would be used to facilitate the client to client connection
Challenges we ran into
Unity VR
- cannot pair with Oculus to create a VR interview setting
- finding solutions for networking and voice chat in unity
web
- finding a library that works in the browser and provides real-time facial feature detection
- manipulate the candidate's voice (via a filter, pitch, etc)
Accomplishments that we're proud of
- created a clean and professional space for interviews
- an avatar that provides real-time facial expression
What we learned
- numerous front-end technologies including clmtracker, tone, three, etc.
What's next for MatchWithoutLimits
- set up the video conference calling
- get voice masking to work
- switch to a more responsive facial feature tracking library
- incorporate real-time translation so that non-native speakers can have the opportunity to use this application as well
Log in or sign up for Devpost to join the conversation.