Inspiration
Giving presentations are a skill that is developed mostly through by ourselves and trial and error. No one really tells us the simple ways that can help your engagement with your presentation. The best way to learn to do presentations is to just present, so we came up with an idea to create a assistant what would give feedback on body language of presentation, as that is one of the most crucial aspects of what makes or breaks a presentation.
What it does
Its the one and only PABLO - Presentation Assistant for Body Language and Observation - who's here to help you get the perfect amount of movement in your presentations, not too much, not too little, but perfect! Record yourself doing a presentation, and once your done, get feedback such as how you can improve the body language during your presentation.
How we built it
PABLO runs off of the Google Media pipe library which allows us to track the position of the body and face. from this, we can calculate the angles and count every time the user makes a noticeable change such as moving position or hiding your hands behind your back. Then, we use Open AI to generate feedback and give an overview of how you did!
Challenges we ran into
One of the biggest challenges was working with the data from media pipe. We knew we wanted to look at how often the user's head turns, how often they stand still, and how often they hide their hands, but only the user's angle of their head was the most straight forwards. The other two require some problem solving that used a timer to see if the user had changed positions outside of a threshold. Furthermore, we struggled with getting accurate data of the angle which made us think things through a second time.
Accomplishments that we're proud of
Our biggest challenge was also out biggest accomplishment. We were able to get accurate face angle detection as well as calculating the standing and hand times.
What we learned
Our main goal while attending was to learn as much as we can. We learned a bunch of new resources, API, and frameworks, which have all added to our repertoires of skills.
What's next for PABLO
Training Training and more Training! With the availability of thousands of TEDxTalks, we can train PABLO to be more accurate when deciding if there is too much or less movement. Additionally, a crucial aspect of presentations is the projection of the voice, and with a few add-ons, it would not be hard to get running.
Log in or sign up for Devpost to join the conversation.