My Eyes Are Up Here

Inspiration

Have you ever sat in a boring telepresence meeting? Or worse have you had to watch a recorded one? Wished you could skip to the important part?

What does it do?

By tracking the audience's head orientation throughout the meeting/presentation we can plot their attention over time. All the while it transcribes the speech, extracts the main talking point per 30s, and associate the keyword to the attentiveness score.

How we built it

In the backend, Python code runs the API calls to Azure Vision With javascript, we record the audio and transcribe it Finally, we plot the data in Chart.js

Challenges we ran into

Our team suffered from decamping by 50% of the members Attention is not a parameter supported by any vision api we could find but the head tilt does a pretty good job

Accomplishments that we're proud of

A successful 4am-backend-to-frontend-integration

What we learned

API calls, lot's of API calls How to make pretty charts

What's next for My Eyes Are Up Here

Cleaning up the code Integration it with telepresence endpoints

Built With

• azure-vision-api
• flask
• javascript
• python