I communicate through movement. I would like to be able to find movements that are related to my own, especially when I don't have the words to describe them. In that direction, MaQ aims to develop a prototype that enables movement as a query into larger databases of movement — ask a search engine "what is this move?" ... search engine responds "that looks like a shimmy. The shimmy appears both contemporary dances like Salsa, as well as West African dances recorded in the Alan Lomax Cord Collection as early as the 1950's. Here are some videos examples of shimmy that I could find online."
What it does
This is at the early prototype phase — currently detects poses from a webcam feed.
How I built it
I leverage poseNet, working with Jameson Toole and Ed Bilous to refine the concept pitch
Challenges I ran into
Issues with poseNet installation, issues with getting video to stream from HD in JS.
Accomplishments that I'm proud of
Working with mentors and fellow hackers to get past first obstacle. Made friends and contacts that will be invaluable during further development of this idea.
What I learned
What's next for MaQ — Hacking Arts 2018
Immediate next steps are to enable a tool that does the same for a downloaded video. For a more fleshed out plan moving forward, see presentation (WIP)