The initial inspiration was to use innovations in consumer-level motion capture to make a digital assistant with an open-ended application. The topic domain we picked was Miami Coin
What it does
A digital assistant is represented by an animated character that informs the user about Miami Coin
How we built it
The tech demo was built with Adobe Character Create to create the character, animate body movement based on motion capture, and lip-sync pre-generated text. The speech for the assistant was generated by the Google Text to Speech API cloud service. The video generated of the assistant is loaded on a Wix website provided by one of our members.
Challenges we ran into
A more robust and implementable version of the assistant was deemed not feasible since it would involve learning many new technologies in too short amount of time. Desired implementations would involve using an open-source or free-ish animator like Unity, rig generator like VRoid, and chatbot for text generation. What we generated gives the impression of what a final product would look like and behave.
What we learned
We learned about Miami Coin, Adobe Character Animate, and Google cloud services
What's next for Project David
The next step would be learning to implement the character in unity so the animations and input could be dynamic and implementing a chat bot to respond to user requests intelligently. Programatically retrieving audio for response would need to be automated which should be simple since we are already have the Google API implementation worked out.