CARLsitter

• 

  Using Microsoft Bot Builder + LUIS to build an NLP interface for interacting with CARLsitter

• 

• 

We wanted to combine our knowledge of machine learning, web applications, and Android robotics to solve a commonplace problem in a fun and unique way. To this end, we recalled the time when we were unruly toddlers and sought to develop a new way for parents to keep an eye on them.

CARLsitter seeks to integrate audio / visual emotion detection with an autonomous mobile platform to become an always connected, always on guardian for young children. By utilizing custom machine learning models in conjunction with the Microsoft Cognitive Services API, CARLsitter uses vision and audio to track and follow children, detect children's emotional states, provide parents with contextual notifications, and react in context to different situations.

Built With

• android
• android-based-robotics
• microsoft-project-oxford
• node.js
• opencv
• pyaudioanalysis
• python