Most people have multiple Social Media Accounts that they are constantly checking throughout their day. Using Social Media seems intuitive to us because we use it so intensively every day. For Seniors and Disabled people, the lack of accessibility in Social Media will stop them from using these platforms. This problem was our inspiration to build simplif.ai.
What it does
Our solution, Simplif.ai consolidates social media data for seniors and the disabled who have difficulty staying connected with the world. Simplif.ai streamlines the user experience for accessibility. The integrated chatbot(on Facebook Messenger) allows for users to read a custom summarized version of their activity on social media.
How we built it
We built the Chatbot using Azure’s Bot Service API. Using this API gives us the ability to use CaptionBot, one of Microsoft’s Cognitive Services. We are making use of API’s from Social Media Companies such as Facebook’s Graph API. We are also making use of smartphones text to speech ability to make this extremely accessible to our target audience.
Challenges we ran into
We had difficulty implementing the authorization system in Facebook messenger. We also had difficulty with implementing Instagram and Twitter feeds inside of the messenger.
Accomplishments that we're proud of
We are proud of our idea and the effort we put into creating the product. This hackathon marks our first hackathon and we are proud to have built a product that we think has an impact on the world.
What we learned
We learned about implementing API's such as the CaptionBot. We learned on how to use LUIS to make a chatbot enabled with Natural Language Processing. Learned how to use the Azure Bot Framework. We learned how to work with Facebook's Graph Explorer and implementing its API.
What's next for simplif.ai
We want to make this accessible to a larger demographic. An example of how we can do this is implementing the IBM Watson Visual Recognition API for use of Sign Language inside of this bot. We also want to increase the range of social media platforms available on this bot.