Inspiration
It all started when my little cousin was watching a documentary and had to ask me every time he wanted to search something about the information shown in the documentary. I think this will be an amazing add-on for anyone using a Fire Tv.
What it does
It adds a sidekick or what we can call a simple sidebar for the viewer to ask questions about what they're watching.
How I built it
It was built with vanilla web technologies that leverage Amazon Bedrock Api and using the Nova lite model.
Challenges I ran into
It is difficult to figure out how to read the content shown on the screen when we are viewing some content on a 3rd party app. I struggled to implement the AI functionalities and constructing prompts.
Accomplishments that we're proud of
I think the whole app is a very new concept to me as I have not worked on AI integration before.
What we learned
Learned how to use an AI model using Amazon Bedrock
What's next for ScreenSideKick
Being able to read what is on the screen and content of the video playing on popular 3rd party applications
Log in or sign up for Devpost to join the conversation.