Inspiration
As college student approaching the end of our degree's, we found that often times rubrics, instructional videos, and other learning content can be intentionally complex and confusing. We aimed to create a resourceful tool to assist us with understanding the fundamental ideas of this educational content with ease.
What it does
Iceburg: This learning assistant is a multifaceted AI based Chrome extension that allows the user to accomplish several tasks. Included in the extension:
-An image processing feature that utilizes Tesseract to analyze text within images and convert it to characters.
-A summary tool that converts Youtube subtitles into a transcript, then plugs into Cloudflare's Rest API to communicate with LLaMA 2.0 to get the key points of videos with a simple button.
-A complete page summary to quickly find the main points of any website.
How we built it
We used Cloudflare for the LLaMA 2 LLM, A large number of google cloud API's, as well as custom-created API's to accomplish specific challenges. We also used a number
Challenges we ran into
We found problems at every corner. Some of the big challenges we ran into were getting communication between files as well as learning new concepts and implementing them in a tight time constraint. Another extremely difficult task was setting up the screen snippet tool, this involved
Accomplishments that we're proud of
ALL OF IT
What we learned
How to use cloud flares API, how to make a custom API, how to make java script file communicate through requesting, how to make work with a group from start of project to end.
What's next for Iceberg: Enhanced Learning
We would like to polish it up and hopefully make it a product that anyone can use.
Log in or sign up for Devpost to join the conversation.