Automatically generate Blog Post from YouTube Video

Inspiration

Our inspiration for this project came from the ever-increasing video lengths on youtube. Especially nowadays, some videos run over 20 minutes long -- and as college students, we just don't have that type of time. iSpyAI hopes to solve these problems.

What it does

iSpyAI summarizes YouTube videos and generates a blog in a matter of seconds using the latest in AI technology.

How we built it

We built our application using a multitude of services/frameworks/tools:

React.js for the client frontend
S3 buckets for file storage
Docker for containerization and service interactions
.NET for our REST API
AWS Batch for CRON job management
AWS Fargate for serverless computing engine
AWS Elastic for our Load Balancer
Python for the backend service
Redis as our in-memory database
OpenAI's API for the generative blog posts
YouTube Video Transcriber for YouTube transcriptions
Namecheap + AWS ACM for Application Load Balancer HTTPS + DNS configuration
Render for frontend deployment

Challenges we ran into

Managing many different services and getting them to work together in fluidity.
Coding a lot. We had a complex architecture, there was a lot of heads-down coding required.
Finding time to work as a team -- we all have busy lives as college students, and finding time to work for 72 hours brought some difficulties.
CORS issues between frontend and REST API & S3 preresigned URLs
When we deployed the site onto Render, we faced lots of trouble with not allowing insecure HTTP requests. We had to fix this by configuring an SSL certificate managed by AWS ACM that links up to a custom domain on the REST API's application load balancer.

Accomplishments that we're proud of

Finishing our project and getting it working! We were surprised to have finished our ambitious application in 72 hours.
Using a ton of AWS services in a short amount of time.

What we learned

Used AWS Batch for the first time
Worked together as a team for the first time

What's next for Automatically generate Blog Post from YouTube Video

Improve AI blog generation
Add feature to specifically generate instruction manuals instead of blog posts

Built With

.net
amazon-web-services
aws-batch
aws-ecs
docker
openai
python
react
render

Submitted to

Beaver Hacks Spring 2023
- Winner 1st place

Created by

I worked on getting the YouTube video transcript, title, and channel name using YouTube's Data API. I also worked on setting up routes on the Python background service. This was my first hackathon so I learned a ton!

Sankalp S Patil
hi :)
I worked on the designing and developing the React.js user interface, connecting our backend to the front-end, implementing our Node.js API wrapper, and deploying our website to render.com's static website service! (^.^)

T Nyuma
always enjoy a great hack! ❤️
I worked on integrating the GPT API and building routes in the background service. As my first hackathon, this was a great opportunity to learn a lot!

Derek R Williams
I worked on getting the video to blog service running on AWS Batch jobs and also uploading the content to S3 and Redis. I also worked on the REST API where you submit the jobs to. Also I worked on some of the UI logic in the React app for interacting with the REST API.

Crypto :)