Inspiration

tiktokrefugees on rednote

What it does

A social media platform that focuses on short vlogs where users can simply upload the clips they want to include and AI-edit

How we built it

We used a combination of advanced AI technologies. It leverages Gemini for video-processing and natural language processing to process what is happening in each of the videos that the user uploads. Then, it suggests edits that can be done through video editing script generation. Them, the video editing script is passed to the chatgpt API to generate code with use of the shotstack API, which is a cloud video editing API. Video storage and retrieval are managed with Amazon S3, while video editing is powered by Shotstack's video editing API. The frontend is built with React for a responsive and user-friendly interface, and the backend is developed using Node.js and Python for efficient processing of user uploads and API integrations.

Challenges we ran into

• Integrating multiple APIs in a seamless workflow, especially with asynchronous tasks like video processing.
• Ensuring the platform processes videos quickly and efficiently while maintaining high-quality edits.
• Developing an intuitive UI/UX that simplifies the video editing process for users.

Accomplishments that we're proud of

• Successfully building a pipeline that converts raw user-uploaded video clips into polished, AI-edited vlogs in real-time.
• Creating a highly responsive and visually appealing interface that helps user to simplify their video-editing and uploading process
• Seamlessly integrating Shotstack, OpenAI, and Gemini APIs to deliver personalized video edits and dynamic editing plans.

What we learned

• React native
• The importance of designing efficient workflows when working with multiple APIs and services.
• Techniques for optimizing video processing pipelines to minimize latency.
• How to balance user-friendly design with complex backend logic for a seamless experience.

What's next for Vlogify AI

• Introducing more advanced AI editing features, such as scene detection, transitions, and custom music suggestions.
• Adding multilingual support for users worldwide.
• Implementing analytics tools for users to track engagement metrics for their vlogs.
• Exploring monetization options such as premium subscriptions for advanced editing features.

Built With

• chatgptapi
• flask
• geminiapi
• python
• react-native
• shotstack
• typescript