TrendTok

Problem Statement: Inspiring creativity with Generative AI

😜 FUN FACTS!

You know what? You can actually try this out! It is hosted on a dedicated server. Link
Afraid of copyright violations? Fret not, even the background score in our video is AI-generated!

🌟 INSPIRATION

In a world increasingly influenced by social media trends and influencers, we’ve noticed that developing new, engaging trends is becoming more difficult. We believe that using GenAI to ideate new trends based on inspiration from existing ones can significantly diversify content and better engage audiences.

💼 WHAT IT DOES

Our app analyzes trending TikTok videos and generates new video ideas in the form of short descriptions, along with novel AI-generated music tracks to serve as background scores and image generation features, providing visual templates to further enhance the creative process. This combination helps creators develop new and engaging content.

🔨 HOW WE BUILT IT

A multi-step process involving several advanced technologies was used to build TrendTok.

1.⁠ ⁠Data Collection: Selenium and BeautifulSoup scrape trending videos from TikTok. In cases where web scraping was limited, third-party APIs are used, ensuring a comprehensive dataset of trending videos.

2.⁠ ⁠Data Summarization: Python libraries such as Speech Recognition, Moviepy Editor, and Pytesseract (OCR) process the text data extracted from the videos. Llama3 summarizes the extracted video text descriptions and generates relevant tags that capture the essence of the trending content.

3.⁠ ⁠Idea Generation: The Llama3 LLM uses the summarized data to create short descriptions of novel video ideas, inspired by the existing trends.

4.⁠ ⁠Audio Cue Generation: MusicGen uses the textual audio cues generated by Llama, and then generates creative music tracks.

5.⁠ ⁠Image Generation: Stable Diffusion creates high-quality images, providing visual elements to complement the generated video ideas and music tracks.

6.⁠ ⁠Integration into a Web App: An interactive frontend using HTML, Bootstrap, and JavaScript, with Flask for the backend, GCP for fast, reliable access, and ensured security and scalability through Docker containerization powers TrendTok.

🌍 MARKET IMPACT

By harnessing AI's endless creativity, creators can keep their content fresh and engaging, leading to endless entertainment for users and maximized engagement for creators. The increased activity benefits creators through greater exposure and monetization opportunities, while solidifying TikTok's position as a leading social media platform.

🚀 CHALLENGES WE FACED

Data Access: Due to restricted API access to TikTok data, we utilised web scraping, third-party APIs, public data repositories, and manual data collection.
Model Availability: Obtaining open-source GenAI models was challenging due to the limited availability of music & image generator models and free LLMs suitable for cloud-based API calls.
Compute Power: The high compute power required for video and image generation models necessitated using lighter models and cloud-based APIs.

🏆 ACCOMPLISHMENTS

Revolutionizing Trend Generation: We have pioneered a sophisticated AI-driven pipeline that generates not only textual ideas but also original audio tracks and image visualization templates, enabling creators to develop unique and engaging content that stands out in the crowded TikTok landscape.
Enhanced User Engagement: By providing influencers with ready-to-use templates for new trends, we empower them to captivate their audiences with fresh, innovative content, thus driving higher levels of engagement and interaction on the platform.
Scalable and Secure Infrastructure: Our solution is deployed in a Docker container, with plans to incorporate it in Kubernetes for scalability, providing a degree of encapsulation and security for identifiable data which is sent over the internet.

🚀 What's Next

TrendTok’s next iteration involves model testing on historical trend data to measure its accuracy. Real-time data collection from TikTok and dedicated accelerators for the AI models will ensure TrendTok’s push to the mainstream.