Inspiration

The purpose of StoryGem Studio is to stimulate ideas and act of creativity for anyone to be able to create and share their creations with others, experiment in an online studio environment and express themselves through this medium.

A digital storytelling AI tool for content creators can prove to be a powerful tool for education, media, entertainment, marketing and brand engagement.

Research shows that global video content consumption is predicted to grow by a whopping 82% in 2025, while video streaming will make up 91% of global internet traffic. The need for scalable and efficient video creation tools is greater than ever​. Video content is king.

What it does

It provides automation in storytelling and video production.

Boosts Content Output: Reduces the time needed to create videos, enabling creators to publish more frequently.

Automated Video Creation: It combines images, audio, and text to produce ready-to-use or experimental videos for realtime AI-powered interactive transmedia storytelling which can also be distributed on social media platforms.

How we built it

Gemini API: It is used to generate video scripts with multiple prompts for generating multiple images. It also provides multiple prompts for generating an audio file content in MP3 format.

Replicate: It is used for generating images based on text prompts.

Assembly AI: It is used for adding the video captions.

PINATA File API: For storing the images and audio files.

Neon Postgres Database: It is used for storing users and video data.

Google Cloud Text-to-Speech: Translate text (script) to speech (the MP3 audio file). A text-to-speech service converts the content text into natural-sounding speech, which is delivered to the user in the video.

Remotion: It is used for generating the videos and bringing it all together.

What's next for StoryGem AI Studio

  • 2D and 3D generation of AI Avatars
  • Adding more features for content creation, such as scriptwriting, editing, or animation.
  • Enhanced Image, Video, Avatar, and Story studios
  • Digital right and ownership of content.
  • Make it easy to adjust content element.

Built With

Share this project:

Updates