Inspiration
With advancements in text-to-speech technologies provided by companies like SoundHoundAI, OpenAI, ElevenLabs, and more, we wanted to turn storytelling into an interactive, live experience, making it more accessible to all.
What it does
Fable is your all in one storytelling hub, allowing users to author, generate, save, and publish (hopefully) their stories all in platform. Utilizing OpenAI, WhisperAPI, Dall-E, and ElevenLabs technologies, we make your stories turn to life by generating live images as you narrate, or have an AI voice of your choosing narrate for you.
How we built it
First we did some basic researched on tools and technologies used to turn text into speech, and how to use them, by reading documentation, watching videos, and asking ChatGPT and other generative AIs. While one member began working on the Figma file to outline how the webpage should look, and basic functionality, the others launched a project using Monorepo on a GitHub repository, shared it with everyone, and made branches for each person so we could all work while minimizing version control issues. We split up our workload according to our strengths, so while some members worked on the front-end (Tailwind, etc.), the others worked on the back-end (TypeScript, AI functionality). Then, we combined everything together, tested, and prepared to present.
Challenges we ran into
Many, many, merge conflicts, API calls (at one point it was going infinitely and others not at all) , replicating Figma as closely as possible.
Accomplishments that we're proud of
Minimum Viable Product (MVP), linking all the AI technologies together. Working(ish) back-end database and functionality.
What we learned
- How to utilize Tailwind, and interact with various APIs and technologies all at once.
- Working on a project with teammates (dealing with version control, merging conflicts, etc.)
- MySQL + Prisma + Express backend
What's next for Fable | All-In-One Storytelling Hub.
Use SoraAI to create videos in addition to images. Security measures to present all sorts of attacks. Everything functioning correctly... there's a few bug fixes to be made for both frontend and backend
Video Demo
Built With
- dall-e
- express.js
- html
- mysql
- openai
- prisma
- react
- tailwind
- typescript
- whisperapi
Log in or sign up for Devpost to join the conversation.