Fable

What are you reading today?
Fable responds back after you reply with what story you are reading.
The beginning of your story.
Fable visualizes your story as you are reading it.
Fable is waiting for your response.

What it does

Fable is an interactive storytelling platform that visualizes the experience of story telling and brings the words, and world, to life. Speak into the microphone and Fable will detect the setting of the story, visualize the characters, and animate live actions along with the story.

Use it to:

Visualize storytelling
Add visuals to a lecture to help students
Add additional creative optics to the stories you tell your friends

How we built it

Using a collection of Machine Learning Natural Language Processing algorithms, we began to better break down and understand relationships in our voice inputs. We then used these relationships to create images to represent objects (using the Google image search API) and actions to represent relationships.

The platform is an extremely light Python Flask backend, serving a frontend which uses Fabric.js (a canvas) to display pictures. All the rest is mapping and some clever math.