Storybook ML

Inspiration

This is a program that our group believes would help many struggling elementary students. We also believe it would save teachers valuable time.

What it does

Allows teachers to select the age group of the student and then academic subject. The teacher then enters a prompt to specify around the personal passions and interests of the student. Once entered, the teacher is navigated to the results page where the Machine Learning information is displayed. Images and an associated educational story are produced to encourage concept comprehension. A question to test knowledge is also produced and the answer to the question can be revealed by clicking the "card" that the information is displayed on.

How we built it

The frontend of the project was built in React-Native. The backend was built in Python. The user input from the frontend is used to engineer a prompt. This prompt is sent to DALLE-2 to create an image or series of images based on the prompt. Each image receives its own "card". The generated images are then sent to GPT-4 turbo to create the story, question, and answer. **Write about API that connects

Challenges we ran into

Server timeout due to inactivity
Prompt engineering
Scope slip
Consistency between cross platform animations
Learning OpenAi API
Deploying the program ## Accomplishments that we're proud of Though we are proud of the entire project there are a few milestones that stand out the most to us. They are as follows:
- The use of multithreading for performance improvements
- AWS S3 bucket used for dynamic imaging
- Using React Native for the development of a cross-platform front end.
- Used various model types for inputs and outputs (DALLE-2, GPT4, and GPT4 Vision)
- Multi-lingual support ## What we learned
Frontend group members learned about colour theory to develop UX
Backend group members learned about multi threading to improve the server performance
Everyone learned about the power of friendship ## What's next for Storybook ML The next step for StoryBook is to further develop the adaptability features. For example, if the student is dyslexic, use dyslexic friendly fonts. To ensure that StoryBook can positively impact as many people as possible implementing usability for students and expanding into older age groups is another step.