• What it does People with cognitive disabilities- such as dysgraphia and dyslexia- who thrive when learning in auditory or visual environments, are often frustrated when trying to retain new information on educational technology/online learning platforms, because typical studying (digital/physical flashcards, word memorization, etc) is often boring and references text-based learning. Memory Mind translates text input into mnemonics, through popular songs, in order to retain important information in an accessible and fun way!
• Impact we bring! ->Reducing stress for those with cognitive disabilities ->Helping students who want to learn and have fun!
• How you built it ->Developed a basic UI ->Paragraph from user (eventually a plug in or extension) -> extract keywords using a ML model -> convert the keywords into lyrics using chatGPT 4.0 API -> convert it from text to speech using gtts library -> Uses python code to combine it with music/tune to convert the whole thing into a catchy song.
• Challenges you ran into ->Integrating the ML model and feeding the keywords input to get a accurate and logical lyrics.
• Accomplishments that you’re proud of -> Idea that we came up with! -> Implementation of it - it was really tough to get accurate keywords from the text. Retaining the actual meaning of input context and generating a song with same meaning but with a catchy tune!
• What you learned -> It is possible to implement a complex function and if the idea is novel when we have the motivation to achieve it.
• What's next for Test Project Hope to eventually take custom genre specifications in order to adjust both the GPT tone and audio background. Generate video with it as well!
Log in or sign up for Devpost to join the conversation.