-
Memory mind
• What it does People with cognitive disabilities- such as dysgraphia and dyslexia- who thrive when learning in auditory or visual environments, are often frustrated when trying to retain new information on educational technology/online learning platforms, because typical studying (digital/physical flashcards, word memorization, etc) is often boring and references text-based learning. Memory Mind translates text input into mnemonics, through popular songs, in order to retain important information in an accessible and fun way!
• Impact we bring! ->Reducing stress for those with cognitive disabilities ->Helping students who want to learn and have fun!
• How you built it ->Developed a basic UI ->Paragraph from user (eventually a plug in or extension) -> extract keywords using a ML model -> convert the keywords into lyrics using chatGPT 4.0 API -> convert it from text to speech using gtts library -> Uses python code to combine it with music/tune to convert the whole thing into a catchy song.
• Challenges you ran into ->Integrating the ML model and feeding the keywords input to get a accurate and logical lyrics.
• Accomplishments that you’re proud of -> Idea that we came up with! -> Implementation of it - it was really tough to get accurate keywords from the text. Retaining the actual meaning of input context and generating a song with same meaning but with a catchy tune!
• What you learned -> It is possible to implement a complex function and if the idea is novel when we have the motivation to achieve it.
• What's next for Test Project Hope to eventually take custom genre specifications in order to adjust both the GPT tone and audio background. Generate video with it as well!
