Inspiration
As university students, our team have received read many research papers and newspaper articles for school. We realized that this would not be accessible for everyone, which inspired us to create a hack to read summaries for everyone.
What it does
Our hack offers summaries for everyone to read a research paper or news article. It is both accessible visual and article to reach the biggest audience.
How we built it
The front-end framework has a keyboard input for click on to state your query, and it offers instructions on how to use our hack when first logged onto the website when the program is running. We also created and trained cohere modules that classifies a paper's or a article's name and topic and reply to the user with a summary of the article name spoken into. We also have created a database that has sample papers and articles that is used when we retrieved from the front-end work along with an upload pdf option to add your own pdfs.
Challenges we ran into
For the front-end framework, we encountered many errors with the speech recognition and the synthesizer when spoken back to the user. We struggled with uploading the pdf on the website because it would not recognize the pdf file when user clicks "Submit." Lastly, we had trouble with connecting to the database through the front-end.
Accomplishments that we're proud of
We are proud of having our hack speak back to the user when it summarizes a research paper and newspaper articles and the speech recognition when instructions given using the cohere AI.
What we learned
We learned brand new languages and integrating the different types of language for this hack. We also learned how AI works along with speech recognition, synthesizers, keyboard input, and learning how to connect to a database.
What's next for WorldPlay
In the future, we aim to expand our program to encounter and handle speech queries with human errors.
Log in or sign up for Devpost to join the conversation.