Inspiration
In our Chinese classes, we have weekly spelling tests (听写 tingxie) to test our knowledge and vocabulary on various words. We were inspired to create a more efficient and accurate way to practice for these tests, leading us to develop a website that enables students to easily prepare for these spelling tests.
What it does
This website enables students to generate and grade practice papers by uploading an image of their word list. This method simplifies practice for students in our school, making it more accessible and efficient for students.
How we built it
To build this website, we used flask to integrate web development with python. We also integrated OCR and gemini 1.5 pro with python to be able to detect and output a list of Chinese characters and their respective English translations. The outputted text from our AI is stored in a .csv file, which is then formatted into a .pdf file and displayed to the user.
Challenges we ran into
During this hackathon, we faced challenges in accurately detecting and formatting text extracted from images. Integrating our front-end and back-end proved to be very challenging as well.
Accomplishments that we're proud of
We are proud of our text-to-pdf script, which we created from scratch using the docx package. We are also proud of our AI text-detection integration, which required hours of fine-tuning through trial and error.
What we learned
In this hackathon, we learned a lot about writing and text detection including different OCR libraries, preprocessing techniques for images, and post-processing methods to improve text accuracy. We also learned how to approach and solve complex technical problems under pressure.
What's next for Instant Tingxie
After this hackathon, we plan to further polish our text-detection system and add more features such as flashcards and compatibility with other apps such as Quizlet or Anki.