Based on National Center for Education Statistic- U.S.-born adults make up two-thirds of adults with low levels of English literacy skills in the United States. Non-U.S.-born adults comprise 34 percent of the population with low literacy skills Colorful and simple for kids and non-english speakers.
What it does
Through ESLAssistant, we wish to tackle the difficulties by non-english speakers to learn the language by providing textual description and voice recognition through image captioning. link
How we built it
Challenges we ran into
For training, we had to use local CPU which took a lot of time. Tensorflow.js was released in 2018 so it is a relatively new library which is difficult to learn. link
Accomplishments that we're proud of
Understanding basics of Convolutional Nets and Recurrent Nets to create sensible sentences based on the picture. Integrating the model with front end so that it can give live predictions, and also set up the basis to build online training like the one used by Amazon. link
What we learned
What's next for ESLAssistant (English as a Second Language Assistant)
Convert the web application into a mobile app
Improve the accuracy of the app by using online training where the user are given opportunity to figure out mistakes.