True-Sight Translator: Words to Reality

Visually verify translations using authentic global imagery pooled from Pexel.

Comment

Inspiration

Google Translate is quite often correct but it's the small cases where it can potentially mess up and improperly translate single words without context, such as the two words spring & spring. One is a season the other a coiled piece of metal. But of course who doesn't like the occasional cute animal picture?

What it does

I designed a Chrome Extension to show how this is an issue with single-word inputs in Google Translate. Once a word or phrase is translated and the extension enabled, 9 images of the translated word are found in a database and shown to the user, the pop-up also has buttons and can go in the past to see what the previous searches were.

How I built it

Through hard work of prompting multiple AIs and searching on Google when they were of no assistance (which was rare). I started with the Chrome extension aspect of the project and properly reading variables from Google Translate, next was the Cloudflare aspect of the project where I would use a Cloudflare Worker to send out the APIs for the Google Translate API and the Pexel API in a secure way to the chrome extension. After the completion of the secure API, I then opened a server to take information from the Chrome Extension and send it to a data collection system in MongoDB that I made to make sure the correct info was going through. It would also be a fun Easter egg for the users once they utilize the Chrome Extension, and if I had time to properly implement it.

Challenges I ran into

I would say the largest challenge overall was when I was stuck and reading through what the AI spat out and had to fix it by hand, as well as when the AIs did not necessarily understand my prompts and my train of thinking. It is hard to explain something to a human let alone a machine without a human train of thought.

Accomplishments that we're proud of

I am super happy that I got the server to export data from Google data to MongoDB, yes I could not get far enough to create a website that held all the analysis that I wanted, but I still worked through several issues with server configuration, and in the end, I got it to work and export the data of the extension usage the way I intended.

What I learned

I learned that while yes AI is great it is not yet completely free for the very best versions and that you will still have to sift through information and understand it. But AI is also a useful tool if you know how to utilize it. Now I also learned that making extensions secure by not exposing the API keys is important in the case that the API is not ready or expectant of such a big load of requests from users.

What's Next for True-Sight Translator: Words to Reality

The next step for True-Sight Translator is to complete the 'Easter Egg analysis' that I had spent 5 hours on and still had crumble and fall. From there I would most likely switch to Bing images for the images and have an option to refresh for a different set of images. Here is the link for my submission and judging: https://vimeo.com/1059440735/1549a3f693?share=copy

Built With

Share this project:

Updates