LingoLens

• 

  Home Screen

• 

  Questionnaire UI

• 

  Camera UI

• 

  Past Scores

• 

  Past Scans

• 

  Language Selector

• 

  Scan Result Screen

Inspiration

I was very interested in learning Spanish. I still am, don't get me wrong - but there was one thing that bugged the hell out of me - no course covered some random stuff that you find in your surroundings. This was the inspiration for my project.

What it does

It basically allows you to take a picture of your surroundings and analyses the objects and returns 3 that stand out the most. Gemini API analyses and returns a JSON response that contains 3 objects that are going to be stored in a local database along with the pronunciation guide and an example sentence which basically allows you to learn even more words as you go through it. It also allows you to listen to pronunciations using android's built in TTS engine. You can also take a quiz to test your expanded vocabulary.

How we built it

So basically I built this using Kotlin and Jetpack Compose along with Gemini API to process the data underneath.

Challenges we ran into

The major challenge was taking into account Gemini's limits as well as structuring the data for processing.

Accomplishments that we're proud of

I am very proud of the concept itself and see it as something that can come in handy for many individuals who are learning a new language.

What we learned

I've learnt a lot during this process. This basically is a very good demonstration of how powerful is the API.

What's next for LingoLens

I look forward to make it production ready and make it smarter and more efficient - possibly consuming a lot less tokens.

Built With

• camerax
• compose
• geminiapi
• hilt
• kotlin