FormFriend

New country, endless forms, confusing language? FormFriend translates, simplifies, and guides you, so you can enroll, apply, and access what matters. Let’s make paperwork painless, one form at a time.

Comment

Inspiration

For generations, families have struggled to navigate complex bureaucracies, from handwritten forms to digital PDFs, especially when faced with unfamiliar language, confusing terms, and unclear document requirements. Today, immigrant families continue to face these same barriers when filling out official forms for school, healthcare, immigration, or taxes. Despite advances in technology, many still lack access to tools that translate, explain, and assist in real time — especially in their native language. As a result, vital services remain out of reach for those who need them most.

What it does

Upload or take a picture of any official form and FormFriend will instantly:

  1. Translates the entire document into the users’ language, not just word-for-word, but in a way that makes sense.
  2. Provides step-by-step guidance on what additional documents are needed and what information to fill in.
  3. Explains specific technical legal terms so users know exactly what’s being asked.

How we built it

We built our innovative platform inspired by a variety of groundbreaking technology. We used Optical Character Recognition (OCR) to extract text from uploaded images or scanned PDFs. Gemini AI helped us to determine required documents. Deep Translator provided accurate and context-aware translations. OpenCV and image processing were utilized to detect blank fields users need to fill. We created a Tkinter-based GUI for local testing, later converted into a Flask API backend, ready to connect with a React frontend hosted on Vercel.

Challenges we ran into

  • Figuring out how to integrate the Gemini API keys into our code
  • Detecting blank fields on forms with different layouts
  • Building a full-stack application from scratch and connecting the frontend and backend
  • Ensuring that the translated language remains translated throughout the platform

Accomplishments that we're proud of

  • Learned how to integrate full stack development
  • Learned how to develop OCR, how to integrate APIs
  • Created a tool that can translate and guide users through legal forms in multiple languages
  • Built an interface that is both user-friendly and AI-powered

What we learned

  • Full-stack development
  • Gemini for real-world applications
  • Handling API integration, secure keys, and data flow between services
  • Barriers faced by immigrant and multilingual communities when navigating forms

What's next for FormFriend

Moving forward, we plan to implement functionality that lets the user automatically fill out their forms by simply uploading their supporting documents like birth certificates, passports, etc. We will also add more languages to broaden the countries of origin that use our tool. In the future, users will be able to invite contributors such as other family members that may be in possession of the supporting documents and can upload them remotely.

Share this project:

Updates