Gemini Navigator

Inspiration

Public service websites are notorious for being complex and user-unfriendly, leaving many users confused or unable to access essential benefits. Whether it’s finding tax filing steps on IRS.gov or booking a DMV appointment, users often abandon these services due to overwhelming layouts or navigation challenges. This disconnect creates a significant barrier to accessing critical public resources globally.

What it does

Gemini Navigator is a Chrome extension powered by Chrome built in advanced AI powered by Gemini (Prompt API) that transforms the user experience by dynamically retrieving relevant information from public websites in real-time. Unlike traditional keyword search tools or static chatbots, Gemini Navigator integrates directly into the browser, providing tailored, context-aware assistance to guide users effortlessly to the information they need.

How we built it

Gemini Navigator is built on a powerful RAG (Retrieval-Augmented Generation) architecture that crawls website data, chunks it into manageable pieces, and stores it in a Pinecone database for efficient retrieval. When a user enters a query, the RAG system extracts relevant content and sublinks, retrieves the most appropriate chunks, and sends them as context along with the user’s query to Google Chrome’s built-in AI, powered by Gemini. The AI processes this information to generate a precise answer, which is then displayed with highlighted sections for clarity and easy navigation. Key Element.

Website data is crawled, chunked into manageable pieces, and stored in a Pinecone database.
User queries are processed to retrieve the most relevant chunks of information.
Google Chrome’s built-in AI analyzes the content and user query to generate accurate answers.
The results are displayed seamlessly in the Chrome extension with relevant sections highlighted.

Challenges we ran into

Ensuring compatibility across diverse public websites with inconsistent structures.
Managing large volumes of web content while maintaining quick response times.
Balancing user privacy with cloud-based processing for accurate results.

Accomplishments that we're proud of

Successfully integrating Gemini AI to process complex queries and deliver concise answers.
Developing a seamless user experience that empowers people to navigate even the most challenging websites effortlessly.
Achieving high retrieval accuracy for relevant information while maintaining data privacy.

Key Features

AI-Assisted Navigation: Uses RAG to dynamically retrieve up-to-date data from websites.
Browser Integration: Runs as a lightweight extension on Chrome and Opera, requiring no modifications to the target website.
Global Compatibility: Adapts to any public service website structure, ensuring worldwide usability.
Multilingual Support: Leverages browser translation tools to assist users in their preferred language.

What we learned

The importance of a user-friendly design to reduce the friction of adopting new tools.
How RAG architecture can significantly improve information retrieval and user satisfaction.
The critical role of real-world testing in understanding user pain points and refining the tool.