Data Navigator

Inspiration

Millions of people have valuable data in Google Sheets, but don't know how to manipulate it (Pivot Tables, Apps Script, Query) to make quick decisions. Companies and managers waste hours on repetitive tasks such as cleaning, formatting, and analyzing data. Sheets is powerful, but it requires technical knowledge (formulas) or constant manual effort. 😫

What it does

The UI Navigator A Gemini agent that acts as a UI Navigator. It "sees" your open spreadsheet, "hears" your business needs, and "executes" changes directly in the interface. • Vision: The agent visually identifies patterns, typos, and outliers. • Voice: The user commands: "Gemini, consolidate March sales and generate an insight into the product that fell the most." • Action (Tool Use): The agent uses Google Workspace APIs to automatically create tabs, format cells, and generate charts.

How we built it

We were unable to build anything with Google tools because we didn't have access to the credits. We are certain it's feasible because we've implemented it on other servers, but unfortunately, due to this issue, we haven't been able to implement it.

I want to take this opportunity to state for the record that this method is very rigid, which impacted hundreds of teams in submitting their projects because it wasn't clear from the beginning that the use of Google Cloud was mandatory.

Challenges we ran into

It was a huge challenge to gain access to Google Cloud. A teammate spent money to get access.

Accomplishments that we're proud of

We are happy to be able to get Gemini to perform tasks that would otherwise take hours or an entire team.

What we learned

We learned about a variety of solutions that Google provides. Sensational!

What's next for Data Navigator

We are confident in trying to use our extension across all Google Workspaces tools (from Google Maps to Google Slides).

Built With

• gemini-2.5-flash
• gemini-multimodal
• google-ai-studio
• google-colab-enterprise
• jupyter
• python