Scarlet Agent

Sign-Up page
Sign-in page
Home page
Message-text page

Inspiration

College life is fast-paced, stressful, and fragmented across apps like Canvas, Google Drive, and Calendar. We wanted to create something futuristic yet practical: an AI-powered personal secretary that organizes assignments, finds resources, and even talks with you — so students can focus on learning instead of chasing deadlines.

What it does

Scarlet Agent is an AI agent hub that:

Pulls your assignments and deadlines from Canvas (or via scraper if APIs fail)
Analyzes assignment descriptions and finds relevant resources from Google Drive
Provides real-time updates via text, call, or voice conversation through ElevenLabs + Gemini
Stores data securely in an encrypted Snowflake database In short: it’s a student’s all-in-one AI assistant.

How we built it

We combined multiple agents — Gatherer, Orchestrator, Scheduler, and our new ResourceFinder — and linked them with Gemini for reasoning and ElevenLabs for natural conversation. We used scrapers when APIs fell short, integrated Drive and Calendar through OAuth, and set up Snowflake for secure data storage. On the front end, we built a sleek Streamlit interface inspired by Rutgers’ black-and-red aesthetic, making Scarlet Agent feel futuristic yet intuitive.

Challenges we ran into

This project tested us at every level:

Canvas API was inaccessible, so we engineered a extension which is a custom scraper to extract data.
Gemini rate limits capped replies, so we restructured workflows to optimize requests.
ElevenLabs integration with Gemini was tough — we debugged streaming voice-to-text and back for hours.
Snowflake database caused major hurdles with encryption and structure, but we fought through it.
Countless API errors at 3am tested our patience — but every blocker became a breakthrough.

Accomplishments that we're proud of

We didn’t just build a prototype — we created a working AI ecosystem:

A functioning multi-agent system with voice and text communication
Successful Canvas scraping without API keys
Real-time resource-finding in Google Drive
A modern, responsive interface that feels like the future of student productivity Most importantly, we transformed challenges into strengths, showing we can innovate under pressure.

What we learned

This project pushed us to master:

API integration and fallback strategies (scraping when keys fail)
Voice + AI agent pipelines using ElevenLabs and Gemini
Encrypted cloud storage with Snowflake
Building resilient systems that don’t collapse when one piece fails
The value of persistence, adaptability, and creativity in problem-solving

What's next for Scarlet Agent

Our vision doesn’t stop here. Next we will:

Integrate directly with Canvas LMS APIs for seamless assignment management
Expand to other LMS platforms to make Scarlet Agent universal
Add a dedicated “virtual secretary” phone contact for quick calls or texts, just like calling your school secretary
Continue refining our AI agents so students everywhere can focus less on stress and more on success