AgentJarvis: Your Personalized Autonomous AI Assistant

AgentJarvis is a Personalized Autonomous AI Assistant that learns your routines, plans your day, and adapts to your lifestyle—creating a digital version of you.

It doesn't just tell you what to do — it builds your daily plan, waits for your approval, and keeps everything running smoothly with reminders, insights, and motivation.

Over time, it becomes your AI Chief of Staff — it learns your habits, energy levels, and personal goals.


🧩 Story

👤 Meet Mark — VP of Sales at NVIDIA

Mark's days are packed — gym, client meetings, reviews, and family time.

Each morning, AgentJarvis reviews his calendar, emails, and preferences to prepare a personalized plan:

🗓️ Daily Plan — Approve or Modify

1️⃣ Gym at 5:30 AM – 45-min session (Motivation: "Consistency beats intensity.")
2️⃣ Order Protein Shake from your favorite nutrition app
3️⃣ Meeting Summary – Key notes and actions ready to review
4️⃣ Lunch Option: Paneer Sandwich from Panera – Confirm or Change?
5️⃣ Client Email Review: Draft replies ready for approval
6️⃣ Team Meeting: Slides available in SharePoint for 3 PM sync
7️⃣ Family Dinner: Reservation at myChef restaurant, 6 PM

Mark can approve ✓ or adjust each item before the day starts.

Once confirmed, AgentJarvis manages schedules, reminders, and even adapts automatically if plans shift — like rescheduling the gym or ordering food on the go.


🌇 End-of-Day Reflection

At night, AgentJarvis sends a personalized summary with motivation and stats:

"Progress is the product of small, consistent wins."
🏋️‍♂️ Steps walked: 7,820
🔥 Calories burned: 520
🍔 Calories consumed: 1,780
🕒 Meetings completed: 4
📧 Client emails reviewed: 5
🍽️ Family time logged: 1 hr
Productivity score: 93%

It celebrates achievements, highlights missed items, and sets gentle nudges for the next day — helping Mark stay balanced and productive.


🌍 Vision

AgentJarvis grows smarter with every interaction — learning from your confirmations, habits, and corrections.

It carries your preferences as a portable personal agent, and over time becomes a true digital twin that plans, prioritizes, and motivates — just like you would.


🧠 One-Line Summary

AgentJarvis — your AI that plans your day, tracks your energy, and keeps your life perfectly in sync.


⚙️ How We Built It

AgentJarvis is powered by NVIDIA NIM microservices and deployed on Amazon EKS.

It combines reasoning, retrieval, and orchestration to act as a truly personalized AI Chief of Staff.

  • 🤖 Reasoning: Llama-3.1-Nemotron-Nano-8B-v1 NIM for intelligent task planning and conversation
  • 🔍 Retrieval: NVIDIA NV-EmbedQA-E5-v5 NIM for RAG pipeline indexing emails, calendar, and meeting transcripts
  • 🧠 Orchestration: Python FastAPI backend coordinating agentic workflows
  • 💻 Interface: Streamlit dashboard with real-time Gmail and Google Calendar integration
  • ☁️ Infrastructure: Deployed on AWS EKS with Kubernetes orchestration

🚀 Accomplishments We're Proud Of

  • Built a fully working autonomous agentic system with real Gmail and Calendar integration
  • Delivered a seamless "Morning Brief" experience for busy professionals
  • Deployed successfully on AWS EKS using NVIDIA NIMs for both reasoning and retrieval
  • Implemented RAG pipeline with ChromaDB for context-aware planning
  • Created a project that feels personal, practical, and genuinely useful

📚 What We Learned

  • Agentic architectures work best when tasks are modularized and autonomous
  • Retrieval-augmented generation (RAG) keeps the assistant grounded in real-world context
  • NVIDIA NIM microservices enable rapid deployment of production-ready AI agents
  • Small, focused agents are easier to debug, explain, and evolve than one giant model

🔮 What's Next for AgentJarvis

  • Add Outlook and Slack integration for enterprise users
  • Integrate wellness APIs (Fitbit, Apple Health) for deeper health tracking
  • Extend to mobile and voice-based daily updates via Alexa/Google Home
  • Build adaptive learning that evolves with each user's lifestyle patterns
  • Offline mode with local LLM for privacy-sensitive users

AgentJarvis — Your Personalized AI Chief of Staff. Plan smarter. Live better.

Built With

Share this project:

Updates