Posturelytics.AI

Inspiration

In the age of remote work and online learning, posture and focus are often neglected—leading to long-term health and productivity issues. We wanted to build a solution that not only tracks how you're sitting but also gives you actionable feedback to improve your well-being while studying or working.

What It Does

Posturelytics.AI is a real-time AI productivity companion that monitors:

  • Posture Quality: Detects if you're slouching or maintaining good posture.
  • Attention Tracking: Uses face orientation to detect if you're focused or distracted.
  • Live Feedback: Warns users with spoken reminders if they slouch or zone out.
  • Session Summaries: At the end of each session, users receive:
    • AI-generated productivity feedback using OpenAI GPT-3.5.
    • Analytics with charts showing posture score, session duration, focus trend, and a heatmap of posture strain areas.
  • User Dashboard: View all your past sessions, trends, and track improvement over time.

How We Built It

Frontend

  • Vue 3 + Composition API
  • Vuetify UI Framework
  • D3.js & Observable Plot for data visualizations
  • MediaPipe Pose and FaceMesh for real-time webcam posture/attention tracking
  • Web Speech API for voice feedback

Backend

  • FastAPI for building robust REST APIs
  • JWT authentication
  • OpenAI GPT-3.5 API for feedback generation
  • MongoDB Atlas for secure session storage

Key Features

  • Real-Time Webcam Analysis
  • Posture & Focus Visualization
  • GPT-Based Personalized Feedback
  • Posture Heatmap Visualization
  • Secure User Authentication & Session Tracking

Challenges We Ran Into

  • CORS conflicts between frontend and backend
  • FastAPI + JWT integration took trial and error
  • Speech synthesis inconsistencies across browsers
  • Tuning MediaPipe models for accurate pose and gaze detection
  • Designing a responsive yet accessible dashboard layout for data-heavy views

Accomplishments We’re Proud Of

  • Successfully achieved real-time pose and attention detection with just webcam input
  • Fully responsive analytics dashboard with meaningful insights
  • Seamless end-to-end session flow from tracking → saving → visualization
  • Integrated OpenAI to produce human-like summaries and improvement advice

What We Learned

  • Vue 3 Composition API & component communication
  • Integrating GPT-3.5 for contextual feedback
  • Real-time video processing with MediaPipe
  • Voice interaction using the Web Speech API
  • FastAPI’s dependency injection and secure routing
  • Structuring NoSQL databases for session analytics
  • CORS and token-based auth in production-ready apps

What's Next for Posturelytics.AI

  • Mobile app integration for posture alerts
  • Browser extension for passive tracking
  • Real-time leaderboard for productivity sessions
  • Adaptive voice assistant using custom GPT prompts

Team

  • Srushti Sanjay Samant — Worked on frontend development using Vue 3 and Vuetify, implemented real-time charts with D3 and Observable Plot, designed the dashboard UI, and created a responsive user experience for posture and productivity tracking.

  • Himanshu Kiran Garud — Developed backend using FastAPI, implemented secure JWT-based user authentication, handled MongoDB data storage, and integrated OpenAI's GPT-3.5 API for generating personalized session feedback.

Built With

Share this project:

Updates