Posturelytics.AI
Inspiration
In the age of remote work and online learning, posture and focus are often neglected—leading to long-term health and productivity issues. We wanted to build a solution that not only tracks how you're sitting but also gives you actionable feedback to improve your well-being while studying or working.
What It Does
Posturelytics.AI is a real-time AI productivity companion that monitors:
- Posture Quality: Detects if you're slouching or maintaining good posture.
- Attention Tracking: Uses face orientation to detect if you're focused or distracted.
- Live Feedback: Warns users with spoken reminders if they slouch or zone out.
- Session Summaries: At the end of each session, users receive:
- AI-generated productivity feedback using OpenAI GPT-3.5.
- Analytics with charts showing posture score, session duration, focus trend, and a heatmap of posture strain areas.
- User Dashboard: View all your past sessions, trends, and track improvement over time.
How We Built It
Frontend
- Vue 3 + Composition API
- Vuetify UI Framework
- D3.js & Observable Plot for data visualizations
- MediaPipe Pose and FaceMesh for real-time webcam posture/attention tracking
- Web Speech API for voice feedback
Backend
- FastAPI for building robust REST APIs
- JWT authentication
- OpenAI GPT-3.5 API for feedback generation
- MongoDB Atlas for secure session storage
Key Features
- Real-Time Webcam Analysis
- Posture & Focus Visualization
- GPT-Based Personalized Feedback
- Posture Heatmap Visualization
- Secure User Authentication & Session Tracking
Challenges We Ran Into
- CORS conflicts between frontend and backend
- FastAPI + JWT integration took trial and error
- Speech synthesis inconsistencies across browsers
- Tuning MediaPipe models for accurate pose and gaze detection
- Designing a responsive yet accessible dashboard layout for data-heavy views
Accomplishments We’re Proud Of
- Successfully achieved real-time pose and attention detection with just webcam input
- Fully responsive analytics dashboard with meaningful insights
- Seamless end-to-end session flow from tracking → saving → visualization
- Integrated OpenAI to produce human-like summaries and improvement advice
What We Learned
- Vue 3 Composition API & component communication
- Integrating GPT-3.5 for contextual feedback
- Real-time video processing with MediaPipe
- Voice interaction using the Web Speech API
- FastAPI’s dependency injection and secure routing
- Structuring NoSQL databases for session analytics
- CORS and token-based auth in production-ready apps
What's Next for Posturelytics.AI
- Mobile app integration for posture alerts
- Browser extension for passive tracking
- Real-time leaderboard for productivity sessions
- Adaptive voice assistant using custom GPT prompts
Team
Srushti Sanjay Samant — Worked on frontend development using Vue 3 and Vuetify, implemented real-time charts with D3 and Observable Plot, designed the dashboard UI, and created a responsive user experience for posture and productivity tracking.
Himanshu Kiran Garud — Developed backend using FastAPI, implemented secure JWT-based user authentication, handled MongoDB data storage, and integrated OpenAI's GPT-3.5 API for generating personalized session feedback.
Built With
- css
- fastapi
- html
- javascript
- mediapipe
- mongodb
- python
- vue
Log in or sign up for Devpost to join the conversation.