MindFlux Game
MindFlux Dashboard
MindFlux Gesture

MindFlux: A Game with a Purpose

Inspiration

The inspiration for MindFlux came from our desire to bridge the gap between fun and meaningful interaction. We wanted to create a game that not only entertains but also challenges players to grow cognitively, emotionally, and physically. The concept of integrating hand gestures and emotion tracking into a modern twist on Simon Says was driven by a shared belief that technology can and should empower people of all abilities. Whether it's enhancing focus, improving motor skills, or offering therapeutic benefits, our goal was to make a difference.

What It Does

MindFlux is an interactive game where players replicate an increasingly complex sequence of arrows through hand gestures, keyboard inputs, or on-screen clicks. The game tracks performance, gesture usage, and emotional responses, providing insights through a detailed analytics dashboard. By combining gameplay with gesture recognition and emotion tracking, MindFlux offers both fun and an opportunity to develop skills in a highly engaging environment.

How We Built It

Frontend: We used React and TypeScript to design a dynamic, user-friendly interface. Players interact with the game seamlessly, while their progress is visualized on an analytics dashboard powered by Chart.js.
Backend: The backend is built with Python, using Mediapipe for real-time hand gesture recognition and DeepFace for emotion analysis. Data is processed and sent to the frontend for display and interaction.
Integration: To ensure smooth communication between the frontend and backend, we set up APIs to handle real-time data transmission. Local storage was also utilized for preserving player progress and insights across sessions.

Challenges We Ran Into

Gesture Recognition Accuracy: Ensuring precise hand tracking across various environments, lighting conditions, and user behaviors was a significant challenge.
Real-Time Performance: Integrating computationally intensive processes like gesture and emotion detection without compromising gameplay fluidity required extensive optimization.
User Experience: Balancing complexity with accessibility was a learning curve as we aimed to make the game engaging yet inclusive for all players.

Accomplishments That We're Proud Of

Successfully integrating Mediapipe and DeepFace to enhance interactivity and emotional engagement.
Developing a fully functional analytics dashboard that provides meaningful insights into player performance and emotional states.
Creating a game that is not only fun but also fosters cognitive and motor skill development, with the potential to assist in therapeutic and rehabilitative settings.

What We Learned

This project taught us the value of teamwork, persistence, and adaptability. We deepened our understanding of real-time gesture and emotion detection, learned how to optimize resource-heavy computations, and gained insight into designing inclusive and user-focused applications. Most importantly, we learned how powerful technology can be when driven by a purpose to create positive change.

What's Next for MindFlux

The journey of MindFlux is far from over. Here’s what we envision for the future:

Enhanced Gesture Recognition: Incorporate more complex gestures and improve recognition accuracy across diverse user demographics.
Multiplayer Mode: Introduce competitive and cooperative gameplay modes to enhance social interaction.
Mobile and VR Integration: Expand the game to mobile devices and virtual reality platforms for a more immersive experience.
AI Personalization: Use AI to adapt the game’s difficulty and provide tailored feedback based on player behavior and performance.
Research and Therapy Applications: Partner with therapists and researchers to explore MindFlux's potential in cognitive rehabilitation, ADHD assessment, and skill development.

MindFlux isn’t just a game—it’s our way of proving that technology can make a difference. We’re excited to see how far this journey takes us!