----------------------------------------------------------------------
Damnnn ... my wrists really hurt :(
Almost everyone is on their laptop in today's Tech Driven world. Having your wrists in that strained position for too long can possibly lead to CARPAL TUNNEL & ARTHRITIS! Reference Link
----------------------------------------------------------------------
Problem: No Affordable, Accessible and Engaging Therapy
Therapy centers are: Reference Link
- EXPENSIVE💸: 4 weekly Therapy sessions in a month can set you back nearly $SGD 200!!
- BORING 💤: Current Repetitive exercises are simple too boring to consider going for
- NOT ACCESSIBLE⌚: People are too busy to even consider making time for Therapy
----------------------------------------------------------------------
Inspiration and What it is: The What If's ...
What if we made an EXTREMELY LOW COST, GAMIFIED THERAPY WEB APP with AI!! You could play ANY online game in the world using doing therapeutic hand gestures, easing your minds and wrists at the same time :)
- Accessible: We went with a Web Based deployment as you can use ANY device with a camera (Smartphones, Tablets, Laptops obviously). No Fuss of Hardware, No Fuss of Downloading.
- Very Fun and Engaging: The unique ability to play ANY online game in the world gives a fresh outlook for potential therapy seekers
- Affordable: After surveying how much it costs to fully deploy our web app, we will only charge our users $SGD 1 a month!! YEAP! One Singapore Dollar a month.
----------------------------------------------------------------------
How its built and logic flow
- Step 1: We trained a custom deep learning Gesture Detecting AI model on 3600+ images
- Step 2: We coded the OpenCV inference back end: Main logic - Press Keyboard Key if gesture detected
- Step 3: We linked the web interface of the games with our OpenCV control with Flask
----------------------------------------------------------------------
Bumps on our "Developing Road"
The AI model was misfiring initially due to lack of training dataset. We implemented Augmented images and Dropout (better generalization of nodes in Neural Network) and VOILA! It worked like a charm. Another problem we faced was the major input lag, from a doing a gesture and the game character moving. We took things step back, made the backend code more efficient and then re-tried to link the Web interface with Flask. Worked like a charm :)
----------------------------------------------------------------------
What we're happy about
As of writing this project outline, my team and I have worked nearly 21 hours non stop, paired with a BAJILLION cups of coffee. We honestly are quite pleased with ourselves for simply managing to complete nearly 2000+ lines of python code. We didnt expect the project to turn out as well as it did. Superb effort!
----------------------------------------------------------------------
Learning Points
We used technologies we had never used before. From hosting a real time OpenCV window on the web to using Flask Framework for the first time.. I think all the knowledge we gained from this hackathon will greatly benefit our future projects.
----------------------------------------------------------------------
What's next for Team Junior Ghosts
We have a gut feeling that this idea has major potential to take off as a Startup 👀. We would like to reach out to any judge among the Judges panel to mentor us. We will go door to door, to therapy and wellness clinics in Singapore, to better understand patients needs, and implement them in due time. Also World Domination 😈😈
Built With
- ai
- detection
- flask
- html
- javascript
- opencv
- python
- tensorflow
Log in or sign up for Devpost to join the conversation.