FN(kineticX)

Arm Rehab starting position
Arm Rehab ending position, connects motion to the robot's arm
Raising arm to control the robot's arm
Robot with RPi Camera attachment for AR gameplay
AR using opencv : overlay enemy with HP

Inspiration

Having met several patients who previously sustained injuries from accidents and had to go through physiotherapy, we understand that the rehabilitation experience can be too mundane and be really demoralising for the patients.

What it does:

We aim to help patients recovering from their injuries by incorporating the game element into the therapy/rehabilitation experience. We hope that by adopting gamification with Augmented Reality (AR) will help to make it a more interesting and fun way to help the patients get better.

How we built it:

We used Arduino and 2 servos to create the prototype robot. We also used aluminium foil that will be worn on the body to act as a controller for the robot by transmitting information through simple hand and leg motions. We further attached a Raspberry Pi to the robot for the user to get a peripheral vision of the robot through a monitor where augmented reality elements are incorporated using OpenCV.

Challenges we ran into:

Creating the prototype with the limited materials and time we had. Getting the different parts together for the prototype was also very challenging as we did not have the necessary items. As this is our first attempt at AR and OpenCV, we ran into some complications while setting up the software and introducing the AR element.

Accomplishments that we’re proud of:

The hardest and most satisfying part was establishing the connection between the robot and the user - the transmission of information to the robot when the user moves and also the robot sending back visual information back to the user with augmented reality.

What we have learned:

How to work with Arduino, Servos for the creating of a working prototype and using OpenCV and Machine Learning to deal with image recognition and creating AR.