Magic Gesture Wand

Draw in the Air Magically using IMU and ESP8266

Comment

Inspiration

The Wand Chooses it's Wizard

This year marks 20 Years Anniversary for Harry Potter's Movie Series. To celebrate it we created a Magic Wand which Identifies Gestures and Puts it onto your screen.

As a child after watching Harry Potter, we all wanted that wand so why not make a magic wand now and fulfill our childhood dream.

What it does

It reads Gyro Data from MPU6050 Gyro/Accelerometer Sensor and sends it to PC using Serial USB Port, and on PC it reads that data and moves the mouse position using Python.

How we built it

It is divided into two parts Measuring Data on ESP8266 and Reading Data on Laptop

  • Measuring Data:
  1. Here we are using MPU6050 with ESP8266 to measure Gyro Readings in X and Y axis.
  2. MPU uses I2C to send data to ESP8266 and ESP8266 uses Serial Communication to send data to Laptop
  3. It sends data only when Button is pressed

The Circuit as Follows: MPU6050 SDA-> D2 , MPU6050 SCL-> D1 , BUTTON PIN -> D3 , And power pin to 3,3V and GND Screenshot-from-2021-05-09-16-11-32

  • Reading Serial Data and Moving Mouse:
  1. We are reading Serial Data using pySerial Library in python
  2. Then using pyAutoGUI library to send commands to move the mouse using Gyro Data of X and Y axis

Challenges we ran into

  1. We had trouble in reading data from MPU6050 due to loose connections
  2. Also while setting up PyAutoGUI we had trouble regarding Permissions to access the mouse.

Accomplishments that we're proud of

  1. Creating our Dream Magic Wand in Hackathon Period

What we learned

  1. Using MPU6050 IMU with calibration and plotting
  2. Reading data from Serial Port using Python
  3. Button interrupts

What's next for Magic Gesture Wand

  1. Hiding Wires and improving Aesthetics
  2. Adding Predefined Gestures to open Apps

Built With

Share this project:

Updates