AirMouse3D

Inspiration

Most computer interactions still depend on a physical mouse and a flat surface. During presentations, smart TV usage, or touch-free environments, this becomes inconvenient. While air mice already exist, they require dedicated external hardware, which increases cost and limits accessibility. We were inspired to explore whether a smartphone alone, something everyone already owns, could replace these devices using its built-in motion sensors. AirMouse3D was created to remove the dependency on extra hardware and make motion-based interaction more accessible.

What it does

AirMouse3D turns a smartphone into a wireless 3D air mouse that controls a PC using natural hand movements. By simply moving or tilting the phone, users can move the cursor in real time and perform mouse clicks using gestures. This allows touch-free and surface-free interaction with a computer.

Unlike traditional air mice, AirMouse3D does not require any external device. The smartphone itself becomes the controller.

How we built it

We built AirMouse3D using two main components:

An Android application that reads motion data from the phone’s sensors and detects click gestures.

A PC receiver that fetches this data from Firebase and converts it into system-level cursor movement and mouse clicks.

To ensure smooth interaction, we separated data fetching from cursor rendering. This design allows the cursor to move continuously even when network updates are irregular. We also applied motion smoothing and event-based click detection to make the interaction stable and responsive.

Accomplishments that we’re proud of

We successfully built a fully functional air mouse system using only a smartphone, without relying on any external hardware. We overcame real-time motion smoothing issues, handled network latency, and ensured reliable click detection. Most importantly, we demonstrated that everyday smartphones can replace dedicated air-mouse devices while providing a smooth and intuitive user experience.

What’s next for AirMouse3D

In the future, we plan to add multiple interaction modes such as mouse-like tilt control and presentation mode. We also want to improve precision, add scrolling and right-click gestures, and explore faster real-time communication methods. With further refinement, AirMouse3D can become a practical and low-cost alternative to traditional pointing devices.

Why AirMouse3D is different

Most air mouse solutions require external hardware. AirMouse3D eliminates this requirement by using only a smartphone, making it more accessible, cost-effective, and easy to adopt.