Flight Simulation

Inspiration of innovative ways to control the flight

Our main goal was to introduce new and innovative ways to control an aircraft. The thought process behind this was to use such techniques that could minimize human error by giving out better control strategies for the pilot.

What it does

This project uses the position of the hand to control the elevation and pitch of an aircraft. Other controls like air/wheels brake, throttle, and rudder movement are controlled by voice recognition. It also gives voice feedback to confirm the functionality it is going to apply.

How we built it

We have used OpenCV to detect the hand movement from the live video feed. After detection of the movement, it dynamically maps it to the input for the aircraft. The x-axis movement is used for elevation while the y-axis movement is used for pitch angle. Apart from that, the speech recognition library for python was to take voice commands and perform the relevant functionality. All the simulations were performed using xplane 11 simulator.

Challenges we ran into

Mapping the hand movement input to the pitch and roll for the aircraft was a challenging task. We have to approximate all the limits according to the simulator's input range.

Accomplishments that we're proud of

We successfully controlled the aircraft using hand motion. The voice recognition feature is also working as expected.

What we learned

Through this problem statement, we not only were able to learn about aircraft simulations, but we gained a lot of information about the challenges and complexity of controlling an aircraft.

What's next for Flight Simulation

Our future prospect is to make it more user-friendly so that it could fulfill our major aim of reducing human errors and making things easier for pilots to fly an aircraft.