To face various challenges, we use different state-of-the-art AI techniques. With our multinational team with distinct background knowledge, we were able to find effective approaches to create solutions. Furthermore, we tested our code on actual camera data to verify the functions.
For better precision, we propose the object highlighting combined with haptic feedback to make the operator have better contact with the object. With object segmentation, it can be expected to give a better depth and distance perception. Also to assure that the operator can concentrate on doing his work we have developed a Pedestrian Detection. A haptic chair is also a possible solution for the dizziness caused by unmatched brain-body perception. We have also established physical enhancements like sensor at the crane arm to get more date to be able to make more precise movements.