Potential of Head-Mounted Computers and Robots

• 

  Robot with MR

Inspiration

Since we ultimately die in reality, we cannot ignore real. We love anything that increases our chances of survival in the real world. How can we turn head-mounted computers into tools that enhance our chances of survival?

What it does

I thought that one possibility is collaboration with robots

How we built it

Using Passthrough + RoomMesh with Quest, we measured the world. The position information of the pointed location is transferred to the PC via the Fishnet API. The PC simulates the robot moving to that position and transfers the angle information of each joint to the robot via USB.

Challenges we ran into

Our main business is VR software development, and we usually create VR training for dangerous tasks. Therefore, there were no particular issues with VR software development. However, this was our first time programming a robot, and we had a lot of trouble getting the robot to move correctly.

Accomplishments that we're proud of

The integration of VR and robots is not a world first. However, many robot developers employ a "master-slave" approach. We believe that what customers truly desire is not merely moving a robot's hands like their own, but rather achieving the result of "taking something and handing it to me." As far as I know, systems combining robots and VR developed in this manner are relatively uncommon.

What we learned

ROS(OS of how to move robots）

What's next for Potential of Head-Mounted Computers and Robots

Currently, I'm working on an initiative to "enable humans to marry and reproduce." Many of you are probably familiar with apps like Tinder, which are used mainly by "extroverts" and can be challenging for "introverts." Most engineers fall into the "introvert" category. I'm exploring ways to create systems that encourage more conversations, connections, marriages, and reproduction. Of course, if XR seems suitable for this, I'd like to incorporate it.

Built With

• fishnetapi