LEIA PET

Inspiration

Many children and elderly people are bedridden, either recovering from recent surgeries or unable to walk. With this in mind, Leia Pet was designed to help this audience with immersive experiences focused on education and reliability. The idea of using cute animals came up because it is a perfect way to connect with children and adults.

What it does

We create immersive experiences with the purpose of transforming moments of tedium in a hospital bed into a magical moment of interaction, fun, and physical rehabilitation.

How I built it

Astha: I was inspired by the fact that living with a canine companion helps us mitigate loneliness, gives us a higher level of physical activity, and ultimately plays a role in our psychological well-being. I thought about how we can leverage XR to give people easier access to these awesome benefits. While there are some companion applications focusing on providing a fully sociable AI bot, we wanted to get creative and introduce some fun while testing the latest interaction capabilities. I tested the capabilities of the Pico neo 3 pro eye's passthrough and eye tracking with Ultraleap's hand tracking to create a mixed reality experience.

MJ: I was an uiux student who was interested in XR technology but had no experience, but after experiencing Pico's Neo 3 pro on the first day of the hackathon, I realized that VR leading me to a whole different dimension of the world with no limitations of creativity even my physical body was still in the same space. I thought that this would provide people with opportunities for entertainment that they had not seen before, and would lower the entry barrier for those who had reduced access opportunities due to realistic barriers. And I thought that this characteristic of XR technology exerts greater value, especially in relation to education and health. As it was my first XR project, I wanted to create a product that covered all the situations where the advantages of XR technology such as education and health can be well revealed. I designed an animation that shakes the body from side to side through the legging of avatars used in our team's product, and made an animation that opens with eyes closed through text sequence by using Blender, and provided users with abundant experiences with our team's product's avatars and hands tracking technology at TikTok effect house. In this process, I learned how to use TikTok effect house, which was the first step I took to make my own unique filter that I was usually interested in. These experiences have shown me a new world that I don't know where to start, and I'm sure will completely change my career.

Jamie/Celso: We used the brand new Lynx R1 that was released last week. Stan Larroque from Lynx mentioned in the workshop that this is the first opportunity for anyone to develop on the device or even use the device since its debut last week. This inspired us to use this new technology. The Lynx R1 is a mixed-reality device that provides AR and VR with hand tracking and eye tracking. The Lynx uses UltraLeap for hand detection. We used the UltraLeap to recognize 9 poses. In your left hand, it can recognize 4 Palm directions including Palm Up, Palm Down, and Palm facing right or left. On your right handed can recognize 5-finger poses. We built it to recognize pointing, peace sign, 3 fingers up, 4 fingers up, and rock N Toll with your index and ring finger extended. With these 9 recognizable hand movements, we wanted to immerse our users in an experience to

Challenges I ran into

One of the biggest challenges we faced was to combine all our ideas into a project that could help people and mobility. At first, the idea was to create something that could help blind people and their mobility and perception of the world. During the process one of our team partners had an emergency and had to return to his city, this made our entire project and subsequent priorities reassessed to be able to complete everything in time.

Accomplishments that I'm proud of

The opportunity to create something from scratch that has an impact on the health and education of children and elderly who have difficulty in locomotion. Also the challenge of learning new things together with amazing companies like PICO who worked closely with us and gave us input.

What I learned

Work as a team Adapt to the unforeseen Learning to use technologies we never used before (PICO, TikTok Effect House,)

What's next for LEIA PET

For our next steps, we want to expand the number of characters (animals) and create more in-depth educational and rehabilitative exercises, for example, some exercises related to breathing, stretching, etc. The idea of gamification of this project is also on our radar so that each exercise performed the patient receives a number of points that or take him to our phase of education or treatment.

Built With

• lynx
• pico
• tiktok
• uiux
• unity