Friends were bragging about their amazing management skills. How good they were at communicating, at being the admirable leader, at solving problems with a group. But as soon as we entered the escape room, they all turned into headless chickens.
What it does
It's a natural human thing not to practice what you preach. Often it's not because people want to lie, but simply because they don't know themselves well enough. Surveys and interviews can only give a very biased and limited view of oneself and others. PATMA, the Personality Assessment Tool, powered by Mixed Reality via AI, allows you to go through different challenges alone or with a group. As you complete the challenges (games), the AI analyses and interprets your personality traits based on the latest personality assessment research, directly feeding you with personalised AI-generated in-game quests to further clarify your personality traits and teach you how your actions align with your personality. A final report based on your preferences is provided for your post-game self-reflection or for corporate purposes such as
- Increase self-awareness
- Improve analytical thinking . Improve communication
- Increase teamwork and commitment
- Meet employees' emotional needs
- Improve performance
- Increase transparency
AI also removes the subjective judgement of psychologists, saving companies money and time by not having to send employees or prospective employees to facilities such as escape rooms and have them analysed by a professional.
How we built it
This project is an advanced Mixed Reality application developed in Unity, leveraging Meta’s Building Blocks to create a XR environment. The foundation of the interaction system is built around hand tracking, enabling intuitive, natural manipulation of grabbable objects within the passthrough environment. By integrating these dynamic components, we crafted an immersive experience for participants in a personality assessment experiment.
We incorporated interactive UI canvases, each featuring adaptive displays that respond to user behavior during the assessment, providing real-time feedback. A core element of the experiment involves a 3D object, designed as a disc, which facilitates bi-directional communication between participants—allowing for information exchange within the immersive environment. This interaction simulates collaborative problem-solving tasks, further enhancing the experiential depth of the MR experiment. The combination of these systems results in a highly immersive and data-rich environment for analyzing participant behavior and interaction patterns.
Challenges we ran into
We wanted to implement a new light-recognition technology that would allow users to be further apart physically, while still being able to communicate through virtual elements and take full advantage of MR. The idea was to separate users using Meta Quest 3 by physical distance so that they could not communicate verbally. However, implementing a multiplayer setup with this new technology proved to take up too much time. So we decided to cut that out, much to the disappointment and understanding of some people.
Accomplishments that we're proud of
We are super proud of the whole team for working so hard and dedicated together. We are proud to have learnt so much and to have been part of such an inspiring hackathon. From a technical point of view, we would have liked to have created a more sophisticated product with more detail. But the latter is an improvement that will come with time and dedication. The first part can only be achieved by us, as fellow hackers, loving what we do and being together with new people.
What we learned
We learnt a lot of new technical aspects, such as that Meta Quest 3 has to be configured correctly, that our phones have to be in the right build mode, and the list goes on... We also learned how difficult it is to bring an ambiguous project to a brand new team of people who do not know each other from personal and technical point of view. But no betting no getting, so no regrets, just lots of new learning.
What's next for (PATMA) Personality Assessment Tool, driven by MR via AI.
The next step is to pitch the project at XR Hackaton 2024, Stockholm under the category: "Education" by Pearson. We hope to get some good feedback that we can use to develop the project further. Possibly we will pitch the idea to an HR assessment tool company to get them on board as investors. We strongly believe that the concept has it's value, but it needs a lot of work before it becomes a real educational tool that is more helpful for the users.
Log in or sign up for Devpost to join the conversation.