Break down

Imaginary Friends' Drive Dreams is an in-car experience enabling users to discover and connect with the Cupra brand through immersive experiences.

Still unfamiliar to many, Cupra needs not just buyers but passionate fans. Targeted at modern tech-oriented people, the pre-sales experience should be more exciting by connecting users to the brand in playful ways, which results in more engagement. Engaged customers buy 90% more frequently and spend 60% more per transaction. Also, the after-sales phase can be enhanced with touchpoints throughout the car's lifecycle.

To whom

Potential buyers, and Current users and friends & family

From where

Either in the In showroom, In Cupra Events or While charging, camping, etc.

What it does

A portal allowing users inside the car to experience a virtual interactive world through the windows and windscreen.

Travel

Teleport to Barcelona, your favourite mountain, or even space to visualize traveling with your Cupra.

Game

Play with friends, compare scores, earn points to redeem for discounts in events or merchandise.

How we built it

  • Created an occlusion model for passthrough, using car windows and the windscreen to interact with the virtual world for a mixed reality experience.
  • Setting up the Meta Presence Platform SDK for the passthrough, and hand interaction.
  • We aligned the occlusion model with the car by fitting the left touch controller into the center console and creating an offset, allowing us to track controllers and hands simultaneously.
  • The Virtual Travel Experience leverages Google Street View APIs to load panoramic views for any given coordinates.
  • Implemented Ball Blitz game using in-car occlusions and hand interactions.

Challenges we ran into

  • Creating a good occlusion model for the car was challenging. Initially, we used a custom model from a phone 3D-scan, but later switched to a similar 3D model provided by the hackathon team.
  • We used HandGrabInteraction for steering control due to hardware access constraints, but integrating the physical steering wheel would be awesome!
  • We aimed to utilize transparent materials (e.g., highlight steering wheel), but passthrough took precedence, making it difficult to combine.

Accomplishments that we're proud of

  • We tested our idea of changing different street view scenes inside the car and found it to be doable.
  • We aligned our game content with the car's layout, blending it with the in-car experience.
  • Teamed up, organized, and prototyped with our fresh crew to bring the idea to life on time!

What's next for Imaginary Friends | DriveDream

  • Generate a LIDAR scan of the interior or obtain precise dimensions from a 3D model to improve the occlusion model for enhanced immersion.
  • Experience music events like Concert, Festival or the Holly Circle Club in MR. Explore surroundings better with MR or enjoy interactive clue-games, and meditation.
  • Possibility to integrate Haptics inside of the car
  • add multiplayer functionality

Built With

Share this project:

Updates