After brainstorming on Friday, the best parts of several ideas (image processing, augmented reality, etc.) were put together to create the final product.

What it does

  1. Take a selfie on the phone!
  2. The selfie will be sent to a server for processing using OpenCV to identify the person in the image
  3. The image is sent back to the phone with just the person's cutout as a png and the user is ready to be transported to a whole new world!
  4. Select one of our destinations to travel to
  5. Ta-Da! You've made it. Swivel the camera around to view the entire area and where you want to position yourself for a photo.
  6. Want to keep the memory? Take a screen shot & save your adventure :)

How we built it

We started with the foundation on react native so that the app could be run on both android and ios. As we got into the project, we realized that the phone did not have enough processing power to isolate the person in the image. We offloaded that process to a computer using JavaScript, fetch, and tcp to run the file in Open CV. Once the image was processed, the new image was sent back over as a JSON to be placed over the google maps streetview portion of the app. From there, we used the magnetometer to move the streetview around so you could save the selfie to the camera roll at your desired location.

Challenges we ran into

One of the largest challenges we faced with having to adjust the scale of our application. At first, we wanted to overlay the live video of the user and put them into streetview. As our time came to a close, we ended up settling for an image overlayed on streetview, which is still really cool!

Accomplishments that we're proud of

A finished product! Seriously, this took a lot of work & we're really proud of the fact that all of these difficult concepts were combined into one.

What we learned

React-Native does not play well with fetching from a server if you are trying to avoid blobs. We finally overcame the challenge by changing the file format that was being sent to and from the server.

What's next for FAKE-A-tion

For our team - Sleep! In the future, however, it'd be awesome to incorporate the live video.

Share this project: