SpecFind

Using the AR capabilities of the Snap Spectacles and location data via bluetooth, we were able to add a new feature to the Spectacles: Accurate and location information of all your Snap friends.

Comment

Inspiration

We were inspired by talking to the Snap spokespeople, they really sold us on the idea of using spectacles in day to day life and it sounded like a really cool and fun project!

What it does

It takes location data via bluetooth transmitters to triangulate the location of a person, this location is then fed into the script on the spectacles that allow the position of that person to be shown in 3D in real time.

How we built it

We used Lens Studio to build the entire functionality of the spectacles, everything from graphic design to user defined functions can be done inside of Lens Studio. The backend was integrated via a web hook, and Bluetooth receivers and transmitters. There were 3 transmitters to get around the issue of duplicate positioning, allowing us to locate any Bluetooth device withing 10/15m of our setup.

Challenges we ran into

As none of this was integrated into the spectacles already, a lot of it was pure software design on our end. We had to create our own 2D cartesian plane in the Spectacles to be able to draw in our location for the part. This took a lot of time to understand and build as there had to be many considerations and it was our first time working in a 3D space like this before. There were issues getting Bluetooth setup as well as connectivity could be weak or the device not being recognized.

Accomplishments that we're proud of

Building a workaround for the Spectacles. Originally the Spectacles are not able to share/receive location data from others, we built around this to show that a feature like this is possible, useful, and needed in the modern AR world.

What we learned

We learned how to use Lens Studio, basic typescript, and how to program devices together in new ways.

What's next for SpecFind

Integrating it into the regular Spectacles library of features so it does not just stay as a "games" device, to show people they can use it for its utilities and social gatherings too. Spectacles are paving the future of the AR space and we hope to ride along with it!

Share this project:

Updates