Pencil!

Pencil! Art Lessons for Quest
Learn to Draw using Paper, a Pencil and a Mixed Reality Headset
Guided Lessons and Trace Tools to Learn Art Skills
Toggle opacity off and on as needed
Make your own still life scenes
Project the Scene onto the paper in realtime
Strike your own poses and be your own figure model
Learn to Draw with Pencil!

What it does

Pencil! teaches you how to draw using a Paper, a Pencil, and a Mixed Reality Headset. It overlays drawing guides and displays lessons onto a piece of paper to help you get started with drawing and helpful tips. The overlay functions like a virtual lightbox and can be toggled on and off

Inspiration

We were Inspired by traditional art instruction and existing drawing apps like Art Academy on the Nintendo DS

How we built it

We built it over 72 Hours for the Meta NY Presence Platform Hackathon 2024. We built it for Quest 3 Mixed Reality, using Unity Engine and Presence Platform to enable our particular spatial computing use case.

Challenges we ran into

The Depth API is does not have enough resolution to track the slim pencil as we had hoped Body tracking API and Multimodal input for hand and controllers are not yet compatible with each other

Accomplishments that we're proud of

We are proud of our applied use of XR tech combined with a physical medium of pencil and paper with success We are happy to be creating a tool that helps you a learn a skill and encourages people to put the pencil to the paper and start drawing.

What's next for Pencil!

Cleanup and Upgrade the app then ship it! We want people using Pencil to create more art, physical art. So we may start shipping No.2 Pencils and sheets of 8.5x11 inch paper to people who support Pencil ✏️❤️