Scene Blocker

Inspiration

I had a very interesting high school to college background. While in college I am studying computer science, and I did have computer science classes in high school, my main activity was theater. I loved to act, but found the line memorization pretty difficult, especially when doing blocking with it. So when thinking about XR through education, I wanted to create something that fixed this aspect.

What it does

Right now, this prototype takes you through a preset scene. After calibrating, it goes through a series of slides with your line on them. You can adjust this panel with the lines at any time. It also showcases a path and marker for you to follow in order to simulate the blocking of the scene. When you finish speaking the line, a voice recognition system will listen for the last part of that line, and automatically switch to the next line, path, and marker. At the last line, it will move back to the first one.

How we built it

I used Lens Studio as the base to get it onto the spectacle glasses. I took heavy inspiration from 2 of the examples on the spectacles git hub, Path Pioneer for the blocking, and Public Speaker for the slides and voice recognition. For the rest of my scripts, I gave the Cursor LLM Access to my assets folder in order to create new scripts for other features and adjust existing ones. Then I put everything together inside of the studio view, and also added the assets and meshes needed for the marker and paths. I also created an original script myself, and placed all of the markers.

Challenges we ran into

By far the biggest problem was getting the markers and paths working. They didn't show up until after about 2 hours of tweaks, fixes and debugging. With the actual hardware itself, the Field Of View of the spectacles is not very big, so I had to adjust asset placements in order to get things working. The voice recognition system also takes a while to detect your voice and what you are saying, and can make waiting between scenes awkward.

Accomplishments that we're proud of

I am proud of my ability to learn new software and a new medium of development in such a short time, even with AI Assistance. I feel like I can now look through an existing project file and understand what is going on. I am also proud of myself for learning how a hackathon works in the general sense, as this is my first time ever doing an event like this.

What we learned

I feel like I learned a lot about Time management and development while making this project, especially how quickly one can come together with the right prep. It makes me want to do things like this more, even on my own free time not part of a competition.

What's next for Scene Blocker

While I would love to continue working on this and add more features, like having another person's lines being read or customizing the scene in lens, I won't be able to until the spectacles become commercially available. If I ever get access to these again, I will continue to work on it as I believe there is something really cool here.

Built With

• cursor
• github
• lens
• spectacles
• typescript