Sudoku Capture AR

Inspiration

I've always wanted to build an AR/VR game so people can more easily play/enjoy their favourite pastimes of solving puzzles - but free from the constraints/limitations of a small screen. Sudoku is played by millions daily, making it easily one of the most popular games out there - it seemed like it was a great place to explore how playing it in AR/VR could make it a more natural/fun experience!

What it does

This app allows you to play Sudoku in AR, enabled by Meta Quest's colour passthrough cameras, custom UI elements which can be repositioned/resized to the user's preference, to see and enter Sudoku grid answers/notes, as well as choose which puzzles they wish to play.

It allows you to play easy, medium and hard collections of daily released puzzles, as well as capture your own personal puzzle collections from the real world using Quest's cameras, custom AI models and computer vision techniques so real world Sudoku grids can then be played later.

Supports using hand controls or controllers, includes relaxing music, dynamic Sudoku board with animations, making it feel more alive in only ways AR can achieve!

How we built it

Custom built by a solo dev since hackathon launch, using the latest Unity version and custom trained AI models for detecting/capturing the real world grids.

Challenges we ran into

I didn't know any of Unity or Meta's SDKs so it's been quite the learning curve!

Accomplishments that we're proud of and what we learned

Bringing this combination of features together in such a tight timeline, and having it reach this level of development, is something I am very proud of. Learnt a lot, all of which will help me going forward.

What's next for Sudoku Capture AR

I plan to add in support for smaller 6x6 Sudoku grids, larger 10x10 ones, and all the other flavours of Sudoku that exist out there (Killer, Jigsaw, Sudoku X, etc)