Inspiration

We got inspired by Draw and Guess games, but wanted to do something where you learn about culture with music and paintings alone or with your friends, a gamified fun learning app.

What it does

  • you reveal a well known painting/picture by revealing with your hand-tracked brush different layers by painting it with colors you choose. At the same time when you paint you also hear music layers of a famous music piece. -The aim is to guess the name of the painting and the music piece. You can play alone or with other people.
  • once you finished 80% of a painting layer you can go to the next layer to reveal. The better you finish revealing a layer the better the music layer is heard. If you paint into other layers then the music will get distorted the more falsely you paint. So you are better in correctly painting in a double sense. But with each new layer the music distortion resets.
  • You see tipps about the painting and the music, which might help you guess their names as well (and you might learn some fun facts about those as well along the way)
  • You and your friends can all the time guess the name of the music and the painting by saying the names.
  • Also as an option you see letters appear of the names of the music + painting with every solved layer you painted. So at some later point its really like doing a Wheel of Fortune word Puzzle guessing. We dont want frustrated players who just happen to not know this painting or music piece.
  • in the end you hear the full music and see the full painting in your own colored version
  • 1 round takes around 2-3 minutes. We have used 8 layers for the painting and the sound, this can vary.
  • the winner takes the painting home and is listed in the highscore.
  • then choose another combination of photo and music and start the guessing again (if multiplayer) or get a new combination to guess.

How we built it

with Unity and fmod

Challenges we ran into

  • using speech recognition and only filter the real words when they are fully correctly spoken
  • reveal-painting on a canvas with 2 brushes and a good live performance
  • Passthrough in combination with transparent layers.
  • combining music and drawing is a challenge but we tried a lot

Accomplishments that we're proud of

  • making the speech recognition work well enough in most cases (still need some more work)
  • making the music in layers from original music files and then finetune and well-distorting it - our composer really knows it inside out.
  • custom shader scripting for performance painting
  • painting and music in combo to feel natural as feedback from what you do.

What we learned

  • custom shaders for drawing

What's next for Reveal & Guess

  • UI & UX
  • test and re-work what sticks best with a bigger audience
  • more pictures + music - maybe even uploading of own photos and auto-creation of layers to make it more fun for a general audience
  • combining different pictures and music
  • multiplayer with highscore and possibly a buzzer system: you buzz then all pauses and you have some seconds to say the name.

Built With

Share this project:

Updates