Sketch Game

Cultivate and grow datasets using lively games.

Comment

Inspiration

The inspiration for this project comes from a documentary on police sketches in criminal investigations. I came across a database named the CUHK database of faces. The CUHK database holds original photos and sketches made by pencil artists. I wondered how we could make this database more voluminous and diverse in the faces and sketches existing.

What it does

SketchGame is a generative adverserial network built into a game and created to make you question how much emphasis you should put on your visual perception of things. The Gan, aptly named Gannis, takes an input and generates a sketch image version of it; It then uses the sketch to draw its own version of the image and outputs all 3 images side by side. The user is then asked to determine which is fake and which image is real.

How we built it

This project was built using fastai, heroku, dash, pydrive and python. It was built across 3 platforms.

Challenges we ran into

  • The Size of the model being outputed by fastai in kaggle was and still is a major issue i am trying to resolve. The model is too big for the free tier slugs in heroku.
  • I am struggling to implement the pydrive store function in google drive due to the size of my application exceeding the ram size of the network made available for free on heroku. I am attempting to reduce the model's size currently.
  • First time ever using fastai, the learning curve has been insane. There is still so much to learn.

Accomplishments that we're proud of

  • Built this project in 2 weeks because i was ill for the better part of the first 2 weeks.
  • Coming up with this idea and executing it to the best of my ability. ## What we learned Machine learning is fun! Keep going no matter how bleak things may seem.

What's next for Sketch Game

  • I hope to add some functionality which enables people to download the cuhk database directly from the platform.
  • A logical progression is the real time sketching of possible representations of a missing individuals face, because when trafficking occurs the first thing which is done is changing the victims appearance. Face databases and GAN's can help create different representations of how people might look with different adjustments made to their appearance.

Built With

Share this project:

Updates