GoofyGiphyCamera

• 

  Keynote Pitch

• 

  iOS Icon

Inspiration

• You can search for images with words (Google Search)
• You can search for words with images (Google Image Search)
• Why can't you search for images with images???

What it does

• Translates camera image to Giphy search query using Core ML Image Recognition
• Keep tapping your screen to add more GIFs!!!

Controls

• Long Press: Switch camera mode
• Shutter button: Take photo (and load first GIF)
• Tap: Load another GIF
• Shake phone: Clear photo & gifs, go back to camera mode

Best at detecting

• Computers
• Sunglasses
• Sneakers
• Water bottles
• Pill bottles
• Phone/iPod
• You tell me.....

How I built it

• AV Foundation for building custom camera view
• Inceptionv3 for object recognition model ported to Core ML
• Alamofire and SwiftyJSON for calling Giphy API
• SwiftyGif for displaying GIFs

Challenges I ran into

1. What to do with inaccurate predictions (just show 'em all!!! It'll be fun!!!)
2. Sometimes hit Giphy's API rate limit after just a few calls (likely too many other hackers were calling their API from the same IP address)

What I learned

• Classifying images using Core ML/Vision APIs
• Using Giphy API
• Creating customize-able camera module

What's next for GoofyGiphyCamera

1. Allow the user to select from top 5 predictions
2. Social Sharing
3. Use BulletinBoard context cards to add on-boarding tutorial (not needed now -- will be doing hackathon demo in person)
4. Publication on Apple App Store

Built With

• coreml
• giphy
• swift