Santoku

A gesture-based tool that enhances productivity across the three virtues adding a new dimension to interaction. Santoku bridges modes of interaction, minimizing interruptions and maximizing efficiency

Comment

Inspiration

Santoku was born out of my obsession with becoming a power user. Integrating powerful tools that take a lifetime to master into my workflows so that I can work towards becoming the greatest programmer I can be, with a holistic understanding of powerful tools like VIM, BetterTouchTool, Mac Scripting/automation, and tiling window managers. I believe user-friendly and beginner-friendly are two separate ideas, as the most powerful tools often have a significant learning curve. Vim is a tool with a significant learning curve but provides the immense power to their users. Santoku attempts to bridge the gap between being user-friendly and beginner-friendly and aims to incrementally increase productivity and ease of use for any type of user.

What it does

Add a new dimension to productivity. Control the computer with user customizable hand gestures.

How I built it

Blood sweat and tears.

  • Python
  • Qt cross platform desktop application framework
  • Google Media Pipe
  • OpenCV ## Challenges we ran into
  • Learning a new frontend framework
    • I am a perfectionist when it comes to frontend so I spent quite some time getting it to be how i wanted it to be.
    • Turns out the frontend framework was just a prototyping framework like figma
    • Convert all of the frontend code to be compatible with pyQt.
  • Mac os is very stingy with the camera permissions. ## Accomplishments that we're proud of
  • I did it all by myself
  • I gave somebody else an idea at the start of the hackathon and their team ended up using it. ## What we learned
  • Computer vision
  • Landmarks analysis
  • Machine learning ## What's next for Santoku ## Expanded Ideas likely not included due to time limitations
  • Make full tiling window manager controlled by camera based gestures.
    • Issue, these actions are not always advantageous to initiate when you are away from your computer
  • Add voice activation as well
  • What if I could somehow initiate a visual selection with gestures.
  • Easter egg, show a picture of rick ross. and launch youtube and get rickrolled.
  • Probably implement more unique gestures
  • Ideally programmable gestures.

Gestures

  • Ideally pinch and move up or down.
  • A-Z (excluding j and c)
  • Closing window with big X from arms
  • Opening hand
  • Closing hand
  • Close eyes for 1 second, twice.
  • Middle finger quit active app would be funny
  • Thumbs up
  • Thumbs down
  • Peace sign
  • Eyebrows up
  • Eyebrows down
  • 1 hand vs 2 hands. #### Actions
  • Open app switcher
  • Left application
  • Right application
  • Split window in half left.
  • Split window in half right.

Built With

Share this project:

Updates