The core idea is to leverage the gemini-pro-vision api capabilities for tracking daily calorie in-take. Me & my partner recently started a fitness training program where we need to take photos and document calories consumed for every meal. We have started using the gemini-pro-vision API for tracking our consumption. While not perfect, it gets does a great job most of times and we are left with minimal edits to do.

Function-calling is not yet enabled for this API, but we plan to save each meal to a db and integrate with google fit app which is where we track our movement. I think this would be game-changer for us as currently we have to do much of this manually.

Video URL: [link]https://youtu.be/CQT5PpnZqTE

Built With

  • collab
  • google-ai
  • jupyter
  • python-sdk
Share this project:

Updates

Submission history