Cal Pal

Cal Pal Logo

Inspiration

Cal Pal is an AR calorie tracker made in Snap Spectacles, a virtuous attempt to tackle obesity and food related diseases that affect our communities. Using Claude AI and Gemini, we’ve created prompts to give instant nutritional info to users to make healthier food consumption choices by tracking their calorie intake after asking questions about their age, biology and physical activity which then generates a data calorie goal for each user. Follow Cal Pal bunny and stay healthy!

Obesity is one of the largest problems in the world today. Apps have been created to help you track your calories, but when the decision is up to the user- how often are they opening up an app to track their calories as they reach for the cookie that they are craving? We aim to tackle this problem, witnessing the effect that this has had on my close friend's life (he then became diagnosed with diabetes at age 16).

What it does

As you walk into a dining hall or a party with food, Cal Pal recognizes each item and provides you a calorie amount. The interactive bunny will advise you whether to eat the food based on the way that it will help/hurt your goals. Cal Pal uses custom prompts that asks questions about user biology and physical activity which generates a data calorie goal for each user. Cal Pal's 2nd prompt scans food to determine calories which are then measured as healthy or unhealthy specific to user calorie goals. Come thru and stay healthy!

How we built it

We built this algorithm using Lens Studio. We learned the basics of Lens Studio and synced it to the Snap Spectacles, testing on basic demos/use cases. We used 8th Wall Asset Lab to generate the characters then revamped textures and animated them using Blender 3D. We used Gemini to create our smart calorie tracker.

Challenges we ran into

1) Incorporating the AI- started off with GPT and switched to Gemini 2) Using a touch based UI or a voice based UI

Accomplishments that we're proud of

1) Building a fully working solution 2) Our cute animated characters

What we learned

1) How to work with Spectacles 2) How to prompt engineer with Claude 3) How to animate characters in blender 4) How to incorporate an AI algorithm into Spectacle AR glasses 5) How to prompt engineer Gemini 6) How to design UI