Doctor Sandie

Home Page
Leaderboard
Store Page
Camera Features

Inspiration

We were inspired by Professor John Humphrey and we decided to his dog our mascot for our game. We were also inspired by retro style games such as older Pokemon games. We also wanted to make being healthy fun and competitive, especially for CS students.

What it does

Dr. Sandie is an AI chatbot where users can enter health-related questions. The user will receive suggestions and advice based on their health problem as a set of tasks to complete. Once the user completes a task they will earn a point which they can use to purchase items in the shop. In order to complete a task, users must submit an image showing proof of completion. Users can either upload an image or use their camera to take a picture directly through the game. The users will compete in a multiplayer setting where challenges are made public and other users can compete different challenges and different tasks.

How we built it

We started with a Next.js project for the front-end with a sample database from Convex for realtime updates as well as collaborative and multiplayer features. For the backend, we started by designing the schema for all the tables and the relations among them. Next, we wrote the API endpoint for requesting structured response from Google Gemini Flash 2.0 models and the leaderboard API for fetching the top 10 users. A simple authentication was implemented for persisting users' identity with their browsers' tokens. With convex, the front-end are automatically updated with their web socket server, making it a multiplayer experience.

Challenges we ran into

We faced issues with implementing the file storage for persisting users' proof of completion whenever the user finish a task. We tried using a few third party cloud services at first but eventually realize that Convex has their own file storage built-in for each database. Making the background store was also difficult to have different backgrounds for each user. We fix this by making a new table that manage these backgrounds instead of storing them among tables.

Accomplishments that we're proud of

Something we're very proud of is creating a user-friendly UI that makes our program feel more like a game intended to improve one's wellness rather than a medical website giving standard advice. We also are thrilled that we could create an engaging way of encouraging people to take care of themselves both mentally and physically. Adding multiplayer features along with game features such as a shop are accomplishments we didn't expect to complete in time, but managed to do.

What we learned

During this project, we realized the capabilities of Google's Gemeni which served as the base for our chat bot. Our team also learned about using Git has a team and the various steps that have to be done when multiple users are editing the code on a local branch. On an ethical level, we learned about the importance advertising our program as a wellness game rather than legitimate medical advice.

What's next for Doctor Sandie

In the future, we hope for Dr. Sandie to be more specialized in its created tasks. Currently, there are certain symptoms or conditions that result in the same tasks being generated. However, we want the user to feel as if every challenge is authentic and adding to their wellness.