Mr. Whiskers

Inspiration

We wanted to re imagine the simple desktop companions with more modern components, such as artificial intelligence.

What it does

There are a few components that makes Mr Whiskers unique, mainly,

State machine. Mr. Whiskers logic is dictated by using a state machine. The state machine was built modularly to allow for easy expandability
Can 'view' the users screen to make conversation. Mr. Whiskers has a state which screenshots of the user's screen and feeds it into Gemini API, which returns dialogue for Mr. Whiskers to give to the user.
Windowed gravity. Mr. Whiskers experiences gravity on the users desktop. He is able to roam on top of applications, or on the task bar.

How we built it

We used Python along with several libraries including Gemini API, pillow, tkinter, git, and more to create a dynamic interface that makes calls to Gemini API with custom prompts.

Challenges we ran into

This was our group's first project together, and two of our members first experience programming a full project (and even using git!) Needless to say, a lot of the time creating Mr. Whiskers, was not actually spent making Mr. Whiskers...

Accomplishments that we're proud of

We think Mr. Whiskers is a cute, fun companion and we are very proud of how he turned out. Learning how to turn something as simple as a desktop companion into a more interactive technology for the user with AI was a great experience.

What we learned

This project gave us valuable experience on working a frontend, a backend, and connecting them to create a cohesive end result.

What's next for Mr. Whiskers

If we do more with this project, we would like to add customization to him. Being able to change the size, colors, moods, etc of Mr. Whiskers would give users more interactive components.