Inspiration

I got this inspiration from this youtuber series I used to watch called Animator Vs Animator by Alan Becker which is the reason I wanted to turn that into a real thing

What it does

He's an AI powered desktop companion that lives on your screen. It can communicate with you through text and voice, respond to commands, perform desktop interactions, and express itself through different animations and reactions. It also includes features like focus mode so it does not get annoying

How I built it

I built Stickman Buddy using Python and PyQt6. I integrated Ollama with a lightweight Qwen mode (maybe will change later) to power its brain, Vosk I used for offline speech recognition, and other Python libraries for audio, animations, and desktop interaction . I organized everything into different files to handle its AI, voice, behavior, GUI, and other features.

Challenges I ran into

One of our biggest challenges was making all the different components work together smoothly. I was very frustrating when I ran into small problems like small code misplacement, performance, voice chat, AI responses, animations, and desktop interactions required so much of debugging. I also had to deal with performance issues and make sure that background processes wont freeze the interface. also ran into voice chat issues and small bugs which was a headache.

Accomplishments that I'm proud of

I'm particularly proud that I managed to turn this mere idea inspired by an my fav stickman series into a working application. Seeing the stickman respond to me and to commands made me happy and finally got the dopamine I needed after the frustration.

What I learned

Building this project gave me experience combining Python, GUI , local AI, voice recognition, and async operations into a single application and I learned different AI technologies It was a lot of hassle I had to work all day sometimes.

What's next for Stickman Buddy

I want to turn this Stickman Buddy smarter, add more features make it more interactive as well as maybe add some enemy or story fight. I want to improve its memory and conversational abilities, adding more animations and behaviors, expanding desktop interactions, and giving users more customization options. This is just the beginning, and I hope to keep developing it beyond the hackathon and turn this into a real application.

Built With

Share this project:

Updates

Submission history