Inspiration

We wanted a personal AI assistant available right from the desktop, without interrupting whatever we were working on. Our original vision was an assistant we could carry on a USB drive. PortAI is our first step toward that goal, with quick voice access and practical everyday tasks.

What It Does

PortAI lets us use a Ctrl+Alt shortcut to make voice requests. It can answer questions, analyze the screen or clipboard, launch supported Windows apps, set timers and reminders, and manage tasks. Speech transcription runs locally; AI chat and analysis use the Nebius API.

How We Built It

We built PortAI in Python. Faster-Whisper handles local speech transcription, and a request router connects natural-language commands to the appropriate action. We used PyQt6 for the system tray, floating status pill, and animated response drawer. SQLite stores tasks, while timers and reminders use Windows notifications.

Challenges We Ran Into

We had to keep the interface responsive while recording audio and processing requests, and account for differences in microphones, GPUs, and installed apps across Windows setups. We also had to balance our original offline, portable vision with the current implementation: transcription is local, but chat, intent classification, and screen or clipboard analysis require an internet connection and the Nebius API.

Accomplishments That We’re Proud Of

We brought voice interaction, AI responses, desktop controls, and task management together in one assistant. We’re especially proud that PortAI can do more than chat: it can connect requests to useful actions on the user’s computer.

What We Learned

We learned how much coordination a desktop assistant requires: keeping the interface responsive, translating natural-language requests into structured actions, and connecting AI capabilities to operating-system features. We also learned to be clear about which parts run locally and which rely on external services.

What’s Next for PortAI

We want to move more AI processing on-device, reduce reliance on an internet connection, and bring PortAI closer to our original portable USB vision. We also hope to improve reliability across different Windows setups and expand the assistant’s supported actions.

Built With

Share this project:

Updates

Submission history