Inspiration
Current desktop automation agents are boring to watch, and low trust. The user needs to stay in control, and get a meaningful speed up when using the agent
What it does
Automate low entropy keystrokes for you
How we built it
LOTS OF SWIFT, and some calls to LLM providers
Challenges we ran into
Low OS level control is hard The latency of each action had to be under 500ms for this to feel the way it should
Accomplishments that we're proud of
Works under synthetic conditions, and feels great
What's next for KeyPilot
Make it more robust Improve location detection (for onscreen elements)
Log in or sign up for Devpost to join the conversation.