MaskyLive

operational dashboard

Inspiration

Masky existed with a talking avatar api and conversations. Why not give our openclaws personalities and embodiment, allow them to read twitch chat like a real human, so many humans can inform it or guide it toward accomplishing a goal?

What it does

Brings any masky avatar to life on twitch with memories and chat interactivity.

How we built it

MaskyLive spins up a vm and provides an agent using claud's computer_use tool, composio, and can spawn guild.ai subagents to accomplish tasks. With hermes and gbrain breathing life into the avatar, it remembers important messages seen in twitch chat while it's streaming live to accomplish it's goal.

Challenges we ran into

auth can be a big issue; captchas and vm/vpn detection can get in the way preventing the agents from doing real work.

Accomplishments that we're proud of

the operational dashboard showing some observability on cpu/memory averages and per vm for each streamer agent.
Utilized calude's credential_use skill so username/password combos can be entered into forms and tools without ever getting them into context.

What we learned

Memory and planning to accomplish arbitrary goals, knowing what tools to use and how to authenticate them is tricky.

What's next for MaskyLive

Giving agents their own accounts instead of connecting to existing ones - letting them sign up for services with their own agent-avatarname email addresses on masky.ai and interacting via the VCMail project's api/claude skill.