Onboardly

Inspiration

Onboarding is time consuming and the effort can vary based on the experience of the onboardee

What it does

Conversational agent that is able to automatically onboard new employees on internal API documentation

How we built it

Apify was used to scrape the API documentation using the website scraping agent. The scraped information is structured in a json and preserves the page hierarchy. The contents of each page are returned as markdown, which is a good format for downstream processing by language models.

The extracted data is provided as ElevenLabs conversational agent. This takes care of the STT and TTS under the hood with the Gemini Flash model. The user can then start an onboarding call directly with the conversational agent

Windsurf was used to write the bulk of the code

Challenges we ran into

We wanted to further integrate this with a browser use agent. The issue here was that it doesn't seem Eleven labs allows any communication and everything is wrapped into the high level API. They do provide option for tool use but there wasn't enough time to setup a browser agent environment.

Accomplishments that we're proud of

What we learned

What's next for Onboardly

Complete the browser use workflow to completely mimic screen share and walkthrough, which is the current human based onboarding workflow. Extend this to other types of onboarding - code walkthrough, salesforce, etc.

Built With

• apify
• elevenlabs
• python
• windsurf