Inspiration
Doctors spend a significant amount of time on administrative tasks during and after consultations—note-taking, drafting reports, and composing follow-up referral letters—reducing the time available for patient care and clinical decision-making.
What it does
Steven is a medical co-pilot that listens to the doctor-patient conversation in real time, and then, post-consultation, automates the administrative process and acts as a second brain for medical decision-making. It generates detailed reports—saving up to 50% of the time normally spent on these tasks—and improves the differential diagnosis. By leveraging a natural, conversational interface designed for busy, on-the-move healthcare professionals, Steven ultimately frees up more time for doctors to focus on what they are good at.
How we built it
- Interactive multi-agent system to transcribe audio file into draft report using a summarization and writing agent connected via CrewAI
- Conversational agent using Elevenlabs and connecting it via Make and Google Drive to the draft report
- Front-end built with Flask, we used Lovable for our mock-up
Challenges we ran into
- Getting the multi-agent architecture to summarize long audio transcriptions
- Not knowing the exact tools that Doctors currently use in the NHS healthcare, hence having to make some assumptions with work-flows.
Accomplishments that we're proud of
- Showing our product to medical students and them getting excited. They told us that a doctor supervisor of theirs has specifically said that they wish they had "a robot" doing all these boring administrative tasks.
- Creating multi agent LLM ecosystem -Using make.com to save lot's time building the backend, and integrating it with Eleven Labs conversational agent.
What we learned
- How to build an Eleven Labs conversational agent. We have realized how easy it is to build these agents and will be using these tools in future projects.
- Learned how to solve a clear pain point in the medical industry.
What's next for Steven: Doctor’s Co-Pilot – Less Admin, More Patient Care
Steven enables a future where healthcare is patient focused as doctors can spend more time doing what they are good at, allowing for improved differential diagnosis and increased patient throughput. The industry is crying out for these cost and time saving AI tools. We want to iterate on the MVP that we made in 24 hours, and make it production-grade, with a better backend infrastructure.
Log in or sign up for Devpost to join the conversation.