Inspiration
microAlan take clear inspiration from Alan. We first got the idea by thinking "how much of Alan could we possibly automate in 24 hours?" We ended up locking onto several specific features we wanted to automate using AI.
What it does
microAlan automates 3 core features of Alan's mobile application.
- It automates getting medical advice through a chat interface.
- Automates video consultations using image and voice models.
- Finds real practitioners and automates booking appointments with them.
How we built it
We used nextjs, express and a combination of several AI models:
- Openai's Realtime model
- Pixtral
- Bland ai's call models
Challenges we ran into
Giving the Realtime voice model vision capabilities was very challenging to do in a short amount of time. Making everything look the way we wanted also took some time.
Accomplishments that we're proud of
Giving the Realtime voice model vision before the end of the first day!!
What we learned
Processing audio in react, making things work properly with websockets. Function calling and more...
What's next for [microAlan]
Polishing some of the most promising functionalities. Open sourcing a kit to combine Pixtral and Realtime models for apps.
Built With
- blandai
- nextjs
- pixtral
- realtimeapi-openai
- typescript
Log in or sign up for Devpost to join the conversation.