AccessCare

Inspiration

TeleHealth is a new innovation in healthcare technology, which allows patients to seek healthcare without having to take time out of their day to go to a hospital, but instead they can do it from the comfort of their phone or laptop.

Sadly, current telehealth technology has problems: many solutions have poor accessibility, including insufficient screen reading technology (57% of visually impaired people have had issues accessing telehealth solutions), poor captioning (40% of top-20 US hospitals used telehealth platforms that routinely offered automatic captioning), and more.

What it does

AccessCare is designed to incorporate accessibility. A couple of important notes:

• WCAG 2.1 Level AA accessibility compliance, which is (soon to be) legally required in hospitals.
• Better Captioning. We provide this with two features: two transcription models are run (note that during the demo, to better showcase this, we run whisper against a mock) against eachother, if there's any differences between them, it gets flagged so either the provider or another person in the call (excluding the patient, there are designated people that can be added as well for this) can select the correct transcription. Another safeguard against incorrect captioning is having the provider / other person review the transcript while it's happening, if changes are needed they can issue a correction.
• For patients with speech disabilites / who require external devices to type, we implement multiple features. We firstly provide them with a built in speech board that has multiple options for them to select, which can be prewritten before the meeting or can also be done by AI during the meeting, which will listen to the conversation and provide suggestions. Additionally, patients can type less (e.g "daily dosage" instead of "How much dosage do I need daily")

How we built it

Tech stack is built on React and Cloudflare Workers, with Bedrock used as the AI model endpoint (workers AI is used for the transcription models). Claude Code and Antigravity were used for the implementation, and Claude Code was used for architecture discussion and general ideation (with my input of course).

Challenges we ran into

My Claude Code sub ran out of usage, didn't realize that the cloud would be so slow so I switched to antigravity for the last minute implementation.

Accomplishments that we're proud of

I was really locked in during this.

What we learned

Start my 5 hour limit earlier so I don't have to worry about running out of usage mid hackathon :(

What's next for AccessCare

HIPPA compliance, better implementation

(for full transparency, if it's not clear from the video, most implementation was not completed)

Built With

• cloudflare
• react
• workers