VoiceMedic

VoiceMedic is a voice-activated app that guides users through emergency first aid. It processes speech with AI and provides real-time audio instructions, empowering anyone to act and save lives.

Comment

Inspiration

Our inspiration for VoiceMedic came from realizing how important basic first aid knowledge is! We noticed that many people lack first aid knowledge altogether, so we wanted to create a tool that empowers anyone, regardless of their experience level, to step in and potentially save a life.

What it does

VoiceMedic allows users to describe the emergency situation they’re facing, and it responds with clear, spoken first-aid instructions. It guides users through essential checks and techniques to help stabilize the person until emergency services arrive, and it can also assist with treating minor injuries.

How to use it?

Start Speaking: Click the blue button and start speaking. Once you stop talking, the app will provide spoken first aid instructions.

Text Option: If you don’t have a microphone, you can enter text manually.

Reference Numbers: The app also includes reference numbers like 911, suicide hotlines, and non-emergency numbers. Just click on the number to call using your device’s calling feature.

How we built it

We built VoiceMedic by integrating several key components. We used APIs to capture speech input, processed it through OpenAI for relevant first aid responses, and then converted the response back to speech output for the user. Expo helped us troubleshoot the app on our device, while Android Studio’s emulator displayed the app on our PC for additional testing. Tailwind was used to style the app with simple, responsive CSS.

Challenges we ran into

Dependency Conflicts: Using several tools for the first time led to conflicting dependencies, preventing us from exporting the app as an APK using Gradle for mobile testing.

Impact: We were limited to testing on a PC emulator and had to remove a key feature that still needs further development.

What we learned!

API Integration: Gained valuable experience working with speech recognition and AI models like OpenAI, learning how to effectively process real-time speech input and output.

Cross-Tool Compatibility: Learned how to manage dependencies and the challenges of integrating various tools, especially when using them for the first time.

Testing and Troubleshooting: Understood the importance of testing on multiple devices and emulators, and how crucial it is to troubleshoot on both real devices and emulators to ensure a smooth user experience.

Future Inspirations

Increase Accuracy: We plan to conduct repeated tests and collaborate with medical professionals to refine and enhance the accuracy of the first aid guidance provided by VoiceMedic.

Integration with Assistants: Our goal is to incorporate VoiceMedic into popular voice assistants like Siri or Bixby, leveraging their existing frameworks and the power of large language models like ChatGPT to improve functionality.

Mobile App Setup: We aim to resolve the mobile app setup issues, particularly with exporting the app to a mobile device, sometime in the future to make VoiceMedic is more accessible on phones.

How to set it up?

For detailed instructions on how to set up and use VoiceMedic, please refer to the README file in our GitHub repository. It includes step-by-step guidelines for installation, setup, and troubleshooting. Link Here

Share this project:

Updates