Inspiration
The project was inspired by a personal story. One of our team members had a very close family member who suffered from a stroke. Fortunately, they were lucky enough to survive, but in those moments he wondered how this could have just happened. That experience made him realize the importance of recognizing stroke symptoms quickly to prevent them. He thought, "What if someone had a tool right in their pocket or on their phone to overcome the long and arduous process of detecting a stroke?" That question is what led to StrokeSentry, our app that helps detect stroke symptoms in real time.
What It Does
StrokeSentry is a mobile app that uses your phone camera and microphone to check for stroke symptoms. It is built based on the widely proven F.A.S.T. method:
- Face Drooping
- Arm Weakness
- Speech Difficulty
- Time to act
The app looks for things such as facial asymmetry and drooping, slurred speech, or changes in posture. It provides the user with quick, clear, and concise feedback so they can take immediate action if needed.
How We Built It
We built the app using Swift for iOS. For real-time face and pose estimation, we used Apple's Vision Framework. Our backend models consist of:
- Convolutional Neural Networks to detect facial and posture changes
- Speech-to-text APIs to analyze voice input and detect slurring
- CoreML and TensorFlow Lite to run everything directly on the device
Challenges We Ran Into
The hardest part was making sure the app could recognize stroke symptoms accurately. Faces come in all kinds of shapes, lighting isn't always ideal, and speech varies greatly from person to person.
Accomplishments That We're Proud Of
We are very proud that we built a working app that detects stroke symptoms in real time, achieved over 75% accuracy in tests, designed a clean and simple UI for anyone to use, and created something that could potentially save many lives.
What We Learned
We learned just how powerful AI can be when applied to real-world problems. Strokes are just one of many health risks—early detection can make a huge difference. We also realized that not every problem has been solved yet. There's still so much room for AI and other software tools to grow, especially in healthcare. This project made us more motivated to keep building tools that help people when it matters most.
What's Next for StrokeSentry
We plan to refine the app and release it on the App Store, work on publishing our results in a reputable journal, and explore new features to detect other health risks in real time.
Built With
- avfoundation
- facemesh
- foundationb
- mapkit
- posenet
- speechframework
- swift
- swiftui
- visionframework
Log in or sign up for Devpost to join the conversation.