Sixth Sense

• 

  Example Query to look for misplaced items

• 

  Possible distress detected & Caretakers notified

• 

  Raspberry PI + internals

• 

  Standalone Camera

• 

  Snorlax Plushie :D

Inspiration

Inspired by our grandparents who have limited vision, weakened memory, and are prone to falling, the Sixth Sense allows family members to detect when they have fallen, to describe the current room, and to search for any item within the room if you have misplaced it.

What it does

• Detects falls and possible distressful behavior.
• Provides contextual assistance like locating objects.
• Streams live video to caregivers’ mobile apps.
• Designed to be non-intrusive and accessible for older adults.

How we built it

• Hardware: Raspberry Pi + camera.
• App: Mobile interface for alerts and live feeds.
• Design: All self contained, and able to run OFFLINE

What we learned

• Real-time video/audio processing on small hardware is challenging + limiting use of cloud computing ai tools is difficult
• How to build self-contained modular offline tools that are unobtrusive and practical

Built With

• ankerc2
• applefastvlm
• deloittelunchbag
• fastapi
• python
• raspberrypi
• react
• vite