-
-
Helmet prototype: RPLIDAR A1 on top, XREAL AR glasses under the visor.
-
The 2D LiDAR on top of the helmet scans the room 360° around the firefighter.
-
Real view through the XREAL glasses (shot through the lens): scanned walls and a live mini-map.
-
Command dashboard: a live 3D building map with the field team's positions and activity.
Inspiration
In a burning building, smoke cuts visibility to almost zero. Firefighters feel their way along walls and get lost even in small rooms. We wanted to give them their sight back.
What it does
BlackGrid is a firefighter helmet with a LiDAR scanner and XREAL AR glasses that draw walls as bright lines over the real view, so smoke can't hide them. The commander sees a live map of the walls and the firefighter's route.
How we built it
An RPLIDAR A1 streams scans through ROS 2. A Python/FastAPI backend merges them into stable walls; React + Three.js renders them in the glasses and dashboard.
Challenges
Keeping walls steady and lag-free during head movement, and the LiDAR, glasses and laptop in sync.
What we learned
Hardware takes far longer than code, and in AR even small lag feels wrong.
Built With
- docker
- fastapi
- ios
- linux
- numpy
- opencv
- python
- react
- ros-2-jazzy
- rplidar-a1
- three.js
- typescript
- vite
- websockets
- xreal-glasses