Inspiration A warning light can turn an ordinary drive into an expensive question: “Should I repair this car—or replace it?”
Drivers often have to piece together answers from dashboard symbols, repair estimates, financing calculators, and workshop searches. We wanted to bring those steps together in one place. Our Toyota companion helps drivers understand what their car is showing them, explore ownership costs, and decide what to do next. What it does Our app guides drivers through three steps: Inspect → Understand → Act.
- Inspect: Upload dashboard and exterior photos. The app identifies supported illuminated warning lights and performs experimental checks for visible dents and scratches.
- Understand: Review the findings, explore estimated keep-versus-buy costs, and adjust financing assumptions. An AI assistant explains inspection results and answers questions using the available context.
- Act: Find nearby workshops, view available business details, and open directions. Workshop listings sync with a shared database. The interface supports light and dark themes, smooth transitions, and a layout designed for phone screens. How it works The frontend uses React Native Web and React, with server-side API handlers connecting the app to AI, speech, and database services.
Dashboard photos go through an OpenCV pipeline that detects illuminated colors and compares icon shapes against supported warning symbols. A rules-based system combines detected indicators with the driver’s entered mileage and model year to produce an explainable reliability estimate. Exterior photos use a separate experimental damage-detection model; condition ratings are withheld when its evaluation requirements are not met.
The NVIDIA-powered assistant receives structured inspection findings, financing selections, and the latest workshop-search context to generate relevant explanations. ElevenLabs supports speech generation and transcription.
Geoapify provides nearby workshop listings and route information, while SpacetimeDB stores service-center records and supplies live database updates. GitHub Actions checks the frontend, API contracts, vision pipeline, and database modules.
Our goal is to make the next step clearer while keeping estimates, uncertainty, and the limits of visual inspection visible.