👁️ SightlineAI — Offline-First Edge AI Assistant (Companion Build)

This is the edge-assistant companion entry to the main SightlineAI smart-glasses project: an offline-first prototype narrating the world for blind and visually impaired users using on-device inference.

Focus of this build

  • Offline-first — core scene narration works without internet
  • Qwen-powered description — compact LLM turns detections into natural spoken sentences
  • ESP32 + camera + speaker — minimal wearable bill of materials
  • Latency-aware pipeline — detection → caption → speech tuned for real-time use

See the main SightlineAI project for the full glasses platform, roadmap and hardware guides.

Built With

  • computer-vision
  • esp32
  • python
  • qwen
Share this project:

Updates

posted an update —

Qwen Integration Completed for SightlineAI

SightlineAI now includes a working Qwen-powered accessibility guidance workflow using Alibaba Cloud Model Studio APIs.

New Features Added

  • ✅ FastAPI backend
  • ✅ Qwen OpenAI-compatible API integration
  • ✅ Accessibility-focused environmental guidance
  • ✅ Structured AI responses
  • ✅ Responsive frontend MVP
  • ✅ Edge-AI-ready architecture
  • ✅ Improved error handling and modular backend design

Current focus:

  • accessibility AI
  • environmental awareness
  • assistive navigation workflows
  • edge AI architecture

Next steps:

  • OCR integration
  • voice interaction
  • real-time computer vision
  • wearable edge-device workflows
  • persistent memory systems

GitHub: https://github.com/rudra496/sightlineai

Submission history