Inspiration

More than 2.2 billion people worldwide live with some form of vision impairment, yet most assistive technologies remain expensive, inaccessible, or dependent on constant internet connectivity. I wanted to build an affordable, open-source, AI-powered wearable system that could help visually impaired individuals navigate and interact with the world more independently.

SightlineAI was created to combine edge AI, computer vision, and real-time voice assistance into a low-cost wearable platform that works even in low-connectivity environments.

What it does

SightlineAI is an offline-first AI assistive system for blind and visually impaired users that provides:

  • Real-time object detection
  • Environmental awareness
  • OCR and text-to-speech
  • Voice-guided assistance
  • Navigation support
  • Persistent contextual memory
  • Edge-cloud AI orchestration powered by Qwen

The system is designed to run on affordable hardware and assist users in understanding their surroundings in real time.

How we built it

SightlineAI combines embedded systems, computer vision, and AI reasoning.

Core technologies include:

  • ESP32 camera modules
  • Edge AI inference
  • Computer vision pipelines
  • OCR and speech systems
  • Qwen-powered contextual reasoning
  • Voice interaction modules
  • Real-time sensor processing
  • Offline-first architecture

The platform is designed to support future expansion into adaptive memory systems, personalized navigation assistance, and autonomous contextual awareness.

Challenges we ran into

Building affordable assistive technology introduces several engineering challenges:

  • Running AI efficiently on constrained hardware
  • Maintaining low latency for real-time assistance
  • Designing offline-first workflows
  • Improving OCR reliability in different lighting conditions
  • Balancing power efficiency with continuous sensing
  • Creating an accessible and intuitive user experience

Another major challenge was designing the system to remain open-source and affordable while still delivering meaningful AI capabilities.

Accomplishments that we're proud of

  • Building a functional AI assistive technology platform
  • Creating a low-cost and open-source accessibility solution
  • Combining edge AI with assistive wearable systems
  • Developing real-time environmental awareness features
  • Creating a scalable foundation for future AI memory systems

What we learned

This project taught me how impactful edge AI can become when applied to accessibility and real-world human problems. I learned how to combine embedded systems, AI reasoning, and computer vision into a practical assistive platform while balancing performance, usability, and affordability.

What's next for SightlineAI

Future development goals include:

  • Advanced persistent memory systems
  • Familiar face recognition
  • Smart route learning
  • Offline multilingual voice assistant
  • Cloud synchronization with edge autonomy
  • Improved navigation intelligence
  • Lightweight on-device AI optimization

The long-term goal is to make advanced assistive technology more affordable, open, and globally accessible.

Built With

  • accessibility
  • ai-agents
  • alibaba-cloud
  • arduino
  • c++
  • computer-vision
  • edge-ai
  • embedded-systems
  • esp32
  • github
  • iot
  • ocr
  • offline-ai
  • opencv
  • python
  • qwen
  • sensor-fusion
  • speech-recognition
  • text-to-speech
Share this project:

Updates

posted an update

Qwen Integration Completed for SightlineAI

SightlineAI now includes a working Qwen-powered accessibility guidance workflow using Alibaba Cloud Model Studio APIs.

New Features Added

  • ✅ FastAPI backend
  • ✅ Qwen OpenAI-compatible API integration
  • ✅ Accessibility-focused environmental guidance
  • ✅ Structured AI responses
  • ✅ Responsive frontend MVP
  • ✅ Edge-AI-ready architecture
  • ✅ Improved error handling and modular backend design

Current focus:

  • accessibility AI
  • environmental awareness
  • assistive navigation workflows
  • edge AI architecture

Next steps:

  • OCR integration
  • voice interaction
  • real-time computer vision
  • wearable edge-device workflows
  • persistent memory systems

GitHub: https://github.com/rudra496/sightlineai

Log in or sign up for Devpost to join the conversation.