Inspiration
The hassle of sorting a cluttered drawer is annoying enough now imagine doing it with delicate electronic components like resistors, capacitors, and LEDs. You have to be extra careful to avoid damage, and it’s time-consuming. We wanted to eliminate that pain by creating an automated solution.
What it does
Our robotic arm identifies and sorts electrical components such as resistors, capacitors, and LEDs in real-time using computer vision. It handles them with precision to prevent damage and save time.
How we built it
We developed the system using: QNX 8.0 OS as the base operating system Python to control servo motor positions and movements OpenCV and Twelve Labs’ video graph AI to detect and classify components Hardware includes a Raspberry Pi, Arduino, and a custom 5-servo robotic arm graphic AI for component detection and identification.
Challenges we ran into
Integrating tools with QNX was difficult due to unfamiliarity and compatibility issues. Setting up the environment and managing real-time control while using external AI services pushed us to learn fast.
Accomplishments that we're proud of
We’re proud that the full hardware setup is functioning end-to-end: vision, classification, movement, and sorting all integrated into a working system.
What we learned
We gained experience working with real-time OS environments like QNX, explored new AI tools like Twelve Labs, and improved our skills in cross-platform integration between hardware and software.
Log in or sign up for Devpost to join the conversation.