Inspiration

What it does

  1. Visual Intelligence: The robot does not just move blindly. It "sees" the environment through Gemini's multimodal capabilities. 2. Object Sorting: It identifies specific objects (e.g., apples or boxes) and commands the Arduino to move them. 3. Human Safety Protocol (The Key Feature): If Gemini detects a human hand or finger in the frame, it immediately sends a "STOP" command to the Arduino. This prevents potential accidents and injuries in real-time. ## How we built it

Challenges we ran into

"The biggest challenge was managing the API rate limits during the testing phase. Since I was testing the robot's reaction time frequently, I hit the quota limits quickly. To solve this, I had to experiment with different Gemini model versions (like Flash and Pro) to find the most efficient and fastest model for real-time control."

Accomplishments that we're proud of

What we learned

"I realized how seamlessly Generative AI can be integrated into physical hardware to ensure human safety. This project proved to me that AI is not just for chatbots; it can be easily embedded into industrial systems to protect human life in real-world scenarios."

What's next for Gemini Vision Safety Arm

Built With

Share this project:

Updates