Hardware Tools Used: Arduino Uno (no wireless/bluetooth) ESP32 Wifi (final board) Adafruit flora color sensor
Software Tools Used: NodeJS ReactJS TheColorAPI ReactSpeechKit
Project Goal: Use the Arduino Uno connected to the Adafruit flora Color Sensor to detect specific colors and the ReachSpeechKit to say the color.
Development: Friday and Saturday morning Before beginning development, we learned about how we could possibly use the combination of hardware and software to create a seamless user experience for the visually impaired. We began development using the Arduino Uno and the Adafruit flora color sensor to detect colors as rgb values. This was done using the Arduino IDE and programming the Uno. Alongside this we developed a basic application with Javascript using the React Framework. This app implemented TheColorApi to read RBG values and output them as properly named colors in the color wheel. The react app was mostly successful. The app could read RGB values entered upon a button press and output the name of the color in text. The text to speech API was also added in here and later modified to automatically say the color on resubmit.
March 4 Evening After some trial and error and troubleshooting our code, the app now successfully outputs the name of a color in text and says the color out loud all in one button press. The next task is to send the RGB data in the Arduino Board to the the Color-Eye Application.
March 4 Night After having difficulty getting the RGB values from the Arduino Board to the Color-Eye App we switched to using the ESP32 Wifi to send the RGB values over wifi to the application. In the end we were not able to resolve the issue with POST Requests however we were able to connect the ESP32 to the internet, however it would not connect to the school's eduroam due to it needing a username as well as a password, so our testing was very limited. this is something we plan on completing for the future to expand on this project.
The 2 that primarily worked on the front end had no previous experience but were able to learn react and node with JavaScript to make a functional website. the other two that worked on the hardware had little to no experience and had to solder due to a lack of hardware when switching boards last minute allowing for a great learning experience.
How we plan on continuing/finishing the project is included in our presentation linked.
Google Drive links lead to 2 demos. Link to presentation: https://docs.google.com/presentation/d/1m8iGLQ8BFdQv03MUkzOtAdj7bupuyZ21PWtD9V43RQs/edit
Log in or sign up for Devpost to join the conversation.