What is it
ScreenSense is a tool that uses 35 dollars worth of stuff to recreate a 5,000 dollar smartboard but with more accuracy, features, flexibility and similar consistency. Through the use of the latest computer vision algorithms we are able to track a custom built pen with a onboard ESP32 devboard to simulate a smartboard. Offering more features and at 1/142nd the price point our product is the go to option for all schools.
Hardware
We use 2 15 dollar cameras to track the 3d printed pen and a ESP32 devboard communicates button presses with a web server. This allows us to track the pen and do features like drawing, using AI tools, and a myriad of other options.
Software
We used the claude-api in order to develop many features such as auto-translating text to English, generating similar questions to ones on the board, and solving questions with a step by step explanation. To track the pen itself we used computer vision algorithms that detected the tip color of the pen, in this case green for the most accurate detection.
Impact
Despite research indicating that the presence of smartboards raises students scores by almost 10% on average many schools simply cannot afford to have these tools, by using our product we allow for it to be more accessible to many schools and help hundreds of thousands of students learn.
Log in or sign up for Devpost to join the conversation.