Air Pen is a virtual user interactive environment providing the means for a speaker to simultaneously demonstrating subject like a black board scenario but in a 3d live space which the system mimics and draws accordingly on the image.
Abstract Standard input devices do not closely mimic natural hand motions such as drawing and sketching. A challenging aspect of the design problem for the system is to provide an intuitive way for the user to enter the sketch that defines the appearance of the product. The precise position of the sketch is important to assemble a 3D model based on the sketch. In such an environment, designers can experience the full creative process from concept to realisation and evaluation.
Problem Statement To provide the user a platform through which he/she can sketch along while talking on a video without transferring to an external white board software. During this pandemic period the field of teaching and training has evolved vastly and thus this project would be very useful to the speakers to express his subject by writing of drawing about it while speaking. Users fingers or a pen/scale is choosed as a target and its movement is traced along to draw as per his/her requirements.
Proposed System This entire application is built fundamentally on contour detection. It can be thought of as something like closed color curves on compromises that have the same color or intensity, it’s like a blob. In this project we use color masking to get the binary mask of our target color pen, then we use the counter detection to find the location of this pen and the contour to find it. When we work with it then it is a matter of literally connecting the dots, we just have to draw a line using the x, y dots of the previous position of the pen with new x, y dots and that’s it. , We have a virtual pen.
Methodology Step 1: Find the color range of the target object and save it. Step 2: Apply the correct morphological operations to reduce noise in the video Step 3: Detect and track the colored object with contour detection. Step 4: Find the object’s x,y location coordinates to draw on the screen. Step 5: Add a Wiper functionality to wipe off the whole screen. Step 6: Add an Eraser Functionality to erase parts of the drawing.
Log in or sign up for Devpost to join the conversation.