CodeControl is an interactive debugger controlled by custom gestures made to make Computer Science easier, more approachable, and more accessible to beginner students. It allows students to step through their code, step-by-step, so they truly understand what’s happening, without any of the complexities of debugging. In addition to the gesture-controlled debugging, we have a visualizer that shows exactly how the data structures within the code are being manipulated. We used TensorFlow and JS for the front end to interact with the user and detect the gestures that they were making. Then, from this process, a C++ process was called to interact with the debugger depending on the gesture made by the user. This would return a line of code from the debugger which would then be fed into the Visualizer, which would then give the user a representation of what their code is doing. The Visualizer was built in Java.

Share this project: