We've all spent countless hours whiteboarding solutions to coding challenges, sweating over space-time complexities and wishing you could quickly check if your code actually compiles? That's why we built Optecode you! Now you can take a picture of your code and immediately check for errors, see the output, and write extra test cases if your heart desires it!

What it does

Optecode lets you take a picture and upload it to our servers where we analyze it using Microsoft Vision API. Your code will be automatically recognized, parsed, and finally executed! You'll immediately see your code's output and any error or warning messages. If you wish you can modify your program and write some test cases!

How we built it

With love, loads of coffee, caffeinated chocolate—and hot chocolate. We used Microsoft's Cognitive Toolkit and Vision API to do the handwriting recognition of code and a Flask API to serve it to our beautiful website made with Javascript and HTML/CSS!

Challenges we ran into

Handwriting recognition for code isn't where we'd want it to be. Since the time limitations of a hackathon prohibited us from training our own OCR models, we built a set of rules that recognized common OCR deficiencies and quickly fixes them!

Accomplishments that we're proud of

We're proud of how smooth we managed to make the process of understanding code and presenting it in a very beautiful way in our front-end, while the OCR model we used wasn't made to understand programming languages. We're all proud that we got to work on something new, testing new technologies, and actually delivering a product that lives to its promise!

What we learned

Everything is possible given enough coffee, food, and work.

What's next for Optecode

The next step is to build our own custom OCR code recognition model that understands all the intricacies of programming languages. We want to support more languages other than Python and evolve our application and bring AR into the mix! Stay tuned!

Built With

Share this project: