Inspiration

When we first got together and started brainstorming we quickly decided to do something with AI. That's when the idea of a photomath program came up. This seemed like a great way to get introduced into AI projects as it was more difficult than just basic level image recognition and involved using an API.

What it does

The program is designed to allow a user to input a image of a math problem after which it is returned to them solved.

How we built it

In order to build this we had to make image recognition AI for all 10 digits and the basic 4 math operators. This ended up being done through two separate AI's as it made it easier to find good datasets to properly train the AI. After the user inputs a image it is broken into 3 parts (the 2 numbers and the operator) then the AI returns a string of what it believes the inputted math problem is. From here that string is inputted into a prompt and sent through OpenAI's API in order to be solved. Then the solution is returned to the user.

Challenges we ran into

One of the biggest we ran into was where to start. As all of us had little to no artificial intelligence experience we had to do a lot of research and testing to find out what worked the best for this project. The other main challenge we ran into was making the AI accurately identify numbers and symbols consistently.

Accomplishments that we're proud of

We completed two Image recognition programs and learned how to use OpenAI's API along with making a front end for user inputs and answers.

What we learned

The main things that we learned from this project were how AI work and how to code the various parts of an AI to make it both efficient and effective. Another thing we learned was how to use the outputs of the AI in conjunction with OpenAI's API.

What's next for BoilerMath

The next steps for BoilerMath are to make the AI even more accurate and continue to expand the possible inputs that can be given and solved. For example exponents, integrals, derivative, ect.

Built With

Share this project:

Updates