During the pandemic, there was an abrupt switch to online learning which hindered learning capabilities. Many people are not able to learn particular subjects as they did on campus. This problem is causing people to not learn as effectively because students don’t have a teacher to consult. If students don’t have can’t get their questions answered, they can’t learn a particular subject well. MASTER helps solve this critical problem with online learning by allowing students to chat with mentors to help them and give step-by-step solutions to problems using AI which makes students more engaged in learning. This app can be used for not only students for learning online, but also for students who are going to campus.
What it does
MASTER is a mobile app that makes learning easy and simple. The user can chat in real time with other people to solve their questions and also solve problems using AI. Students can manually type the problem, take a picture of their problem which Computer Vision will analyze the problem, showing a step by step solution, you can voice type your problem, and draw out the problem.
The user starts off at the authentication where they are able to register or sign in if they have an account. Using firebase auth, they are able to register and sign in.
Problem Solving Screen:
Manual Input Screen:
Users are able to manually input their math question which then is fed into Wolfram API query and the result will appear on the screen. (Not shown due to time constraints, please check out UI image though)
Users are also able to choose the image of a photo and then use google cloud to covert that image into text then being fed into the query of Wolfram alpha for a result
The main other two sections is the archive section and the discussions section.
In the archive system, after achieving a result of a question users are able to select a folder and save their question answer and name it. This system utilized golly firestorms realtime database and data modeling to organize.They are als able to press the add button to add more folders.
For the discussion page, users are able to press onto a discussion they find interested in or wish to help someone else with. They are able to join a chat room and send message to the other user to help add to the disussion, Th user is also able to create discussions by pressing the add button. This again is also create using firestorm.
How we built it
- React Native for the frontend
- Firebase for user authentication and for real-time data storage/retrieval
- Google Cloud Vision to power the Computer Vision problem detection
- Google Cloud Speech-to-Text API for the Speech Recognition notes (Didn't finish in time)
- Wolfram API to solve the problems
- Figma for UI/UX design
Challenges we ran into
We ran into many challenges and technical bugs, but that is what programming is all about. The first challenge we ran into was hooking up Google Cloud services to the mobile app, as we aren’t too familiar with it. Another challenge we ran into was figuring out a way to bring a real-time chat feature.
Accomplishments that we're proud of
We are proud of so many things. We made use of this project to the best of our abilities in the allotted time. We got to use the Google Cloud Platform, which is something that isn’t too familiar to the both of us. After seeing how easy it is to use, we plan on using it more often. Additionally, we combined all of our skills to create a mobile app that has multiple features and we are proud of this app. We love the UI/UX and we love the Backend. Finally, we are proud of the amount of work we pulled off in the given time. We would have never thought we could accomplish this much in such a small amount of time.
What we learned
- Real-time storage/retrieval of messages
- Using camera vision to analyze problems
- Using Wolfram’s API to solve the problems
What's next for MASTER
- Making the program applicable to other subjects except math
During the pandemic, there was an abrupt switch to online learning which hindered learning capabilities. Many people are not able to learn particular subjects as they did on campus. This problem is causing people to not learn as effectively because students don’t have a teacher to consult. MASTER helps solve this critical problem with online learning by allowing students to chat with mentors to help them and give step-by-step solutions to problems using AI which makes students more engaged in learning.
When the user visits the app, they can choose whether they would like to login or register. After they login/register, they get to the home page where they can select from two options which are: solving a problem or going to the messaging platform where students can chat in real-time with other people to solve their problems.
SOLVING A PROBLEM
If you select “Solve a Problem”, you have 4 options to choose from: typing the problem, voice typing the problem, taking a picture of the problem, or drawing out the problem. If we tap “Input text”, we can type out the problem and Wolfram will solve the problem and display the result. We can also take a picture of that same problem and Wolfram will display a result.
Users can go to the discussions tab at the bottom, and chat with other people in real time. Users can select specific discussions and help solve other people’s problems.
In conclusion, if this project was implemented it can help many students by allowing them to have the advantage, so many already do. Thanks for reviewing our project!