Inspiration
Education is the future, so to elevate ordinary education is to elevate an ordinary future to something special.
What it does
It is split into four sections. The anatomy section follows body movements and projects selected body parts onto the person in frame. It makes learning anatomy more visual and interactive. In the math section, you can use a camera to scan a math problem. A solution is projected once it is solved. The language section scans text and projects the text into a language of choosing. This elevates education in classes like Spanish or for foreign students who can't understand English well. Finally, the physics part of the project takes a prompt and projects a diagram. This elevates the physics experience a lot because physics is much easier to learn when you have visuals. All you have to do is input the problem, and in return, you will get a diagram to label for yourself or people you are teaching to elevate the physics experience.
How we built it
We used the Firebase Studio Integrated Development Environment (IDE) for all our code and image files. MediaPipe motion tracking software was used for our anatomy portion in order to properly detect the parts of the body on the subject in frame of the camera. Gemini API was integrated into our code to take a mathematical problem input from the camera and calculate the answer, translate one language into another, and generate physics-related diagrams.
Challenges we ran into
- Implementing APIs and the UI in a way that overlays the images to scale
- Acquiring a portable and functional projector in a short period of time
- Calibrating the motion sensing to refresh at a reasonable rate without crashing
- Making sure the math detection is not so sensitive that slight handwriting mishaps throw it off
- Implementing the translation API as well as converting the image detected text to computer text
Accomplishments that we're proud of
- Code works without any bugs
- UI is pleasing
- Functionable in that it works as intended
- Accessible to people for use
- Adaptable for future requests
What we learned
We learned how to work with APIs and integrate them into our code to take user inputs and generate accurate outputs. Making multiple languages working together, image projection, and motion sensing were all things we learned along the way on our project.
What's next for Astral
- Adding more sections of education like chemistry and geography
- Expanding on existing parts like making anatomy include more parts, math solve more complex equations, language translate into more options, etc...
Log in or sign up for Devpost to join the conversation.