Inspiration

Studying is hard, and so is taking notes. Many professors write quick and erase quicker, were you able to transcribe all of it? What if you're working with others and draw notes on a whiteboard? And what if you miss a class and need someone else's handwritten notes? To fix all these common problems college students have, we built an app to do it all.

What it does

You can submit pictures of whiteboards and notes, and it gets transcribed to digital notes (this includes both english and math). You can select which subject it falls into and organize your notes using dividers. After that you can create flashcards for each topic, which you can study. To deepen your understanding of topics, you can use voice to explain a topic and AI can dictate if you've mastered it.

How we built it

Used Gemini API, Next.js, Tiger Data, Vultr, and eleven labs. First, we planned the look of the website and what features it would include. There were a lot of ideas and we had to separate into MVP, additional feasible features, and extra features we may or may not get to. Then, we split the work between frontend, backend, and ai-service. This prevented early merge conflicts. Later, we had to come together to connect everything together. Finally, we fine tuned the front end and the cohesion between each portion.

Challenges we ran into

We had alot of ideas, but choosing which ones were part of our foundation, which ones were doable in the taime frame, and letting go the rest was difficult. There were a lot of merge conflicts (as usual) when we began integrating each part one-by-one. This was especially difficult when some branches became far behind the others.

Accomplishments that we're proud of

Speech-to-text and image-to-text (handrwitten note images). We created a very clean looking web application which integrates multiple usages of AI to help users convert images of notes more conveniently (no more copying from one screen to another).

What we learned

Making a project in 24 hours requires a lot of monster and red bull. Google is not very generous with the free API usage. Most importantly, communicating with teammates during merge conflicts is imperative.

What's next for Orbit Study

Adding a lecture recording feature that will transcribe lectures and generate notes automatically, testing/imporving multiple language accessibility, security implementation, and adding/imporving other features.

Built With

Share this project:

Updates

Submission history