63 - StudyForge

Desktop Application
Exposing Modules to React Native via RNBridge
Interfacing Native Modules in React Native Code
Data Collected from Face and Eye Analysis
Creating Server Endpoint Using Flask
Swift Native Code for Interacting With MacOS APIs
Parsing Screenshots For a Suitable Format To Send To Google's Vision API
Using MediaPipe and OpenCV to Analyze Face and Eye Data with Python

Inspiration

Our inspiration came from wanting to help students improve how they study. We wanted to create a science-based solution that could make learning more effective and less stressful. By combining technology and research, we aimed to give students a tool that helps them achieve better results in less time.

What it does

The project analyzes: 1. User Focus – It tracks how focused a user is during their study sessions. 2. Study Materials – It identifies what the user is studying.

Based on this, the app provides actionable insights to help users study better. • It uses AI-driven schedules and the Pomodoro technique to structure study sessions and breaks. • The AI tracks progress using reinforcement learning, adapting to what the user is studying and how well they’re learning over time.

This ensures personalized and effective study plans that keep improving with use.

How we built it

We used: • MediaPipe and OpenCV for analyzing and processing visual data. • Python for the logic and machine learning aspects of the project. • React Native Desktop and TypeScript to build the user interface and functionality. • Swift for seamless app integration on macOS. By combining these tools, we created a solution that supports students in their studies.

Challenges we ran into

React Native is very unstable and took a lot of our time, solely debugging issues. It was challenging, but we still learned a lot.

Accomplishments that we're proud of

Implementing the Miscrosfot-style recall feature we used to keep track of the users studying topics.

What we learned

• How to use tools like Swift, TypeScript, MediaPipe, Python, and OpenCV.
• Building a desktop app with React Native on macOS.
• The importance of blending research-based techniques with technology.
• Dealing with a firestorm of bugs