TeachMe

Inspiration

In terms of inspiration, part of it came from one of our members majoring in early childhood education, so we thought of something that could benefit them. On top of that, with COVID still going around, we're seeing a growth in online education, and while there may be a lot of resources currently, most people still seem to prefer in-person lessons, so we're aiming to bridge the gap.

What it does

Hello, our app is called TeachMe. The idea behind it is to help early educators (preschool - 1st grade) teach online in an easier and more effective way. So there's a couple parts to the app. The first part deals with obtaining information from the student/parent/teacher to sign them up for the right online class. The second part differs for what person is using the app. For students, they'll be able to see their classes and view them. For teachers, they'll have a built in video editor that will help them with teaching by allowing them to open their palms and edit in certain objects. Our camera can detect whether or not the teacher's palm is open or not, and from there allow them to edit in objects. For parents, they can see what their children are learning and help them with whatever might be necessary.

How I built it

We used Swift and SwiftUI to build the general user interface. For the vision AI, we used iOS 14 beta features such as HandPose to be able to recognize hand positions (ie. open palm, closed palm, etc.)

Challenges I ran into

The biggest challenge we faced was a lack of time. All of us had other things that we had to do and so we were only able to code/work on the project for a couple of hours each day after we finished everything else. Additionally, none of us had much experience in SwiftUI, so we had to spend a lot of time trying to learn it and look up how to do certain things. Given the chance to do it again however, we'd be able to move a lot faster and hopefully have more time to work on it However, given how much we learned and how much experience we obtained, depsite our shortcomings and lack of development, I'm happy with how far we came.

Accomplishments that I'm proud of

This was a new language we were learning and we were also using beta iOS features so that on its own was a huge accomplishment.

What I learned

We learned how to use Swift/SwiftUI and Vision libraries.

What's next for TeachMe

Making the app not only recognize hand poses but have it so that the video recorded can have AR elements above the hand so that the interaction between the teacher and student is more interactive. Better UI, hookup with Firebase etc.

Built With

• beta
• ios
• ios14
• swfit
• vision