Inspiration
We love Manga (Comics in Japan)! We think it will be really interesting to add some elements from Manga to our real world such as dialog boxes.
What it does
The application first detects if there is a human face in the frame. If so, a dialog bubble will pop up as if it's floating in the real world! The app will convert everything the speakers say to text and display it on the dialog bubble.
How we built it
We built the whole application with Swift. We use Apple's Vision library to detect human faces in the frame. We use Apple's ARkit to put a dialog box near a speaker.
Challenges we ran into
We spent some time learning the capability and limitations of AR.
Accomplishments that we're proud of
We're both first-time AR & Swift developers!
What we learned
Swift and ARKit basics.
What's next for MangaTalk
Multilingual support and live translation.
Built With
- arkit
- swift
Log in or sign up for Devpost to join the conversation.