AskMeety

Inspiration

Taking notes on a phone while watching a lecture or sitting in a meeting is clumsy. You pause, switch apps, lose context, and miss the slide that mattered. Foldables have a natural "laptop" posture, and we wanted to use it as the trigger for focused note-taking.

What it does

Fold your iPhone Duo to about 90° during a video or meeting and AskMeety launches automatically. The video keeps playing on the upright top half, and the flat bottom half becomes a scratch pad. While you jot notes, AskMeety streams a live transcript and captures screenshots of key moments. Each suggestion appears as a card you approve or reject, so only what matters is kept. When the session ends, your notes, approved excerpts, and screenshots are compiled into a clean, timestamped doc.

How we built it

We built the app in SwiftUI and used Duo’s hinge API to detect fold state and adapt the interface. A shared session keeps playback and meeting data intact as the layout changes. AVFoundation drives playback and frame capture; Apple’s Speech and Translation frameworks power the live sample experience. PencilKit supports handwritten notes. A ReplayKit extension captures app audio and microphone audio on separate tracks for meeting recording.

Challenges we ran into

The simulator can’t physically fold, so we added a debug shortcut to exercise Duo layouts and the fold gesture. The simulator also can’t confirm how ReplayKit captures audio from real calls. We had to keep the live sample demo distinct from real-meeting capture, which still needs end-to-end testing on hardware.

Accomplishments that we're proud of

We brought captions, translation, captured frames, action review, and a typed-or-drawn scratchpad together in one live meeting workspace. The session can adapt between phone, cover, and unfolded layouts without losing its state, and approved takeaways can be saved with the meeting.

What we learned

A foldable app needs to respond to what the person is doing with the device, not just stretch across a larger screen. We also learned to keep people in control when software suggestions may be wrong: proposed actions stay reviewable until the user accepts them.

What's next for Notefold

We want to validate the hinge experience and full recording flow on physical Duo hardware, especially system-audio capture during calls. Next, we’ll test transcription and meeting exports end to end, improve recognition across languages, and explore turning handwritten notes into searchable text.