Inspiration

Speech therapy for a late-talking child is usually one hour a week. The rest happens at home, where parents often don't wait long enough for the child to answer. Therapists never see what happens there.

What it does

Talkly is a web app that clinics give to parents of late-talking children (18 to 48 months). The parent records one minute of daily conversation with the child. Talkly measures how often the parent invites the child to talk and how long they wait, then gives short feedback. The therapist sees a summary before the next session and adjusts the weekly plan. The child never uses the screen.

How we built it

Next.js, TypeScript and Supabase, deployed on Vercel. ElevenLabs turns the recording into a timestamped transcript, our code measures the pauses and turns, and GPT-6 Luna writes the feedback from templates written by therapists.

Challenges we ran into

Detecting a toddler's short sounds in a transcript, and making sure the AI only writes words while all numbers and decisions come from code.

Accomplishments that we're proud of

A full loop between home and clinic, built in 24 hours. In our scripted tests, the measured pause was off by only 0.28 seconds on average.

What we learned

The most useful thing to measure isn't the child's words but how long the parent waits.

What's next for Talkly

Pilot with a real clinic and support Javanese.

Built With

  • bcrypt
  • deepgram
  • elevenlabs
  • github-actions
  • gpt-6-luna
  • mediarecorder
  • next.js
  • openai
  • postgresql
  • pwa
  • react
  • supabase
  • tailwindcss
  • typescript
  • vercel
  • web-audio-api
  • web-push
  • zod
Share this project:

Updates

Submission history