Inspiration As tutors we constantly watch students zone out in class and stay quiet when they don't understand content. We are often explaining complex topics and nobody was asking questions. Wanted to build the brilliant friend who sits next to you and won't let you switch off.
What it does Chrome extension that injects Rick, Feynman or MrBeast into any lecture. They watch with you, react to what's on screen out loud, and challenge you with a battle game the moment the lecture ends.
How we built it TypeScript extension, Deepgram for live transcription, Claude Vision reading slides every 30s, Sonnet generating character reactions and quiz questions from the real transcript. Canvas game engine, Fish Audio for voice cloning, Next.js on Vercel.
Challenges we ran into Built mostly in a silo with remote teammates which made it hard to stay aligned - features being pitched weren't always what got built. Chrome's CSP blocked our eval approach, tabCapture silently failed for hours, and Fish Audio voice IDs expired mid-hackathon.
Accomplishments that we're proud of Rick actually reads the slide and reacts to what's on it. The battle game generates questions from today's real lecture, not a question bank. Got it working live on Echo360 with a real lecture at 10pm the night before.
What we learned Communication during a build sprint matters as much as the code. Also that MV3 service workers are genuinely hostile and that Claude Vision on lecture slides is way better than expected.
What's next for LevelUp Improving load times and testing with users to ensure this is really helpful to them.
Built With
- 2d
- anthropic
- api
- audio
- canvas
- chrome
- claude
- crxjs
- deepgram
- extension
- fish
- haiku
- next.js
- nova-2
- react
- sonnet
- typescript
- vercel
- vite
Log in or sign up for Devpost to join the conversation.