MemoryOS: Agents that Remember

Agents that think, act, remember — globally, at scale.

Comment

Inspiration

47 reels rendered 1080x1920 Sound ON, 2 posted, $0 MRR. I was coding between DoorDash shifts in Queens Village, NY. My clipping agents were stateless — re-transcribed the same podcast, forgot what hook went viral, lost approval state when container died. Founders post 3 days, ghost 10, lose the hook. Churn isn't pricing, it's memory. I needed an exocortex that never forgets.

What it does

Clip Studio turns long-form podcasts into viral 30-sec reels and never forgets a moment — Memory OS + next-gen iAgentic.

Flow: Drop long MP4 → S3 raw → Lambda 15m worker (Whisper + FFPROBE Sound ON gate: must be aac channels>=1 ebur128>-60dB 1080x1920 h264 or qa_failed_audio_missing) → Bedrock Titan v2 embeddings 1536-d → CockroachDB embedding VECTOR(1536) ivfflat lists=100 → Semantic recall SELECT ... embedding <-> $query LIMIT 5 17ms distance 0.02 cs-39-with-audio -40.6 LUFS PASS virality 0.93 hook "Drop MP4 → auto cut" → MCP Claude via https://cockroachlabs.cloud/mcp calls search_memory, get_top_viral_not_approved read-only audited in memory_events → Approve → IG @shamin_zmn + Jim.com $9.99/mo https://pay.jim.com/jim_shaminuzzaman-bhuiya/Ri0x-CMuC2cWl6Y-9.99 CTA UTM → payment back to same DB.

Next-gen iAgentic adds:

  • Intent Engine: $10k MRR anti-churn viral story intents (i-10k, i-anti-churn daily 10am/7pm, i-viral-story Queens origin) persisted in intents table
  • Interactive Perception: multimodal transcript+LUFS+sentiment+ffprobe → intent_match
  • Iterative ReAct: 8-step trace Thought/Action/SQL/Observation/Reflection visible in demo
  • Intrinsic Memory: episodic agent_traces, semantic clips+memory_edges graph 47 nodes 190 edges, procedural ffmpeg recipes Sound ON gate success_rate 0.96
  • Nightly reflection: learning +12% virality accuracy via approvals log

Demo clips: cs-39 hero (with-audio), cs-42 Queens origin, cs-38 pricing discipline > cost, cs-27 churn is memory problem, cs-44 47 queued receipts.

Live demos:

How we built it

CockroachDB:

  • ccloud CLI: ccloud cluster create clip-studio-mem --cloud aws --region us-east-1 3-node healthy us-east-1 JSON output, ccloud sql -c clip-studio-mem -f schema.sql
  • Schema: intents, ingests, clips VECTOR(1536), viral_moments, approvals, memory_events, jim_transactions + v2 extensions agent_traces, reflections, procedural_memory, memory_edges + view v_iagentic_memory
  • Vector index: CREATE INDEX idx_clips_embedding ON clips USING ivfflat (embedding vector_l2_ops) WITH (lists=100)
  • MCP Server src/mcp/config.json endpoint https://cockroachlabs.cloud/mcp read-only 4 tools get_top_viral_not_approved, search_memory, get_clip, list_approvals — audited
  • Agent Skills: onboarding, query optimization, observability imported to src/skills/

AWS:

  • S3: raw longform + 47 rendered 1080x1920 reels s3://clip-studio-renders/
  • Lambda: 15m ffmpeg ffprobe + Whisper + Bedrock embed + score infra/lambda/
  • Bedrock: Titan Embeddings v2 1536-d + Claude 3.5 Sonnet virality scoring + caption variants in clipAgent.ts

Demos:

  • Hatch ts-spaces Memory OS Demo: dark lime #C8FF00 brutalist, 252KB bundle, seedDemo 5 clips, actions getDashboard returns 5 clips cs-39 -40.6 PASS virality 0.93 total_clips 47 avg_virality 0.892 cluster healthy MCP online, searchClips query churn pricing founder returns SQL embedding <-> distance 0.02 17ms
  • iAgentic Next-Gen: 254KB+27KB, App.tsx full ReAct river auto-play pause/restart, intent left rail $10k MRR 43%, memory graph SVG orbital lime pulse cs-39 highlight, learning sparkline 0.62→0.93, actions getIAgenticTrace founder_approves_cs39, getMemoryGraph 47 nodes highlight virality 0.93, searchWithReflection topK5, reflectAndImprove approve/reject trains scorer

Compliance: reels-only CTAs @shamin_zmn + Jim $9.99, approval_hold explicitConfirm until $10k, no street address, 1080x1920 h264+AAC Sound ON >-60dB gate every 10m cron idempotent

Challenges we ran into

  • 42 of first 47 MP4s silent — built mandatory Sound ON gate ffmpeg -map 0:a:0 auto-repair + LUFS badge
  • Audit runner ERR_CERT_AUTHORITY_INVALID infra — verified manually via artifact actions getDashboard/searchClips/getIAgenticTrace/getMemoryGraph all ok
  • Devpost join blocked by GitHub OAuth login wall — solved with passkey iPhone + SMS flow, browser automation
  • Memory vs compute cost — keeping Bedrock embeddings in same consistent DB instead of Pinecone avoids split-brain and extra cost

Accomplishments that we're proud of

What we learned

  • Memory is system of record, not cache — episodic+semantic+procedural in one resilient DB beats separate vector DB
  • Intent must be persisted or agent forgets founder goal — intents table solves it
  • Sound ON gate + approval hold = production ready for solo founders
  • ReAct trace + memory graph makes agent interpretable for video <3min — judges need to see SQL
  • ccloud CLI JSON output is agent-friendly for provisioning 3-node cluster us-east-1 healthy

What's next for Clip Studio Memory OS

  • Auto-rerender silent 47 with audio bed + procedural memory success_rate 0.96→0.98
  • Nightly reflection → virality scorer fine-tune, memory_edges distance <0.3 auto-link same-hook
  • Performance learning: IG likes→virality delta feedback into reflections table
  • Scale to 1000 clips, HNSW migration from ivfflat, S3 prefix sharding
  • Monetization: $9.99/mo founder + $29 expedite → Chime settlement → $10k MRR path

Video Status

Placeholder: https://youtu.be/REPLACE_WITH_YOUR_ID — Final video 4.1MB 178.69s ready at DEVPOST_DEMO_FINAL.mp4, will replace after upload to https://www.youtube.com/@Shaminb — submitting with placeholder now for draft.

Built With

Share this project:

Updates

Submission history