Inspiration

Millions of people struggle with persistent skin flare-ups, acne breakouts, barrier damage, and hair thinning. When an acute breakout or scalp issue hits, patients usually resort to frantic late-night Reddit browsing or buying overpriced, mismatched products that worsen their condition. Furthermore, when patients finally see a dermatologist or trichologist, they cannot accurately recall what topical products they applied weeks prior or when the irritation first appeared. We asked ourselves: What if your weekly phone camera could act as an autonomous telemetric clinic that tracks your skin and hair biomarkers over time, flags acute anomalies automatically, and prepares clinical handoff dossiers complete with direct, budget-matched online treatments? That is why we built Dermlog.

What it does

Dermlog is an agentic, privacy-first skin and scalp health diary that converts weekly selfies and hair photos into longitudinal clinical telemetry: Dual Optical Telemetry (Face & Hair/Scalp): Users upload weekly facial selfies or scalp parting photos. Optical computer vision extracts standardized biometrics: Facial: Erythema (Redness Index), Surface Texture, Active Acne Count, Barrier Hydration, and Hyperpigmentation. Hair & Scalp: Hair Density (follicles/cm²), Scalp Seborrhea/Flaking Index, Shaft Caliber/Thickness, and Daily Telogen Shedding. Longitudinal Biomarker Visualization: Plots all multi-parameter telemetry over a timeline (using Recharts), mapping logged skincare/haircare products (e.g., "Started Tretinoin", "Switched to Ketoconazole") directly as vertical markers on the same graph. Autonomous Inflection Surveillance: With every new scan, Dermlog pulls a 6-scan rolling telemetry window and evaluates clinical delta rules (e.g., erythema rising >10% over consecutive scans, sudden acne surges $\ge 3$, hydration drops $>15%$, or hair density thinning $>8%$). Agentic Clinical Handoff & Budget-Matched Treatment Plans: The moment an inflection threshold is breached, an open-source reasoning model (Llama 3.1 8B) correlates the telemetric curve with the patient's logged regimen to generate an in-depth clinical report containing: Physiological Root Causes: Explains why the flare is occurring (follicular hyperkeratinization, lipid bilayer stripping, DHT receptor binding, or fungal Malassezia overgrowth). Holistic & Lifestyle Protocols: Zero-cost daily habits (damp-skin sealing, lukewarm cleansing, 4-minute scalp papillae massage). Customized AM/PM Regimens: Targeted evidence-based active ingredients. Dynamic Cheapest Purchase Links: Direct buy links to the lowest-priced online options (Amazon, Target, Ulta) matched specifically to the diagnosed conditions. 1-Click Dermatologist Handoff PDF Export: Uses jsPDF to render a clean, professional medical document complete with patient data, high-resolution trajectory charts, and raw biomarker tables ready to hand directly to a physician.

How we built it

Framework & Runtime: Next.js (App Router, TypeScript) for unified full-stack server and client execution. Styling & Design System: Modern clinical workstation aesthetics using Tailwind CSS, custom glassmorphism panels, and Plus Jakarta Sans typography. Database & ORM: Prisma ORM with SQLite for instant local zero-dependency demo runs (with built-in toggle for local MySQL via .env). Data Visualization: Recharts for responsive, multi-metric longitudinal curves with event markers. Computer Vision Pipeline: YouCam Skin & Scalp AI Telemetry engine with local file storage. Autonomous Reasoning Agent: Open-source Llama 3.1 8B via Groq / OpenRouter API calls with an offline deterministic fallback ensuring 100% demo uptime. Document Generation: jsPDF and html2canvas for canvas-rendered chart capture and vector clinical export.

Challenges we ran into

Dynamic Metric Tailoring without Hallucinations: Ensuring the AI only recommended treatments and products strictly corresponding to the specific biometric metrics flagged in that exact scan, rather than outputting generic boilerplate recommendations. We solved this with structured prompt engineering and dynamic catalog filtering. Next.js 16 Webpack & CSS Compatibility: Resolving Next.js 16 compiler bindings on Windows by stabilizing the Tailwind v3 PostCSS pipeline so styling, glassmorphic cards, and charts render consistently across all environments. Cross-Correlating Interventions with Telemetry Curves: Synchronizing asynchronous user-logged calendar events with biometric data points across disparate timeframes on a single Recharts timeline.

Accomplishments that we're proud of

End-to-End Autonomous Pipeline: From raw image upload $\rightarrow$ optical biomarker extraction $\rightarrow$ delta rule calculation $\rightarrow$ LLM clinical synthesis $\rightarrow$ clickable cheap online product links $\rightarrow$ PDF generation—all happening in under 2 seconds. Dual Skin & Hair/Scalp Focus: Bridging facial dermatology with trichology into a unified, elegant workstation. Zero Cloud / Privacy-First Architecture: Keeps sensitive medical photos and health timelines safely stored on the user's local machine.

What we learned

How quickly small shifts in biomarker telemetry (like a 15% drop in epidermal hydration) correlate with patient regimen changes (like introducing retinoids or stripping surfactants). The power of combining strict deterministic rule engines (for anomaly detection) with generative LLM reasoning (for clinical context handoff and product curation).

What's next for Dermlog

Real-Time On-Device Camera Guidance: Guided smartphone framing to ensure standardized facial angles and identical lux/lighting levels across weeks. Multi-Photo Region Mapping: Regional heatmaps isolating cheeks, forehead, crown, and hairline to track localized treatment efficacy. Direct EHR / Patient Portal Export: Direct HL7/FHIR export so dermatologists can import Dermlog telemetry straight into Epic or Cerner electronic medical records.

Built With

  • ai-agents
  • computer-vision
  • dermatology
  • groq
  • healthtech
  • html2canvas
  • jspdf
  • llama-3.1-8b
  • lucide-react
  • medical-ai
  • mysql
  • next.js
  • node.js
  • openrouter
  • prisma
  • react
  • recharts
  • rest-api
  • sqlite
  • tailwind-css
  • telemedicine
  • trichology
  • typescript
  • web-app
Share this project:

Updates

Submission history