-
-
Autonomous dark-mode viewport integrating live webcam capture, diagnostic presets, and real-time biometric ingestion.
-
Multidimensional 16-parameter radar chart normalizing clinical biomarkers from the YouCam S2S Skin Analysis API v2.1.
-
Precision heatmap coordinates mapped to facial contours, targeting localized erythema, pore congestion, and active acne.
-
DeepSeek-V4.1-Flash clinical triage engine gating contraindicated peeling acids to preserve compromised skin barriers.
-
Dynamic cart formulator assembling an AM/PM regimen with clinical concentrations and biometric bundle discounts.
-
Interactive dermatological reasoning drawer explaining clinical formulation logic grounded in patient biometric telemetry.
Inspiration
What it does
How we built it
Challenges we ran into
Accomplishments that we're proud of
What we learned
What's next for DermaTwin OS
Inspiration
Over 80% of online skincare purchases result in consumer dissatisfaction, product returns, or severe cutaneous barrier damage. Today's digital beauty commerce relies on superficial quizzes and unscientific influencer questionnaires. Consumers blindly purchase active dermatological acids (such as 10% Glycolic Acid, 2% Salicylic Acid, or High-Strength Retinoids) without clinical awareness of their underlying skin barrier integrity or inflammatory vascular state. The Clinical Danger: Applying peeling alpha-hydroxy acids to an inflamed or barrier-compromised stratum corneum causes chemical irritation, post-inflammatory hyperpigmentation, and worsened erythema.
DermaTwin OS was engineered to bridge the gap between clinical computer vision and personalized commerce through a closed-loop biometric formulation system.
What it does
DermaTwin OS transforms skincare commerce from hazardous guesswork into an autonomous, closed-loop biometric formulation system:
- 16-Biomarker Facial Engine: Integrates Perfect Corp's YouCam S2S Skin Analysis API v2.1 to evaluate 16 clinical parameters (Acne, Malar Erythema Redness, Pores, Oiliness, Wrinkles, Texture, Dark Circles, Eye Bags, Moisture, and Barrier Integrity).
- Autonomous Contraindication Gatekeeper: An agentic safety gatekeeper powered by DeepSeek-V4.1-Flash audits candidate formulations. If a patient exhibits reactive redness or barrier score < 60/100, peeling AHAs/BHAs are blocked in favor of a 3:1:1 physiological ceramide, cholesterol, and free fatty acid restoration matrix.
- Interactive Facial Blemish Overlays: Real-time spatial heatmaps directly mapped to facial landmarks.
- Dynamic Headless eCommerce Drawer: Generates a custom AM/PM regimen with itemized SKUs, volume, application order, and algorithmic biometric discounts (
DERMATWIN15). - Grounded AI Dermatological Advisor ("Ask DermaTwin"): A contextual chat drawer grounded in the user's live 16-parameter telemetry to explain why specific actives were included or blocked.
How we built it
- Frontend & App Architecture: Next.js 15 (Turbopack), React 19, TypeScript, and Tailwind CSS.
- Biometric Vision Core: Perfect Corp YouCam S2S Skin Analysis API v2.1 via task polling lifecycle.
- Clinical Reasoning Engine: DeepSeek-V4.1-Flash running on Nebius Token Factory for high-throughput pharmacological contraindication auditing.
- Visualizations: Recharts 16-vector biometric spider radar chart and SVG precision gauges.
- Media QA Pipeline: Playwright Chromium automation, Edge-TTS neural voiceover, and FFmpeg 7.1 for 4K video generation.
Challenges we ran into
- Normalizing 16 disparate clinical actions into balanced 0-100 diagnostic vectors in real-time.
- Implementing zero-latency UI updates between the YouCam task polling lifecycle and the slide-out eCommerce cart.
- Engineering robust prompts for the DeepSeek gatekeeper to strictly prioritize pharmacological barrier safety over generic sales recommendations.
Accomplishments that we're proud of
- Delivering a zero-blank, high-contrast accessible UI following Grandma Theory principles.
- Building a true end-to-end flow from live camera capture to a safe, dynamic checkout routine.
- Achieving an Ultra-HD 4K walkthrough and full MIT-licensed open-source repository.
What we learned
- Deep integration patterns for Perfect Corp YouCam S2S asynchronous task queues.
- How to ground LLM reasoning agents in dense multidimensional biometric arrays to eliminate clinical hallucinations.
What's next for DermaTwin OS
- Longitudinal tracking across 30-day treatment cycles to visualize barrier restoration progress.
- Native Shopify Storefront API and WooCommerce webhook integrations for live one-click fulfillment.
Built With
- deepseek-v4.1
- nebius
- next.js
- perfect-corp-api
- playwright
- react
- recharts
- tailwindcss
- typescript
- youcam-api
Log in or sign up for Devpost to join the conversation.