Inspiration
• Real-time vital monitoring usually requires wearables or medical devices.
• Many users don’t track their health consistently because it’s inconvenient.
• We wanted a camera-only approach that feels effortless, works anywhere, and motivates daily use through rewards.
⸻
What We Built
DailyVitals.AI is an iOS app that uses the SmartSpectra SDK to extract heart rate and breathing rate through the camera, displays charts and trends, allows users to ask an AI coach for insights, and rewards users daily through Solana Devnet micropayments.
⸻
Key Features
• Camera-only vital sign measurement (heart rate + breathing rate).
• Real-time visual graph of vitals using SwiftUI Charts.
• AI Coach powered by DigitalOcean Gradient: summaries, insights, and health explanations.
• Phantom Wallet quick-connect for Solana.
• Daily claim reward system with 0.0125 SOL on Devnet.
• Local-only session storage for privacy.
• Smooth SwiftUI navigation and native iOS experience.
⸻
How It Works
1. User opens SmartSpectra view and aligns their face.
2. SmartSpectra continuously streams pulse and respiratory signals.
3. Vitals are stored as timestamped samples and plotted in Swift Charts.
4. User can send the entire session to Gradient AI for interpretation.
5. User connects their Phantom Wallet to the app.
6. User taps “Daily Reward” → iOS -> Flask backend -> Solana Devnet transfer.
7. Backend enforces 1 reward per day per wallet.
⸻
Integration with MLH Tracks
Solana
• Phantom Wallet quick-auth implemented via universal links.
• Devnet reward system with controlled backend distribution (via Python Flask Backend Server).
• Base58 validation + transaction signing through solders SDK (set up a giver wallet and got 16 phrase to programmatically give solana from that wallet).
Presage
• SmartSpectra continuous-mode integration.
• Configured Camera → Graph → AI → Rewards pipeline.
• Heart and breathing rates consumed directly from Presage’s metrics buffer.
DigitalOcean Gradient AI
• Custom /ask endpoint for text insights.
• Gradient /chat/completions used to interpret recorded vitals (Llama-3-8-instruct).
• AI gives plain-language summaries and wellness recommendations.
Vultr
Our Python Flask Backend server is successfully deployed to Vultr with public URL ip address of -> 78.141.226.180
Do you want to try our backend endpoint of giving a user 0.0125 SOL?
Make a SOL devnet wallet address either from phantom wallet or Solana CLI and
do the curl command below with your wallet address! (curl command on mac or Windows gitbash)
We will give 0.125 SOL only once! Multiple redeem overuse will be detected!!
curl -X POST http://78.141.226.180:5000/rewards/daily-claim \ -H "Content-Type: application/json" \ -d '{"wallet": "YOUR_WALLET_ADDRESS"}'
⸻
Impact
• Enables daily health awareness without wearables.
• Encourages consistency through micro-incentives.
• Useful for early detection of stress trends, breathing irregularities, or recovery.
• Makes advanced biometric sensing accessible on any iPhone.
⸻
Challenges We Overcame
• Interfacing SmartSpectra’s MediaPipe-based graph system in SwiftUI.
• Handling asynchronous vital updates without dropping frames.
• Creating a clean UI while avoiding SDK timing errors.
• Phantom universal-link handling and returning to the app.
• Designing a Solana backend that is safe, rate-limited, and simple for users.
• Formatting vitals for AI interpretation in a stable, structured way.
⸻
What’s Next
• Add local history so users can compare days and weeks.
• Build streak rewards and habit tracking.
• Add HRV (heart rate variability) when SmartSpectra supports it.
• Add sleep-time camera monitoring mode.
• Encrypt session uploads via Privy or Lit Protocol.
• Deploy a production Solana Program (on-chain reward logic).
Built With
- digitalocean
- docker
- gradient-ai
- gunicorn
- llama-3
- presage
- python
- solana
- swift
- vultr

Log in or sign up for Devpost to join the conversation.