Fantasy Pet AR Lens

An AI-powered Snapchat Lens that transforms users into magical fantasy creatures using Lens Studio AI. Simply describe your dream creature and watch it come to life in AR with stunning 3D effects.

Comment

Inspiration

The rise of AI-generated content inspired us to explore how generative AI could transform AR experiences on Snapchat. We wanted to democratize AR creation, allowing anyone to become a fantasy character just by describing it in words.

What it does

Fantasy Pet AR Lens uses Lens Studio AI to transform users into magical creatures in real-time. Users simply describe their desired fantasy character (like "a cute fantasy pet with sparkling eyes and magical glow"), and the AI generates a custom 3D model that replaces their head with seamless face tracking. The result is a personalized, shareable AR experience that brings imagination to life.

How we built it

  • Lens Studio AI: Used Creator mode to generate 3D assets from natural language prompts
  • Face Tracking: Implemented real-time face detection and headmorph technology
  • 3D Rendering: Applied AI-generated models with proper lighting and materials
  • AR Pipeline: Optimized for smooth performance on mobile devices

Challenges we ran into

  • Learning Lens Studio's workflow and understanding AI generation parameters
  • Ensuring the AI-generated 3D models had proper face tracking anchor points
  • Optimizing the lens performance for real-time AR on various devices
  • Balancing creativity with technical constraints of mobile AR

Accomplishments that we're proud of

  • Successfully integrated cutting-edge Lens Studio AI into a working AR experience
  • Created a lens that's both technically impressive and immediately fun to use
  • Built something that demonstrates the future potential of AI-powered AR
  • Completed a functional project within the hackathon timeline

What we learned

  • How to use Lens Studio AI's Creator mode effectively
  • The importance of prompt engineering for 3D asset generation
  • AR face tracking and headmorph implementation techniques
  • The balance between AI creativity and technical performance in mobile AR

What's next for Fantasy Pet AR Lens

  • Add multiple creature variations with different themes (dragons, robots, aliens)
  • Implement interactive features like particle effects or animations
  • Create a game mode where users can collect different AI-generated creatures
  • Explore multiplayer features using Snapchat's Turn-Based Component

Built With

  • 3d-graphics
  • ar
  • face-tracking
  • genai
  • lens-studio
  • lens-studio-ai
  • snapchat
Share this project:

Updates