ChicMate

ChicMate is a multi-modal mobile application that provides personalized fashion outfit recommendations from user's wardrobe using state-of-the-art deep learning models. The app integrates image and text inputs—as well as location data—to offer context-aware style suggestions which suggests outfits that are apt for user's location in terms of weather and local trends. It features a conversational chatbot interface, digital wardrobe management, and real-time recommendations.

Features

  1. Conversational Interface: Chat with the app to request outfit ideas.
  2. Image & Text Input: Upload images (e.g., a clothing item) or type queries.
  3. Digital Wardrobe: View, add, and delete wardrobe items.
  4. Context Awareness: Leverages past conversation history and geolocation to refine recommendations. (If users asks for recommendation for a specific location, it improvises accordingly).
  5. Personalized Recommendations: Uses CLIP for visual/text embedding and Google Gemini for natural language understanding.

Technologies

  • Frontend: React Native with Expo
  • Backend: FastAPI
  • Machine Learning: CLIP (via Hugging Face) for embeddings; Google Gemini for natural language generation
  • Database & Authentication: Firebase Firestore and Firebase Authentication
  • Location: Expo Location API

Usage

  • Wardrobe Management:

    Navigate to the wardrobe screen to upload, view, and delete wardrobe items.

  • Getting Recommendations:

    Use the recommendation chat interface to type queries or upload an image (e.g., a picture of pants) to get outfit suggestions.

Screenshots

  1. Sign In Screen - Sign In
  2. Sign Up Screen - Sign_up
  3. Wardrobe Screen - Wardrobe Screen
  4. Empty Wardrobe Screen - Empty wardrobe screen
  5. Example - Wardrobe Items - Wardrobe item view - Wardrobe item view 2
  6. Recommendation Screen - Chatbot interface
  7. Model Feedback -
    • Textual query - textual query feedback - textual-query-feedback 2
    • Image-upoad feedback - Image-upload-feedback - image-feedback 2

Built With

Share this project:

Updates