Quetzal

Inspiration

The inspiration behind Quetzal stemmed from the desire to create a dynamic application that seamlessly integrates real-time selfie capture, emotion detection through computer vision, and creative expression through poetry generation. Leveraging Eden API for emotion detection and ChatGPT for haiku generation, Quetzal aims to provide users with a unique and immersive experience where technology and art converge.

What it does

Quetzal is a dynamic application that allows users to capture selfies in real-time and detect the emotions portrayed in the images using computer vision powered by Eden API. The detected emotion serves as a prompt for ChatGPT to generate a haiku, which encapsulates the essence of the emotion with a touch of hope for something more. The generated title-emotion, along with the selfie and haiku description, can then be effortlessly converted into an NFT (Non-Fungible Token) with just a click of a button. In addition, the haiku can be used to generate an image. We went further and generated videos.

How we built it

Quetzal was built using a combination of cutting-edge technologies and APIs. The frontend of the application was developed using React.js, providing a responsive and intuitive user interface for capturing selfies and interacting with the generated content. The backend utilizes Node.js and Express.js to handle communication with the Eden API for emotion detection and ChatGPT for haiku generation. Integration with blockchain platforms such as Mintbase facilitates the seamless conversion of the generated content into NFTs.

Challenges we ran into

Building Quetzal posed several challenges, including integrating real-time selfie capture, ensuring accurate emotion detection through computer vision, and generating coherent and emotionally resonant haikus using AI. Additionally, seamless integration with blockchain platforms for NFT creation required careful attention to security and user privacy. Overcoming these challenges required innovative solutions and collaboration across multiple domains.

Accomplishments that we're proud of Despite the challenges, we're proud to have developed Quetzal, a unique and engaging application that combines technology, art, and creativity. We successfully implemented real-time selfie capture, accurate emotion detection, and AI-driven haiku generation, providing users with a novel and immersive experience. Additionally, the seamless conversion of generated content into NFTs adds a new dimension to digital ownership and creative expression.

What we learned

Through the development of Quetzal, we gained valuable insights into real-time image processing, emotion detection algorithms, natural language processing with AI, and blockchain integration for NFT creation. We learned the importance of user feedback and iterative development in refining the user experience and enhancing the application's functionality. Additionally, working with cutting-edge technologies and APIs broadened our understanding of the possibilities of digital creativity.

What's next for Quetzal

Looking ahead, we plan to further enhance Quetzal by adding more features and functionalities to enrich the user experience. This includes expanding the range of emotions detected and incorporating additional AI models for generating diverse forms of poetry. We also aim to explore opportunities for community engagement and collaboration, enabling users to share their NFT creations and connect with other digital creators. Ultimately, we envision Quetzal evolving into a vibrant platform for digital expression and storytelling. Furthermore, we can upgrade the recommendation system to use semantic search to recommend materials in mental health and education.

Built With

• arweave
• chatgpt4
• computervision
• html5
• kadinsky
• mintbase
• near
• nextjs-14
• nft
• pixray
• replicate
• stabilityai