Inspiration For many people involved in creative fields, architecture, or planning, the process of turning a basic idea into a detailed and visually appealing proposal can be challenging. Our goal was to streamline this process and make it more intuitive.
What it does This application takes basic inputs, whether in the form of a sketch or a file, and with a brief description, it provides context to guide the design towards a specific theme. Based on the input "sketch," it suggests ideas and generates a detailed image that aligns with the given context.
How we built it We used Flutter to develop the mobile application and manage the connections between various services. For the backend, we employed Python with Intel OpenVINO and SPADE, which includes CocoStuff and Pix2Pix. OpenVINO is used to optimize the SPADE model, which, based on a sketch and its context, generates a detailed image. This image is then stored in the user's history in Firebase, and once the final part of the workflow is complete, the image is processed into a 3D model (in .glb format) and stored for the user.
Challenges we ran into We had never worked with many of the technologies used in this project, particularly generative AI models such as Pix2Pix, SPADE, or Intel OpenVINO for model optimization. Learning how to effectively integrate these was a significant challenge.
Accomplishments that we're proud of We successfully completed everything we had planned, despite facing numerous challenges during the development process, many of which were completely new to us.
What we learned We gained a deep understanding of how to effectively use and adjust existing AI models to fit the specific functionality needed to bring our idea to life.
What's next for Design Companion - PerritosDormilones - RETO SOFTTEK Our next steps include implementing the ability to download 3D models directly within the app, increasing the complexity of the generated designs, and expanding the dataset to accommodate even more use cases.
Inspiration Para muchas personas involucradas en el área creativa, de arquitectura o planeación el proceso de convertir una idea básica en una propuesta detallada y agradable a la vista
What it does Una aplicación que toma detalles básicos ya sea a manera de dibujo o como archivo y con una pequeña descripción se le brinda un contexto para ver hacia que temática se pueden orientar los detalles del "sketch"
How we built it Utilizando Flutter para generar los diseños de la aplicación móvil y las conexiones entre diferentes servicios, Python con Intel OpenVino y SPADE consistiendo de Cocostuff y Pix2Pix, donde Openvino sirve para optimizar el modelo de SPADE que basandose en un Sketch y el contexto se genera una imagen detallada, que se almacena en Firebase en el historial del usuario y cuando queda la parte final del flujo de una imagen se almacena para el usuario ya procesada como modelo 3D como formato glb
Challenges we ran into
Nunca habíamos trabajado con muchas tecnologías de las que se utilizaron en estre proyecto, en especial modelos de inteligencia artifical generativa como Pix2Pix, SPADE o Intel OpenVino para optimizar los modelos.
Accomplishments that we're proud of Se logró completar todo lo que teníamos planeado a pesar de todos los obstáculos que fuimos enfrentando durante el proceso de desarrollo, muchos de los cuales eran completamente nuevos
What we learned Como se utilizan efectivamente y se ajustan los modelos ya existentes para que tengan la funcionalidad que necesitas para que tu idea salga adelante
What's next for Design Companion - PerritosDormilones - RETO SOFTTEK Lograr implementar no solo la descarga de los modelos 3D dentro de la aplicación, darles mayor complejidad a los diseños que se generan y un dataset más grande para que se ajuste a aún más casos
Log in or sign up for Devpost to join the conversation.