-
-
AI Generated Chart: Product Popularity (Bar Chart)
-
AI Chat: What is my CLV? Calculate it. (Uses Store Data as Context)
-
Customer Location Map: Globe with AI Speak
-
AI Generated Chart: Customer Age Groups. (Pie Chart) - Custom Prompt to trigger Chat
-
AI Psychographic Analysis: Generate a Marketing Campaign
-
AI Generate Chart Dialog
-
AI Generate Product: Image Synthesis and SEO Description
-
AI Table Row Enhance: Edit JSON Product Data with Instructions
-
Fancy Animated AI Chat Button
-
Fancy New Chart Button (AI Generate Chart Function)
🚀 Inspiration
The inspiration behind SquareSense is as ambitious as it is groundbreaking. The aim was to create an app that not only elevates the business experience but also democratizes data accessibility, making it a valuable tool for all. We envisioned a platform that seamlessly integrates cutting-edge AI with Square to empower businesses with AI-driven insights, enhanced accessibility, and deeper customer engagement.
💼 What it does
SquareSense is more than just an app; it's an innovation powerhouse. This groundbreaking platform leverages the capabilities of Google Vertex AI and Square APIs to transform the business landscape. It offers a wide range of features that include:
- Enhancing product listings with AI precision.
- Exploring data insights through customizable and interactive charts.
- Making data accessible to everyone with spoken AI-generated charts.
- Engaging in real-time, informative conversations with the AI through the Chat feature.
With SquareSense, businesses can unlock the full potential of their data, making it an invaluable asset.
🔧 How we built it
Building SquareSense was no small feat. It required a combination of cutting-edge technology and innovative thinking. We seamlessly integrated Google Vertex AI and Square APIs to ensure that businesses have access to the most advanced tools for their growth.
The AI components were meticulously developed to provide personalized insights, interactive data representations, and instant responses through the chat interface. The user interface was designed for simplicity, ensuring that even those with minimal technical expertise can utilize its capabilities.
🛠️ Challenges we ran into
One of the major challenges we encountered during the development of SquareSense was the task of keeping the AI's attention sharp and robust, especially when dealing with large datasets from thriving e-commerce stores. Large datasets are not only voluminous but also require a high level of precision for AI-driven insights and calculations. To ensure that SquareSense could perform effectively on this larger scale, we had to invest significant effort into fine-tuning the Vertex AI models.
Real-world stress-testing with e-commerce stores was a pivotal part of this process. The AI's ability to handle the vast and dynamic data of these stores was rigorously examined. We needed to ensure that, even in the most demanding scenarios, the AI could maintain high performance, providing valuable insights and calculations without compromise.
Additionally, the chat interface was subjected to extensive fine-tuning to make it not only responsive but also context-aware. It had to adapt to the diverse needs of users and provide meaningful responses based on the unique data and questions it encountered. This adaptability was crucial in maintaining a strong and engaging AI experience, even in the face of complex, real-world data challenges.
📚 Leveraging Accessibility Insights
Our journey in developing SquareSense was informed by the latest research in accessibility, including a notable study titled "Rich Screen Reader Experiences for Accessible Data Visualization." This study, conducted by a team of esteemed researchers including Jonathan Zong, Crystal Lee, and Alan Lundgard from MIT CSAIL, JiWoong Jang from Carnegie Mellon University, and Daniel Hajas from the Global Disability Innovation Hub, offers a deeper understanding of the challenges and opportunities in accessible data visualization.
The study, which was recognized as a "Best Paper Honorable Mention" at the Computer Graphics Forum (Proc. EuroVis) in 2022, is a testament to the importance of inclusivity and accessibility in data presentation. With a DOI of 10.1111/cgf.14519, it underscores the significance of making data not only available but also comprehensible to all.
SquareSense is proud to align with this research, and our commitment to accessibility and inclusivity is informed by the insights gleaned from such pioneering work. We strive to ensure that SquareSense is a platform where every user, regardless of their abilities, can engage with data and AI in a meaningful way, turning information into a powerful asset for their business.
💪 Accomplishments that we're proud of
One of the proudest achievements of the SquareSense team is creating a platform that empowers businesses of all sizes. We've successfully harnessed the power of AI to make data accessible and valuable, no matter the scale of the business. The integration of Google Vertex AI and Square APIs has paved the way for a transformative experience that can boost the growth of businesses across various industries.
🧠 What we learned
During the development of SquareSense, our team gained invaluable insights into the potential of AI-driven solutions. We discovered the significance of combining innovation with user-friendly design to ensure that businesses can leverage technology to its full extent. Our experiences with data accessibility and interactive data representations underscored the importance of inclusivity and user engagement.
🚀 What's next for SquareSense AI - Personalized Ecommerce Intelligence
The journey for SquareSense is far from over. We envision a future where SquareSense continues to evolve, offering even more advanced AI capabilities and further enhancing the user experience. Our roadmap includes:
- Expanding the AI's capabilities to provide even more personalized insights.
- Integrating additional data sources to enrich the user experience.
- Continuing to improve accessibility and inclusivity features.
- Exploring opportunities for AI-powered automation in business processes.
In conclusion, SquareSense is not just an app; it's a vision for the future of business intelligence, and we're excited to keep pushing the boundaries of what's possible in the world of AI-driven commerce.
How to Access SquareSense
Open the URL. It will show you an Authentication page.
There are three (3) options:
- Authenticate: Login with your live Square store. WARNING Not recommended if you are just testing out SquareSense, as it can act on your real data.
- Sandbox Authenticate: Login with your sandbox Square store. Recommended for testers and judges. NOTE THAT YOU MUST HAVE YOUR SANDBOX STORE OPEN IN ANOTHER TAB FOR THIS TO WORK
- Test Mode: Use my (the developer's) sandbox Square store. This option won't exist forever, and is just here to make SquareSense easily accessible during the judging period.
Enjoy! ❤️
Built With
- ai
- google-ai
- javascript
- jwt
- machine-learning
- ml
- nextjs
- node.js
- oauth
- redis
- sql
- vertex





Log in or sign up for Devpost to join the conversation.