Inspiration
Our inspiration begins with the legendary baseball icons we admired since childhood, adorning our room walls with their posters. Like every true baseball fan, we would mimic the playing styles of our favorite players. This project came to life from the question: could we play in a way that mirrors the style of these legends with statistics?
What it does
The "Beyond the Plate" team transforms baseball into a more interactive, fun, and personalized experience using advanced data analysis and computer vision technologies powered by Google Cloud. It goes beyond traditional stats by providing in-depth insights into player movements, creating heatmaps, and analyzing game footage without manual input. Players can improve their skills with personalized training, coaches can develop more effective strategies, and fans can engage with the game in a whole new way through detailed analytics and immersive gaming experiences. With real player motion data and analytics, we aim to develop realistic baseball games similar to the MLB The Show series.
How we built it
We built Beyond the Plate by leveraging the power of Computer Vision and Google Cloud’s advanced tools to analyze and enhance the baseball experience. Using Google Cloud’s AI and machine learning services, we processed archival baseball footage player data to extract meaningful insights.
By utilizing Google Cloud Storage, AutoML, we efficiently store and analyze videos, generating heatmaps and detailed reports.
With this AI-driven approach, we’ve built an interactive platform that enables players to improve their skills, coaches to refine strategies, and fans to experience a deeper level of engagement with the game—all accessible through just a computer or a phone.
Challenges we ran into
Previously, we had used some of Google's amazing technologies. However, with this competition, we started using its new tools because the more technologies we utilize, the better we can understand Google and improve our project. For this reason, we aimed to learn as much as possible. This process took a bit longer than expected, but it provided us with a lasting and efficient learning experience.
Accomplishments that we're proud of
We’re proud of the transformative impact 'Beyond the Plate' has made in bridging the gap between baseball and technology. By harnessing the advanced tools of Google Cloud, we’ve made baseball more accessible to everyone, whether you're a player, coach, or fan. Our advanced computer vision technology provides in-depth analytics and insights that weren’t available before, allowing players to improve their skills using real-time data. We’ve also created a platform that allows coaches to develop strategies based on comprehensive player movements and historical data. With our app, baseball enthusiasts can experience a more immersive game environment, and we've taken baseball's reach beyond the field, turning it into a digital, globally accessible experience. No matter where you are in the world, it's now possible to have every detail of baseball right at your fingertips. And the data collected enables more realistic games at home, contributing to our personal development in sports and enhancing the evolution of game culture by introducing new and innovative tactics to the field games we watch, which makes us very happy.
What we learned
Throughout this journey, we've learned the incredible potential of combining sports and technology. The use of Google Cloud’s tools, such as computer vision and advanced data analytics, has opened new doors for both fans and players. We’ve learned how powerful AI can be in analyzing player movements and transforming complex game data into valuable insights. Additionally, we’ve discovered how to make baseball more interactive and engaging for everyone, from coaches using data to refine strategies to players enhancing their skills with personalized training. This experience has also taught us the importance of accessibility, ensuring that all you need to experience baseball in a whole new way is a computer or phone. With data and image processing, we can now make everything more realistic, innovative, and engaging.
What's next for Beyond The Plate
Our next goal is to introduce baseball to all countries and ensure that fans without access to a field or proper facilities can embrace and feel a part of this sports culture. While baseball has been played less or remained distant in certain countries and regions for various reasons, we aim to be a catalyst for change and create a new opportunity for growth. To achieve this, we will continue utilizing the powerful tools we’ve learned about and been inspired by through Google Cloud in this competition.
Built With
- cloud-vision-api
- docker
- firebase
- flask
- google-app-engine
- google-cloud
- google-cloud-automl
- google-cloud-run
- google-cloud-sql
- google-compute-engine
- google-vector-search
- javascript
- python
- react
- vertex-ai

Log in or sign up for Devpost to join the conversation.