Personalized Baseball Commentary Experience

recreating commentary using image-gen image generation capabilities
generating score of player based on the insights derived from the mbl dataset

Title: Personalized Baseball Commentary Experience

Overview Our solution enhances the baseball fan experience by providing personalized, real-time commentary based on user preferences. Fans log in via Firebase authentication, set their preferences (favorite team, player, language, and key events like home runs or player outs), and receive tailored commentary, images, and audio highlights. This ensures an immersive and customized fan experience.

How It Works

User Authentication & Preferences • Users log in using Firebase authentication. • Preferences (favorite team, player, language, key events) are securely stored in Google Cloud Storage (GCP Bucket).
Commentary Processing • Live game commentary is filtered based on user preferences. • Gemini-1.5-Pro-002 classifies whether a commentary snippet is a key highlight (analyze_key_moment).
Sentiment Analysis & Audio Generation • If a snippet is identified as a key highlight, Google Cloud NLP performs sentiment analysis to determine tone and emotional impact. • The sentiment score influences the pitch and speed of the generated audio using Google Cloud Text-to-Speech. • Commentary is also summarized using Gemini-1.5-Pro-002 (generate summary).
Enhanced Image Generation • The original commentary is processed by Gemini-1.5-Pro-002 to generate an enhanced prompt for image creation. • Images are generated using Imagen-3.0-Generate-002 and stored in the GCP Bucket.
Language Translation & Multi-Language Audio • Commentary is translated into the user’s preferred language. • Generated audio is adapted to match the user’s language and accent.
Player Card Generation • Player cards are generated using Stability AI.
Data Storage & Frontend Display • Audio and image files are uploaded to the GCP Bucket. • The frontend retrieves and displays personalized commentary, images, and audio highlights via a web UI.

Key Technologies Used • Firebase Authentication – User login and session management.

• Google Cloud Storage – Storing user preferences, images, and audio files.

• Gemini-1.5-Pro-002 – Commentary classification, summarization, and enhanced image prompt generation.

• Google Cloud NLP – Sentiment analysis for voice modulation.

• Google Cloud Text-to-Speech – Generating dynamic audio commentary.

• Google Cloud Translation – Translating text and audio into user-preferred languages.

• Imagen-3.0-Generate-002 – Generating images based on commentary.

• Stability AI – Player card generation.

• Web UI – Displaying the customized content for users.

Innovation & Impact • Hyper-Personalized Experience: Fans receive commentary tailored to their interests.

• Multimodal Engagement: A blend of text, audio, and images for an immersive experience.

• Real-Time Filtering: Users only receive the most relevant game moments.

• Enhanced Accessibility: Multi-language support for a global fanbase.

• Emotional Connection: Sentiment-driven audio commentary enhances engagement. Future Enhancements

• Integration with Live Video Feeds – Providing real-time overlays and commentary.

• AI-Powered Deep Dives – Offering detailed analytics and strategic insights based on live game data.

• Augmented Reality (AR) Support – Displaying highlights in AR for an interactive experience.

• Social Media Sharing – Enabling users to share customized highlights.

This AI-powered solution revolutionizes the way baseball fans engage with live commentary. By leveraging cutting-edge AI and cloud technologies, we ensure an engaging, tailored, and emotionally compelling fan experience.

Built With

axios
eslint
firebase
gcpstorage
gemini-1.5-pro-002
googlecloudnlp
googlecloudtext-to-speech
googlecloudtranslation
imagen-3.0-generate-002
postcss
react
summarization
tailwind
vite

Submitted to

Created by

I contributed to this hackathon project by developing frontend user interface (UI) for the MBL-Game project, focusing on delivering a visually engaging, responsive, and interactive experience. My role involved designing the UI layout, implementing animations, and ensuring seamless user interactions to enhance the overall user experience.

Key Contributions

1. UI/UX Design & Implementation
Designed an intuitive and visually appealing interface that aligns with the game’s theme.
Developed a structured layout to improve user navigation and accessibility and applying a consistent color scheme, typography, and responsive design principles for a polished and professional look.

2. Component-Based Architecture
Built reusable React.js components to ensure maintainability and scalability.
Implemented React Hooks (e.g., useState, useEffect) for efficient state management.
Integrated React Router for smooth navigation between different sections of the game.

3. Animations & User Interaction Enhancements
Leveraged Framer Motion to create fluid animations and interactive transitions.
Applied CSS animations to enhance hover effects and UI responsiveness.

4. Responsive Design & Styling
Utilized Tailwind CSS for efficient, utility-based styling and rapid UI development.
Integrated Material-UI (MUI) components to provide a modern and user-friendly interface.
Ensured full responsiveness across various screen sizes and devices.

Technologies & Resources Used:

1. Frontend Development Framework & Libraries
React.js – For building a modular, component-based UI and React Router For efficient client-side navigation and routing.

2. Styling & UI Components: Tailwind CSS For utility-first, responsive styling. Material-UI (MUI) – For pre-built UI components and improved accessibility.

3. Animations & Motion Effects:
Framer Motion For smooth UI animations and transitions. CSS Animations & Transitions – For additional interactive elements.

4. Icons & Visual Assets
React Icons – For adding iconography to UI elements. Custom Images & Graphics Integrated logos, avatars, and background elements.

Conclusion
The MBL-Game frontend UI was designed with a focus on user engagement, responsiveness, and dynamic interactivity. By utilizing React.js, Tailwind CSS, Framer Motion, and Material-UI, the interface ensures a seamless and visually captivating user experience. The integration of animations and real-time data updates enhances gameplay immersion, making interactions more intuitive and enjoyable.

Adetoye Daniel Gabriel
Full-Stack Developer
I contributed to this hackathon project by developing backend APIs and integrating them with the frontend UI using HTML. Worked collaboratively in a team to ensure seamless communication between the backend and frontend, enabling smooth functionality and user experience.

Gayathri Devi B
I led the development of an AI-powered personalized content delivery system, serving as both Project Manager and Team Lead, while also contributing to research, architecture, and AI development.

Key Contributions
Project Management & Team Leadership: Managed the entire project lifecycle, overseeing development, coordinating tasks, and ensuring timely delivery. Led a cross-functional team, aligning efforts to achieve our vision.
Research & Analysis: Conducted extensive R&D on personalized content applications, identifying key trends, challenges, and innovative solutions.
Solution Architecture: Designed a scalable, AI-driven system, ensuring seamless integration of AI models and user preferences.
End-to-End AI Implementation: Developed the AI solution using state-of-the-art models like Imagen and GCP AI tools, enabling real-time personalized commentary, insights, and media generation.
MLB Data Research & Insights: Conducted deep research into MLB datasets, analyzing key insights and defining how they could be leveraged to enhance user engagement. Provided strategic input on the best ways to integrate player statistics and historical performance data.
As both Project Manager and AI Lead, I drove the project forward, ensuring an innovative and well-researched approach to AI-powered sports personalization.

satyanarayana madaraboina
Tejasri Masina
Kalki Kalki
Shivam pateriya