ShortsHub

ShortsHub Logo

Inspiration

The explosion of short-form video content and live streaming has transformed how creators engage with their audiences. Yet, rewarding genuine engagement and fostering positive community interactions remain challenging. We were inspired to build a platform that not only analyzes live stream content and comments in real-time but also rewards meaningful participation, leveraging AI to ensure fairness and fun. Our goal: empower creators and viewers alike, making every interaction count.

What it does

ShortsHub is an end-to-end platform that analyzes live streaming sessions—both audio and video—while monitoring chat comments for sentiment and engagement. Using advanced AI models, it scores content quality and audience interactions, then distributes rewards to participants based on their contributions. The system is designed to be transparent, scalable, and creator-friendly, with a modern web frontend and a robust backend.

Key features include:

Real-time audio and video analysis using AI (Gemini, etc.) Sentiment analysis of live chat comments Automated reward distribution based on engagement and sentiment Creator dashboard for monitoring streams, analytics, and rewards Secure, scalable backend with Django and SQLite How we built it We structured the project as a full-stack application:

Backend: Built with Django, the backend handles user management, stream metadata, comment and sentiment analysis, and reward logic. We integrated AI services for audio/video analysis and comment sentiment scoring. The backend exposes RESTful APIs for the frontend and manages all business logic and data persistence.

Audio and video files are processed and scored using custom services (see gemini_audio_service.py, gemini_video_service.py). Comments are analyzed in real-time for sentiment and engagement (see comment_analysis_service.py). Rewards are calculated and distributed via the reward_service.py. All data is stored in a SQLite database for rapid prototyping. Frontend: Using React (with Vite for fast builds), the frontend provides an intuitive interface for creators and viewers. Users can view live analytics, track rewards, and interact with streams. The frontend communicates with the backend via a clean API layer.

DevOps: We used Python virtual environments for dependency management and kept environment variables secure with .env files. The project is structured for easy deployment and scaling.

Challenges we ran into

Real-time Processing: Ensuring low-latency analysis of audio, video, and comments was technically demanding. We had to optimise our AI service calls and manage asynchronous processing. AI Integration: Integrating multiple AI models (Gemini, HuggingFace) and tuning them for live streaming data required significant experimentation. Reward Fairness: Designing a reward system that is both fair and resistant to spam or manipulation was a complex challenge. Frontend-Backend Sync: Keeping the frontend in sync with real-time backend analytics, especially for live streams, required careful API design and state management.

Accomplishments that we're proud of

Seamless integration of real-time AI-powered analysis for both audio/video and comments. A robust reward system that incentivises positive engagement. A clean, modern frontend that makes analytics and rewards transparent to users. Modular, extensible codebase ready for new features and scaling.

What we learned

The importance of efficient data pipelines for real-time applications. How to balance AI accuracy with performance in a live setting. The value of clear API contracts between frontend and backend. Best practices for structuring a full-stack project for rapid iteration.

What's next for ShortsHub

Blockchain Integration: Move reward distribution to a blockchain for transparency and trust. Multi-platform Support: Expand to support more streaming platforms and formats. Advanced Analytics: Add deeper insights for creators, including audience retention and content suggestions. Community Features: Enable more ways for viewers to interact and collaborate. Scalability: Migrate to a production-grade database and deploy on cloud infrastructure.

ShortsHub is just getting started. We’re excited to keep building a platform where every voice and every moment matters!