π adminisAI: AI-Powered Content Moderation
π Inspiration
With the increasing reliance on digital communication, online platforms are struggling with hate speech, misinformation, and toxic content. Many platforms still use manual moderation, which is slow, inconsistent, and resource-intensive.
We envisioned adminisAIβa real-time AI-powered content moderation system that not only filters harmful content but also suggests constructive alternatives using Gemini AI.
π‘ What It Does
AdminisAI is an AI-driven moderation assistant that:
β
Analyzes text-based content (social media posts, chat messages, forum comments).
β
Detects harmful content like hate speech, cyberbullying, and profanity using Perspective API.
β
Provides AI-powered suggestions using Gemini API to rephrase flagged messages into more inclusive and constructive versions.
β
Flags or filters inappropriate content before it reaches users.
β
Integrates with multiple platforms (web apps, forums, and Chrome extensions).
β
Offers a dashboard for admins to review flagged content and AI suggestions.
π How We Built It
We leveraged Cloudflareβs edge computing capabilities to create an ultra-fast, scalable solution.
πΉ Tech Stack
- Cloudflare Workers β For AI-powered real-time content filtering.
- Cloudflare AI Gateway β Optimized API requests to minimize latency.
- Perspective API β AI-based toxicity detection and sentiment analysis.
- Gemini API β AI-powered text suggestions to rephrase flagged content into a more constructive message.
- React & Chrome Extension β A seamless UI for moderation controls.
πΉ Project Structure
The project structure for the AI-powered content moderation system is organized into multiple components to ensure modularity and efficiency. At the root level, the project contains the core directories, including the Cloudflare Worker and the Google Chrome Extension. The Cloudflare Worker, located in the /worker/ directory, is responsible for handling AI-powered moderation using the Perspective API. Within this directory, the ai-moderation-worker subfolder contains the main logic in index.ts, along with necessary configuration files such as wrangler.jsonc for Cloudflare settings and package.json for dependencies. On the frontend side, the Google Chrome Extension, found in the /extension/ directory, allows real-time content filtering in the browser. It includes a manifest.json file defining extension permissions, a background.js script that communicates with the Worker API, and a content.js script injected into web pages to detect and filter content dynamically. Additionally, the popup/ folder houses the extensionβs user interface, containing popup.html for structure, popup.js for logic, and popup.css for styling. This structured approach ensures seamless integration between the Cloudflare Worker and the Chrome Extension, enabling efficient and real-time content moderation.
π§ Challenges We Ran Into
π΄ Latency Optimization β Initial API calls were slow; integrating Cloudflare AI Gateway helped reduce response times.
π΄ Balancing Moderation with Free Speech β AI models needed fine-tuning to avoid excessive censorship.
π΄ Handling Edge Cases β AI struggled with sarcasm, slang, and contextual nuances.
π΄ Gemini API Integration β Ensuring suggested rephrasings were natural and contextually relevant.
π΄ Security Concerns β Protecting API requests from abuse and ensuring ethical AI implementation.
π Accomplishments That We're Proud Of
π― Successfully integrated AI-powered moderation with real-time filtering.
π― Implemented Gemini AI to provide smart, positive rephrasings of flagged messages.
π― Developed a Chrome Extension for seamless in-browser moderation.
π― Built a user-friendly dashboard with moderation insights and AI-powered suggestions.
π― Optimized performance using Cloudflare AI Gateway for lower latency.
π What We Learned
β AI moderation isnβt just about filteringβitβs about encouraging better conversations.
β Fine-tuning AI models is crucial for accurate and ethical moderation.
β Combining multiple AI services (Perspective API + Gemini API) improves moderation effectiveness.
β Serverless AI on the edge dramatically reduces latency for real-time applications.
β User experience mattersβadmins need clear insights into moderation decisions.
π What's Next for adminisAI
β
Enhance AI model accuracy with better training data and fine-tuning.
β
Expand support for multiple languages to improve global content moderation.
β
Support multimedia moderation (images, videos, and voice content).
β
Deploy as a SaaS platform for easy integration into online platforms.
β
Provide real-time analytics & reporting to help moderators track trends.
π GitHub Repository: [adminisAI β AI-Powered Moderation]link
adminisAI is a step toward creating a safer and more inclusive internet. Weβre excited about its potential and looking forward to making online spaces smarter, safer, and more engaging! πβ¨
Built With
- cloudfare
- javascript
- react
Log in or sign up for Devpost to join the conversation.