Inspiration

As organizations rapidly adopt Generative AI tools, concerns around security, compliance, and ethical use are growing. Existing solutions lack centralized governance to define, enforce, and audit AI usage. This inspired us to build PromptFort — a practical solution to bring accountability and control to AI workflows.

What it does

PromptFort provides a secure, auditable framework for governing Generative AI usage. It enables organizations to define policies, analyze prompts for risks, enforce access controls, and track AI usage across teams. The platform helps prevent prompt injection, data leakage, and misuse of generated content.

How we built it

The platform consists of a React-based frontend for policy management and real-time analytics, integrated with Supabase for authentication and database management. We leveraged Pica's AI infrastructure to analyze prompts for security risks using both OpenAI and Gemini models. The entire application is hosted on Vercel for seamless deployment.

Challenges we ran into

Building real-time prompt analysis with AI models while ensuring privacy and performance was a key challenge. Integrating multiple tools like Supabase, Pica, and deployment pipelines also required careful coordination. Designing a secure, user-friendly admin interface for policy enforcement was another area that demanded attention.

Accomplishments that we're proud of

We successfully built a working prototype that combines prompt risk analysis, policy management, user access controls, and real-time logging. The platform is modular, scalable, and ready for production deployment. We are particularly proud of integrating AI moderation seamlessly into the user workflow.

What we learned

We gained deeper insights into building AI governance tools, integrating AI APIs securely, and managing real-time frontend interactions with cloud services. We also learned how to handle prompt filtering and analysis in a practical, business-ready manner.

What's next for PromptFort

Next, we plan to expand PromptFort with advanced incident response playbooks, deeper audit reporting, and integrations with popular enterprise tools. We also aim to refine prompt filtering using custom AI models and introduce more granular policy enforcement features.

Built With

Share this project:

Updates