Git AI PR Review Bot

We write prompts, not code. Why don't we see the prompts in PR reviews today? The Git AI PR Review bot solves that by syncing the pull request code with the prompts that were used to write the code.

Comment

Inspiration

Many of the contributions on our open source projects are authored in collaboration with AI coding agents. When we review such PRs, we want to know what was written by AI and what prompts were used, so that we know what the developer intended the code to do. This gives us the context that we need in order to review these PRs.

What it does

  1. GitHub Action that runs git-ai to pull AI authorship data for PRs, submit that data to our central server, and then update the PR comment with the review URL.
  2. NextJS app that runs Gradient AI to create code and prompt summaries and review the pull request. The NextJS app also serves the PR Review UI.
  3. Developers can click the PR description link to use the Git AI PR Review bot.

How we built it

  1. We extended git-ai (an existing open source project) to get all the data on prompts that the agents used and the code that they wrote.
  2. We build a GitHub Action that runs the extended git-ai to capture and submit all this data to our NextJS server that stores it in a Postgres DB.
  3. The NextJS app serves the UI and uses Gradient AI to power all of the AI features that help developers review PRs better with more context

Challenges we ran into

  1. Parsing git diffs is hard!
  2. Connecting two scroll panes is somehow even harder.
  3. Found a tool calling bug in Claude Code
  4. Encountered some issues with the Gradient Typescript SDK

Built With

Share this project:

Updates