techlist.io
KREN
line

Clearing Review Bottlenecks with AI - Transforming Review Culture with PR Review Support and Internal Workshops (opens in new tab)

aidatabase-designclaude-codegitfrontend-developmentbackend-developmentpr-reviewscreening-review

Orchestration Guild member Fukuyama describes how Yahoo! Places addressed PR review bottlenecks by combining AI assistance with standardized processes and team culture. Reviews had become concentrated among a few engineers, creating delays and forcing a trade-off between speed and quality. The team introduced Claude Code–based screening reviews, then expanded the approach into a broader system for improving PR creation, review accuracy, and continuous improvement.

PR Review Bottlenecks

  • In late 2024, review responsibilities were concentrated on the tech lead and one other engineer.
  • Reviewers were simultaneously implementing features and reviewing code, causing PR queues to grow.
  • The main problems were:
    • Authors could not move to their next tasks while waiting for reviews.
    • Review work consumed most of the day.
    • Large PRs had to be reviewed quickly, increasing the risk of missed bugs.
  • This created a single point of failure and exposed the trade-off between thoroughness and development speed.
  • The launch of a dedicated frontend team in early 2025 provided an opportunity to redesign the review process.

Introducing AI Screening Reviews

  • The team first tried having AI summarize PR changes before review.
  • Although summaries made changes easier to understand, AI did not sufficiently reduce the work of tracing dependencies or identifying hidden problems.
  • Manually pasting prompts for every review also made the approach inconvenient, so it was abandoned after about two weeks.
  • The introduction of Claude Code in summer 2025 changed the situation because reusable custom commands eliminated repetitive prompt preparation.
  • AI screening reviews now perform an initial inspection before a human reviewer makes the final judgment.
  • This changes the process from “humans inspect everything” to a two-stage model:
    • AI analyzes the PR, its impact, coding conventions, and possible risks.
    • A human reviewer validates the analysis and makes the final decision.

Claude Code Custom Review Commands

The custom command requests that Claude Code:

  • Summarize the PR and its affected areas.
  • Explain the before-and-after changes for each file.
  • Check coding and naming conventions.
  • Investigate dependent files and broader codebase impact.
  • Identify potential bugs, security issues, performance problems, code smells, and unintended side effects.
  • Suggest concise, respectful review comments for the author.
  • Classify comments with labels such as [must], [want], [imo], [ask], [nits], and [info].
  • Determine whether additional tests are needed based on existing project practices.

The command uses GitHub CLI operations such as:

  • gh pr view --json title,body,files,url
  • gh pr diff
  • gh pr view --comments
  • GitHub API calls for line-level comments
  • gh pr checkout when the relevant branch is not currently checked out

The review procedure is deliberately structured:

  1. Confirm the review requirements.
  2. Understand the PR’s overall purpose and background.
  3. Review each changed file in detail.
  4. Investigate dependencies across the codebase.
  5. Produce a final assessment and suggested comments.

The same screening process can help both reviewers and PR authors. Reviewers use it to reduce preparation time and understand impact, while authors can run it before requesting review to fix likely issues in advance.

Expanding Beyond AI Screening

After seeing benefits from screening reviews, the team created a broader improvement framework spanning technology and team culture. It was organized around four connected goals:

  • Improving efficiency.
  • Establishing a foundation for review accuracy.
  • Building review-oriented team culture.
  • Creating a mechanism for continuous improvement.

The approach treats review optimization as an ongoing cycle rather than a one-time tool deployment.

Automating PR Creation

The team also uses AI to reduce the effort required to create PRs.

  • Git operations such as branch creation, commits, and PR creation are automated.
  • AI analyzes the commit diff to generate:
    • A PR title.
    • A summary of the changes.
    • Background and motivation.
    • Other required PR template fields.
  • Standardized and more complete PR descriptions provide better context for both human reviewers and AI screening.
  • Improving PR quality at the creation stage also increases the accuracy and consistency of later reviews.

Practical Recommendation

AI should support—not replace—reviewer judgment. Teams should begin by standardizing the review workflow, encode that workflow in reusable AI commands, and measure whether review time, PR waiting time, and review quality improve. Combining AI screening with better PR context, dependency analysis, clear comment conventions, and continuous process refinement offers a more sustainable solution than relying on individual reviewers.