How AI Code Review Tools Work: The 6-Stage Pipeline (2026)
How AI code review tools work, stage by stage, and where CodeRabbit, Greptile, DeepSource, Gitar and Claude Code actually diverge inside that pipeline.
Published:
Last Updated:
Direct answer
AI code review tools run a six-stage pipeline: webhook trigger, fetch and parse the diff, gather surrounding context, run deterministic linters, evaluate with a model, post feedback. The stage that decides quality is context gathering, and it is where tools diverge most: a reviewer that sees only the diff produces diff-quality comments. The newer split is comment-only versus fix-and-validate. Independent evidence puts collective issue detection at 41.5% (c-CRAB, arXiv 2603.23448v2). One disclosure, because we hold other publishers to it: c-CRAB is not conflict-free. Five of its six authors are academic (National University of Singapore, Zhejiang University), but one lists SonarSource as their affiliation (arXiv 2603.23448v3, verified 2026-10-18), and the paper carries a disclaimer that its conclusions do not represent SonarSource policy. Sonar sells SonarQube and acquired Gitar, which is a paid sponsor of this site. SonarQube is not among the four tools c-CRAB evaluates, which blunts the conflict considerably - but we are not going to call out vendor-funded benchmarks elsewhere and stay quiet about this one.
How do AI code review tools work?
Direct answer: Six stages: a webhook fires on
pull_requestorpush; the tool fetches the diff and parses it to ASTs; it expands context outward from changed hunks; deterministic linters run first (DeepSource: 5,000-plus rules before its AI agent); a model evaluates intent against that context; output posts as comments, labels, or a committed fix. Verified 2026-10-18.
Every explainer in this market describes the pipeline. None of them tells you where the tools actually differ inside it, which is the only part that affects your purchase. So here is the pipeline, and at each stage, the divergence.
| Stage | What happens | Where tools diverge |
|---|---|---|
| 1. Trigger | Webhook on pull_request (opened, synchronize, reopened, ready_for_review) or push | Vendor cloud app vs CI job on your runners vs self-hosted webhook server |
| 2. Fetch and parse | Shallow clone or diff-only fetch against merge base, parsed to ASTs | Diff only vs full checkout vs pre-built repository index |
| 3. Context gathering | Expand from changed hunks to called definitions, callers, tests, recent commits, instruction files | The widest divergence in the category. Determines most of the eventual quality |
| 4. Deterministic checks | Linters, SAST, secrets, IaC scanners run before the model | Some run 40-plus tools first; some run none |
| 5. Model evaluation | Diff + gathered context + system prompt encoding team priorities | Single pass vs multi-agent with a verification step |
| 6. Posting feedback | Inline comments, summary, severity labels, committed fixes | Comment-only vs fix-and-validate against CI |
Stage 1: the trigger
A Git host app subscribes to webhook events. On GitHub the load-bearing one is pull_request with the opened and synchronize actions, so the review re-runs on every force-push. issue_comment carries on-demand commands, which is how @coderabbitai review works. push triggers branch-level analysis where the tool supports it.
The divergence is architectural, not cosmetic. CodeRabbit, Greptile, Gitar and Cursor Bugbot run in the vendor’s cloud and post back through the API, so the review sits beside your CI. PR-Agent ships as a GitHub Action, a Docker image, a CLI, or a self-hosted webhook server, so the review runs on your runners - it was relicensed to MIT on 23 April 2026 and moved to independent governance under The-PR-Agent org, with v0.48.0 released 2026-10-16.
Anthropic Code Review is enabled per repository and per branch by an admin, and runs in the cloud when a PR opens. It is also the clearest example of why “which host do you use” is a real constraint: it supports GitHub Enterprise Server, which Copilot code review does not, but it is unavailable to orgs with zero-data-retention, the HIPAA configuration, or CMEK - the exact configuration that makes Claude Code PHI-eligible disables Code Review. We cover that trap in AI code review for regulated teams.
Stage 2: fetch and parse
Most tools do not clone your whole repository on every review. They fetch the diff against the merge base, which keeps latency and egress down, then parse changed files to abstract syntax trees so the model is reasoning about structure rather than text lines.
Three strategies exist, and they are not equivalent:
- Diff-only fetch. Fast, cheap, bounded. Caps what stages 3 and 5 can possibly see.
- Full checkout per review. Slower, but the reviewer can follow a symbol anywhere.
- Pre-built index. Greptile indexes the repository into a code graph of functions, classes, dependencies, import chains and change history before the first review, then reviews against the graph. The index costs setup time up front and pays for itself on cross-file questions.
Stage 3: context gathering - the stage that decides everything
This is the stage that decides most of the eventual quality, and it is the stage vendors are vaguest about. A model is only as good as the window it is reasoning over. Given 40 changed lines and nothing else, even a frontier model can only comment on 40 lines.
Good context gathering expands outward from the changed hunks in a predictable order:
- Definitions of functions the changed code calls.
- Callers of functions the changed code modified. This is the direction most tools skip, and it is the direction that catches contract breaks.
- Related test files, which encode the intended behaviour better than any comment.
- Recent commits touching the same paths, which reveal whether this area is churning.
- Existing linter and formatter config, so the reviewer does not fight your toolchain.
- Your instruction files:
CLAUDE.md,REVIEW.md,.cursor/BUGBOT.md,path_instructionsin.coderabbit.yaml.
CodeRabbit is unusually explicit about the mechanics, stating in its context-engineering writeup that it maintains a 1:1 ratio of code to context in the prompt, drawing on repo history, dependency graphs, prior PR patterns and linter output. That is a real engineering commitment and a useful number, and it is also a vendor-published one.
Stage 4: deterministic checks run first
The best-designed pipelines do not let the model see the code until the rule engines have had their turn. There are two reasons. Rule findings are reproducible, so they can gate a merge. And filtering them out first stops the model spending its context budget rediscovering a missing semicolon.
DeepSource is the clearest implementation: it runs deterministic static analysis across 5,000-plus rules and 30-plus languages before its AI agent sees the code. (Note the ownership change: Harness acquired DeepSource on 9 September 2026, and most comparison pages still list it as independent.)
CodeRabbit pairs its model with 40-plus open-source linters and analyzers, catalogued at docs.coderabbit.ai/tools/list, and runs a verification agent over their output to suppress noise. The catalogue spans more than style: OpenGrep and Semgrep for semantic analysis, Gitleaks-class secret scanning, OSV-Scanner for dependency CVEs, Checkov and Trivy for IaC, and Microsoft Presidio for PII. CodeRabbit respects your existing config files, so a repo with ruff.toml at the root gets your Ruff rules, not CodeRabbit’s defaults. One 2026 roundup cites 50-plus rather than 40-plus; the docs catalogue is the authoritative count and the marketing figure has been “40+” historically.
At the other end, several pure-LLM reviewers run no deterministic pass at all. That is a defensible design if you already run your own linters in CI. It is a bad design if you were expecting the reviewer to be your quality gate.
Stage 5: model evaluation
The model receives the diff, the gathered context, and a system prompt encoding what this team cares about. What varies is how many models, in what topology.
Single-pass is the default: one prompt, one completion, findings extracted. Multi-agent is the newer shape. Anthropic’s Code Review dispatches multiple specialised agents in parallel, each hunting a different class of issue - logic errors, boundary conditions, API misuse, authentication flaws, convention compliance - then runs a verification step that attempts to disprove each finding before a final aggregator agent dedupes and ranks them. Reviews take around 20 minutes, which is the honest cost of that depth. It also will not approve a pull request, only comment, which I think is the correct product decision.
Greptile runs a swarm of parallel agents against its code graph. The topology matters because the verification step is the part that suppresses confident nonsense, and it is also the part most single-pass reviewers lack. CRJudgeBench exists precisely because plausible-but-invalid review comments are a measurable problem.
Stage 6: posting feedback, and the newest architectural split
Output used to be the boring stage. It is now the second-biggest divergence after context.
Comment-only tools post inline comments on affected lines, a summary comment, and severity labels. That is CodeRabbit, Greptile, Cursor Bugbot, Anthropic Code Review, Qodo and most of the field.
Fix-and-validate is different in kind. Gitar generates a fix for a high-confidence finding, commits it to the PR branch, runs your CI, and commits only when the build goes green, with automatic follow-up repair if its own fix breaks something. Lower-confidence findings fall back to suggestions in the thread. It reviews PRs on GitHub, GitLab, Bitbucket and Azure DevOps, and also triages failing pipelines, separating genuine breakage from flaky tests. Sonar acquired Gitar on 21 May 2026.
Disclosure: Gitar is a paying sponsor of this site. That buys placement, not editorial treatment. The relevant caveat is the same one we apply to every vendor: Gitar has no published third-party benchmark. Its architecture is interesting and verifiable from docs; its review quality is not independently measured. Our fuller writeup is at Gitar review. Note also that a green CI run is evidence, not proof - Sonar says so itself.
Diff-only versus full-repository indexing: the distinction that predicts everything
Benchmark numbers in this market are nearly all vendor-funded and mutually contradictory. Architecture is verifiable where benchmark numbers are not. So if you only remember one thing from this page, remember this axis.
| Tool | Context scope | Deterministic pre-pass | Output mode | Independent benchmark? |
|---|---|---|---|---|
| Greptile | Full-repo code graph, built before first review; adjacent repos via embeddings on enterprise | None documented | Comment-only | No. Self-scored 82%; Augment’s re-run scored 45% |
| CodeRabbit | Diff-centric plus repo history, dependency graph, prior PRs; 1:1 code-to-context | 40-plus linters and SAST tools | Comment-only, plus committable suggestions | Partly. Martian’s leaderboard put it at 51.2% F1 / 49.2% precision, 3 Mar 2026 |
| DeepSource | Diff plus repo, after rule pass | 5,000-plus rules, 30-plus languages, runs first | Comment-only plus Autofix | No. Self-scored 84.51% F1 |
| Claude Code | Changed files plus adjacent code and similar past bugs | None documented | Comment-only; will not approve | Yes, as a subject. c-CRAB 32.1% |
| Gitar | Full codebase awareness per vendor docs | Pairs with SonarQube’s rule engine post-acquisition | Fix, commit, run CI, commit on green | No published third-party benchmark |
| Cursor Bugbot | Diff plus BUGBOT.md walked up from changed files | None documented | Comment-only | No. Third-party precision estimate 60% |
| PR-Agent | Diff plus configurable repo context | Depends on your CI | Comment-only, command-driven | Yes, as a subject. c-CRAB 23.1% |
| Graphite | Diff-centric | None documented | Comment-only | Yes, as a subject. Scored 0.0% F1 on Cal.com in Entelligence’s benchmark |
| SonarQube | Whole-project analysis; cross-file, cross-function taint | Entirely rule-based core | Issues plus AI CodeFix | Not applicable - deterministic |
The failure modes of diff-only review are specific and predictable. A function rename that breaks callers in another file. A field added to one code path but not its three siblings. A schema change that invalidates an assumption two services away. A removed middleware guard whose importance is invisible in the diff. A reviewer that sees only the diff produces diff-quality comments, and no amount of model capability fixes a context problem.
The tradeoff is honest in the other direction too. Indexing costs setup time, and the most common complaint about full-context reviewers is noise. More context, more findings, more of them irrelevant. We dug into that in AI code reviewers with low false positive rates, where the short answer is that nobody independent has ever measured it.
What bugs can AI code reviewers catch?
Direct answer: Reliably: null dereferences, boundary and off-by-one errors, unhandled error paths, resource leaks, API misuse, missing awaits, hardcoded secrets, injection-shaped concatenation. Inconsistently: cross-file contract breaks, auth logic, business-rule violations. c-CRAB measured four agents against 234 validated human review comments: 41.5% union, Claude Code 32.1% best single tool (verified 2026-10-18).
The honest version of this answer comes from c-CRAB, from the National University of Singapore, which is the rare benchmark in this market whose authors do not sell a reviewer. Its method is the clever part: it converts real human review comments into executable tests, so “did the agent catch this” has an objective answer rather than an LLM judge’s opinion.
The dataset is 184 pull request instances, 67 repositories, 234 validated review comments, each tied to at least one executable test. The headline, quoted exactly: “Taking the union across all four tools, 97 out of the 234 tests were passed by at least one tool (41.5%).”
| Tool (as evaluated in c-CRAB) | Tests passed |
|---|---|
| Claude Code | 32.1% |
| Devin | 24.8% |
| PR-Agent | 23.1% |
| Codex | 20.1% |
| Union of all four | 41.5% |
Read that union figure carefully. Even running four agents at once, roughly six in ten issues that a human reviewer actually caught were missed by every agent. That is the number to put in front of anyone proposing AI review as a replacement for human review rather than a pre-filter for it.
One correction worth making loudly, because it is miscited constantly: the widely-quoted “40-70% false positive rate” is not in the c-CRAB paper. No false-positive rate is reported for any reviewed tool. The phrase appears twice, both conceptually, and the instance in section 4.2.1 concerns tuning the authors’ own comment classifier, not the tools. If you see that figure attributed to c-CRAB, the citation is wrong.
What they catch well, and why
The classes AI reviewers handle well share a property: the bug is locally visible and pattern-shaped. A dereference without a null guard, a loop bound that is <= where it should be <, a try with no catch on an I/O call, a file handle opened on a path that can return early. These are visible inside the hunk, and they are the classes where a model’s pattern coverage genuinely exceeds a tired human’s at 5pm on a Friday.
The classes they handle badly share the opposite property: correctness depends on information not in the diff. Whether this endpoint is supposed to require authentication. Whether this retry is safe given the idempotency guarantees upstream. Whether the business rule says 30 days or 30 business days. CRBugBench (arXiv 2610.13668, CMU plus Microsoft Research) found claude-opus-5 at 79.6% recall@5 on pre-merge bugs but only 64.2% post-merge, at $2.97 per task, and it reports no precision figure at all. Microsoft co-authored it using copilot-cli as the harness, which is worth knowing when you read the number.
The question these tools do not answer
Here is the limit that matters most, and I have not seen a competing explainer state it.
AI code reviewers review the change in front of them. They answer: is this new code correct, secure, and maintainable? They do not answer: what existing production behaviour did this change put at risk?
Those are different questions. The second one requires knowing what your system currently does in production, which callers depend on the old behaviour, what your error budget looks like, and which customers are on the code path. No reviewer in this category has that. A perfectly correct diff can still take down a service, and every tool here will approve it with a clean summary.
This is also why “green CI plus clean AI review” is not a release decision. It is two pieces of evidence.
AI code review vs static analysis
Direct answer: Static analysis answers a fixed question from a fixed rule set, identically every time, and can gate a merge or satisfy an auditor. AI review answers an open question about intent, differently each run, and cannot. Run both, deterministic first. DeepSource runs 5,000-plus rules before its AI agent; SonarQube’s core engine is entirely rule-based. Verified 2026-10-18.
The framing as a versus is wrong, but the distinction underneath it is real and consequential.
| Property | Static analysis | AI code review |
|---|---|---|
| Determinism | Same input, same output, every time | Samples from a distribution; output varies |
| Auditability | Rule ID, version, documented behaviour | Prompt and model version, often undisclosed |
| Suppression | Suppress a rule class once, globally | Argue with the model per PR, or tune prompts |
| Can gate a merge | Yes | Not defensibly |
| Understands intent | No | Partially |
| Cross-file reasoning | Yes, via taint and call-graph analysis | Only if the tool indexes the repo |
| Finds “correct code solving the wrong problem” | Never | Sometimes |
The deterministic layer is where cross-file security analysis actually lives, incidentally, and it is more capable than the AI-review marketing suggests. Semgrep’s cross-file taint analysis tracks unsanitised data from source to sink through arbitrarily many files, enabled by interfile: true in a rule’s options key and gated to proprietary Semgrep (Semgrep CE cannot do interfile analysis). SonarQube’s taint engine is cross-function and cross-file by design, with Advanced SAST extending it through third-party library boundaries on Enterprise Edition and above. We go deeper on that in AI code review tools that find security vulnerabilities and SAST vs DAST.
The practical rule: gate on the deterministic layer, advise with the model layer. If a finding must block a merge or appear in an audit trail, it needs to come from a rule with an ID. If a finding is “this looks like it will break when the queue is empty”, a model is the only thing that will ever produce it.
Non-determinism, and what it means for trusting a single result
Without a deterministic baseline, running the same review twice can yield different findings. Two independent sources of variance stack up: the model samples from a probability distribution, and the retrieval layer is not guaranteed to assemble identical context on two runs. Add silent model-version upgrades on the vendor side and Tuesday’s review of an unchanged diff can differ from Monday’s.
No vendor we checked on 2026-10-18 publishes run-to-run variance for its reviewer. Not one. That is a conspicuous gap in a market that publishes F1 scores to two decimal places.
Three consequences you should act on:
- A clean review is not evidence of absence. Graphite’s reviewer returned zero comments on a clean default-config PR and scored 0 of 16 on Cal.com in Entelligence’s benchmark. A green check means the reviewer said nothing, not that there was nothing to say.
- Do not A/B tools on one PR each. You are sampling noise. Run both tools over the same 30 to 50 merged PRs where you already know the outcome.
- Keep the merge gate deterministic. Tests, linters, SAST. The model layer is a reviewer, not a control.
How much setup do AI code review tools need?
Direct answer: Install takes minutes - CodeRabbit, Greptile, Gitar, Cursor Bugbot and Anthropic Code Review are all Git host apps needing no config file to start. Useful configuration takes about a week: path filters, severity thresholds, instruction files. Greptile additionally needs an initial full-repository index. Budget tuning time, not install time. Verified 2026-10-18.
The install numbers vendors advertise are true and not very interesting. Gitar documents setup in under five minutes, confirmed by a gitar-bot comment on a real PR. CodeRabbit, Greptile and Cursor Bugbot are comparable. Anthropic Code Review needs an admin to install the GitHub app, connect repositories, and enable review on chosen branches.
The work that determines whether anyone still has the bot enabled in month two is the second pass:
- Path filters. Exclude generated code, lockfiles, snapshots, vendored directories.
path_filtersin.coderabbit.yaml. Skipping this step is the most common reason teams declare a tool “too noisy” in week one. - Severity thresholds. Qodo exposes
inline_comments_severity_thresholdin.pr_agent.tomlwith three ranks: 3action_required, 2remediation_recommended, 1informational. Publishing only rank 3 and above transforms the experience. - Review profile. CodeRabbit ships a
chillprofile alongside its default. - Instruction files. Covered in the next section.
- Repository limits you will hit. CodeRabbit Essentials covers 1 linked repository (Team 5, Advanced 10, Enterprise 20) and caps reviews at 150 files on Free and Essentials, 300 on Team and above. Hourly review limits run 5 / 8 / 10 / 12 by tier and degrade to 1 per hour under fair usage. These constraints bite multi-repo teams hard and most comparison pages omit them. See CodeRabbit pricing and CodeRabbit configuration.
If you want the reviewer to run on your own infrastructure instead, that is a different conversation with a much shorter tool list, and we mapped it in self-hosted AI code review tools and AI code review with GitHub Actions.
Can an AI code reviewer understand project-specific conventions?
Direct answer: Partially, via two mechanisms: instruction files you write (
CLAUDE.md,REVIEW.md,.cursor/BUGBOT.md,path_instructions, Gitar’s natural-language policies), and learned convention from repository history (Greptile’s code graph, CodeRabbit’sknowledge_base.learnings). No vendor publishes a measurement of how often a stated convention is honoured. Verify on your own repo during a trial. Verified 2026-10-18.
The explicit mechanism is the one you control, and it is worth real effort because it is the cheapest quality lever in the pipeline.
| Tool | Instruction mechanism | Notable constraint |
|---|---|---|
| Anthropic Code Review | REVIEW.md for review instructions, CLAUDE.md for repo context and architecture | Review runs cloud-side; around 20 minutes |
| Cursor Bugbot | .cursor/BUGBOT.md, resolved by walking up from each changed file | 30,000 characters per rule, 100,000 per review; rules must sit on the default branch |
| CodeRabbit | path_instructions per glob in .coderabbit.yaml, plus knowledge_base.learnings | Learnings retained per repo |
| Qodo / PR-Agent | .pr_agent.toml with severity thresholds and custom prompts | Config lives in-repo, so it is reviewable |
| Gitar | Custom review policies in natural language, no scripts or config files | Vendor-documented; no third-party verification |
| Greptile | Plain-English custom rules; learns team standards from PR comments over time | Requires the initial index |
The learned mechanism is more interesting and less trustworthy. A tool that infers convention from your repository will happily infer your bad conventions and defend them, and nothing in the pipeline distinguishes “this is how we do it” from “this is how we have always accidentally done it”.
One thing to test in a trial, because it is the single highest-signal experiment available: write a convention into the instruction file, then open a PR that violates it, and see whether the reviewer notices. Do it three times with three different conventions. We could not find a single vendor publishing a convention-adherence rate, so this is a measurement you have to run yourself.
How we verified this
Everything below was checked on 2026-10-18 unless dated otherwise.
Verified at primary source:
- c-CRAB dataset and scores against arXiv 2603.23448v2, Table 4 and section 4.4.2. The verbatim dataset line is “the resulting benchmark contains 184 pull request instances and 234 validated review comments, each associated with at least one executable test.” Repository count 67, not the 56 that circulates.
- CodeRabbit’s 40-plus linter catalogue at docs.coderabbit.ai/tools/list, and the 1:1 code-to-context ratio from CodeRabbit’s context-engineering post.
- Semgrep cross-file taint analysis mechanics and the
interfile: trueoption from Semgrep’s cross-file analysis docs, including that interfile analysis is proprietary-only. - SonarQube taint analysis being cross-function and cross-file, with Advanced SAST and custom security-engine configuration gated to Enterprise Edition and above, from Sonar’s docs.
- Gitar’s fix-commit-validate loop and platform coverage from Sonar’s acquisition post and Sonar’s Gitar getting-started material.
Verified as vendor-published, and labelled as such:
- Greptile’s 82% self-score versus Augment’s 45% re-run on the same five repositories. Augment rebuilt the golden comments by hand rather than reusing Greptile’s answer key, so part of that 37-point gap is a different answer key, not purely self-dealing.
- DeepSource’s 84.51% F1 self-score.
- Anthropic’s launch metrics for Code Review: 84% bug detection on PRs over 1,000 lines, under 1% false positives, around 7.5 issues per large change. These are Anthropic’s own figures and have not been independently replicated.
What we could not verify:
- Run-to-run variance for any AI reviewer. No vendor publishes it. Our non-determinism section is reasoned from how the systems are built, not from a measurement.
- Convention-adherence rates. No vendor publishes how often a stated instruction-file rule is actually honoured.
- Any independent false-positive rate for any AI code reviewer. Still zero, as of 2026-10-18. Every FP figure in circulation is vendor-published.
- Anthropic Code Review’s GA status. Launched in research preview 9 March 2026; GA to Claude Team and Enterprise is dated 15 October 2026 with at least $10,000 in review credits (Anthropic’s own figure; press reports a $10,000-$50,000 range scaled by active Claude Code seats) for eligible Enterprise orgs, but at least one Anthropic docs page still read “research preview” on the GA date. Treat the GA date as approximate.
- Whether CodeRabbit’s bundled-tool count is now 40-plus or 50-plus. One 2026 roundup says 50-plus; the docs catalogue is the authoritative enumeration and the long-standing marketing figure is 40-plus. We use 40-plus.
Conflicts we are reporting rather than resolving: Greptile 82% (Greptile) vs 45% (Augment) vs 23.61% (Macroscope’s 118-bug set). Three publishers, three numbers, each one favourable to its publisher.
Recommendations
Stated criteria: context architecture over benchmark claims, deterministic layer present, and output mode matched to how much autonomy you will actually grant a bot.
If your PRs routinely cross service or module boundaries, buy repository indexing. Greptile is the clearest implementation, at $30/seat/mo with 50 credits included and $1 per extra credit, where a seat means any developer who received a review and credits do not pool across authors. Accept that it is the noisier choice and budget tuning time.
If you want one tool to replace three CI steps, buy the deterministic-first pipeline. CodeRabbit at $24/dev/mo annual bundles 40-plus linters and SAST tools with a verification agent over their output. Check the 1-repository cap on Essentials before you commit. DeepSource is the other shape of this bet, with 5,000-plus rules ahead of the agent, though AI review bills separately at $8 per 10K processed LOC on Standard and ownership moved to Harness on 9 September 2026.
If depth matters more than latency, use Anthropic Code Review - multi-agent, with an explicit verification step that tries to disprove findings, and it supports GitHub Enterprise Server. Twenty minutes per review is the price. Do not plan on it if you run ZDR, the HIPAA configuration, or CMEK. See Claude Code review.
If the bottleneck is fixing rather than finding, look at fix-and-validate. Gitar commits a fix, runs CI, and commits only on green. That is a genuinely different product shape from everything else here. It is also our sponsor and it has no published third-party benchmark, so evaluate it on your own repositories and do not take the architecture as a proxy for quality.
If you need the review to run on your infrastructure, use PR-Agent. MIT since 23 April 2026, community-governed, 13.4k stars, runs as a CLI, Docker image, GitHub Action or self-hosted webhook server, across GitHub, GitLab, Bitbucket, Azure DevOps and Gitea, against OpenAI, Claude, Gemini or local models via Ollama. It scored 23.1% in c-CRAB, which is the honest tradeoff.
Whatever you pick, keep the merge gate deterministic. The strongest claim on this page is the one nobody is selling: four agents running together caught 41.5% of what human reviewers caught. Use these tools to make human review cheaper, not to skip it.
Further reading
- What is AI code review? - the concept, from scratch
- Best AI code review tools - the ranked list, with criteria stated
- AI code review tools that find security vulnerabilities - why an AI reviewer is not SAST
- AI code reviewers with low false positive rates - every benchmark and who funded it
- AI code review for regulated teams - 26 trust centres read at source
- AI code review for security - OWASP coverage and pipeline design
- SAST vs DAST - where the deterministic layers sit
- AI code review on large codebases - what breaks at monorepo scale
- State of AI code review 2026 - funding, acquisitions, market shape
- Static code analysis tools guide - the rule-based layer in detail
GitarComments are not enough
Gitar applies the fix, validates it in CI, and clears the queue.
See it on your repo Read our independent Gitar reviewFrequently Asked Questions
How do AI code review tools work?
Six stages. A webhook fires on a pull_request or push event. The tool fetches the diff against the merge base and parses it to abstract syntax trees. It gathers context around the changed hunks: definitions of called functions, callers, related tests, recent commits to the same paths, and your instruction files. Deterministic linters and static analysis run before the model sees anything - DeepSource runs 5,000-plus rules across 30-plus languages first, CodeRabbit pairs the model with 40-plus linters. The model then evaluates intent and semantics against that assembled context. Finally the tool posts output: inline comments, a summary, severity labels, or in Gitar's case a committed fix validated against CI. Verified 2026-10-18.
What bugs can AI code reviewers catch?
Reliably: null and undefined dereferences, off-by-one and boundary errors, unhandled error paths, resource leaks, API misuse, missing awaits and race conditions in obvious shapes, hardcoded secrets, and injection-shaped string concatenation. Inconsistently: cross-file contract breaks, auth logic errors, and business-rule violations. The independent measurement is c-CRAB (arXiv 2603.23448v2), which converted 234 validated human review comments from 184 pull requests across 67 repositories into executable tests. Taking the union of all four agents tested, 97 of 234 tests passed, 41.5%. Per tool: Claude Code 32.1%, Devin 24.8%, PR-Agent 23.1%, Codex 20.1%. So roughly six in ten issues a human reviewer caught were missed by every agent.
AI code review vs static analysis
Static analysis answers a fixed question from a fixed rule set and gives the same answer every time. AI review answers an open question about intent and gives a slightly different answer each time. Static analysis is auditable, gateable, and suppressible class-by-class; it cannot tell you a function is correct but solves the wrong problem. AI review can reason about intent; it cannot be relied on for a compliance control because it is non-deterministic. The pipelines that work run both, deterministic first. DeepSource and CodeRabbit are explicit about this ordering. SonarQube's core SAST engine is rule-based and runs fully on-prem.
How much setup do AI code review tools need?
Install is minutes; useful configuration is a week of tuning. CodeRabbit, Greptile, Gitar, Cursor Bugbot and Anthropic Code Review all install as a Git host app with no config file required. The real work is the second pass: path filters for generated code and lockfiles, severity thresholds, and instruction files. Qodo exposes inline_comments_severity_threshold in .pr_agent.toml with three ranks. CodeRabbit uses .coderabbit.yaml with path_filters, path_instructions and a knowledge_base.learnings block. Cursor Bugbot reads .cursor/BUGBOT.md by walking up from each changed file, capped at 30,000 characters per rule. Greptile needs an initial full-repository index before its first review.
Can an AI code reviewer understand project-specific conventions?
Partially, through two mechanisms. The first is explicit instruction files you write: CLAUDE.md and REVIEW.md for Anthropic Code Review, .cursor/BUGBOT.md for Cursor Bugbot, path_instructions in .coderabbit.yaml, natural-language policies in Gitar. The second is learned convention, where the tool infers patterns from the repository itself. Greptile indexes the codebase into a code graph before reviewing. CodeRabbit retains corrections in knowledge_base.learnings. No vendor publishes a measurement of how often a stated convention is actually honoured, and we could not find one, so treat convention adherence as a thing you verify on your own repository during a trial rather than a feature you buy.
How do code review bots connect to CI pipelines?
Three patterns. The most common is a Git host app subscribing to webhook events - pull_request with opened, synchronize, reopened and ready_for_review actions, plus issue_comment for on-demand commands like @coderabbitai review. The review then runs in the vendor's cloud and posts back through the API, which means it sits beside your CI rather than inside it. The second is a CI job: PR-Agent ships as a GitHub Action, a Docker image, a CLI, or a self-hosted webhook server, so the review runs on your runners. The third is deeper CI coupling: Gitar reads failing pipelines, separates genuine breakage from flaky tests, and re-runs CI to validate its own fixes before committing.
Can AI code reviewers understand changes across multiple files?
It depends entirely on whether the tool indexes the repository or only reads the diff, and this is the single most consequential architectural choice in the category. Greptile indexes the whole repository into a code graph of functions, classes, dependencies and import chains before the first review, and extends to adjacent repositories with vector embeddings on enterprise plans. Anthropic Code Review reasons over changed files plus adjacent code. CodeRabbit is diff-centric with repository context layered on. A diff-only reviewer structurally cannot catch a function rename that breaks callers in another file, or a removed middleware guard whose importance is invisible in the diff.
How accurate are automated code reviews?
Lower than vendor marketing implies, and no party without a commercial stake has published a false-positive rate for any shipping commercial AI code reviewer. The best independent recall figure is c-CRAB's 41.5% union across four agents on 234 validated review comments. CRBugBench (arXiv 2610.13668, CMU plus Microsoft Research) is more optimistic, putting claude-opus-5 at 79.6% pre-merge recall@5 at $2.97 per task, but it reports no precision at all and Microsoft co-authored it using copilot-cli as the harness. Vendor numbers span 82% (Greptile on Greptile) to 45% (Augment's re-run of the same repositories with a rebuilt answer key). Anthropic's own launch figures of 84% detection and under 1% false positives are vendor-published and unreplicated.
Does AI code review improve developer productivity?
There is no independent measurement we can point you to, and anyone who tells you a percentage is quoting a vendor. The mechanism is plausible: a bot that catches a null dereference at minute zero removes a round trip that otherwise costs hours of wall-clock time waiting for a human. The counter-mechanism is also real: at the precision levels published in vendor re-runs, a meaningful share of comments are not findings, and triaging them costs attention. Run your own measurement during a trial. Count comments acted on versus comments resolved as not-an-issue, per reviewer, for four weeks. That ratio is the only productivity number specific to your codebase.
Why do two runs of the same AI review give different results?
Because the model layer samples from a probability distribution and the retrieval layer is not guaranteed to assemble identical context twice. Add silent model-version upgrades on the vendor side and the same diff can produce a different finding set on Tuesday than it did on Monday. No vendor we checked on 2026-10-18 publishes run-to-run variance for its reviewer. The practical consequence: never treat an AI review as a compliance control or a merge gate on its own. Gate on the deterministic layer - linters, SAST, tests - and treat model findings as advisory. This is exactly why DeepSource and CodeRabbit put the deterministic pass first.
Explore More
Tool Reviews
Free Newsletter
Stay ahead with AI dev tools
Weekly insights on AI code review, static analysis, and developer productivity. No spam, unsubscribe anytime.
Join developers getting weekly AI tool insights.
Related Articles
Every AI Code Review Benchmark, Compared (2026)
All 19 AI code review benchmarks: who published each one, whether they sell a reviewer, sample size, metric, and who won. Verified 18 October 2026.
October 18, 2026
guideAI Code Review in CI/CD Pipelines: Where to Run It (2026)
AI code review tools that work with existing CI pipelines, in three architectures. Real GitHub Actions, GitLab CI and Jenkins config, plus what each one costs.
October 18, 2026
guideAI Code Review False Positive Measurement: Our Method
The ACR Noise Index protocol: how we will measure AI code review false positives. Taxonomy, PR selection, blind classification, variance. Pre-registered 2026-10-18.
October 18, 2026
CodeRabbit Review
DeepSource Review
Claude Code Review
Cursor BugBot Review
Qodo Review
PR-Agent Review
Graphite Review
SonarQube Review