• Cost Comparison
  • Hiring Process

Clearing the batch teaches a firm nothing about judgment

A review pilot grades speed. The next hire is not a speed problem.

An offshore legal support specialist pausing over a document that fits none of the coding tags on her screen.
7 min readPublished Sep 26, 2026
DA
Davin Acuram

A firm runs a document review pilot to test an offshore team, and learns nothing it did not already assume. Review goes first because it is the job a firm feels safest getting wrong. The instinct is sound. The pilot it produces is close to worthless. Review is graded on documents per hour, deadline hits, and agreement with a second pass. A team can clear the batch and teach the firm nothing about judgment. I do not think that number answers the question the partner was actually asking. The pile moved. That is the whole finding.

Why firms pick document review as the first job to send offshore

The choice is rational on its face. Review is bounded. It is reversible, and a second pass catches what the first one missed. Nobody loses a client because a first-level reviewer tagged a document responsive when it was not. The work is coded against a manual somebody in the firm already wrote. Volume is high enough that the savings show up on one invoice. A managing partner making a first offshore commitment is right to start where a mistake is cheap. I would start there too.

But cheap to get wrong is the same property as cheap to get right. Firms pick the one job in the building where being wrong costs almost nothing. Then they read the result as evidence about the team. I used to think a clean pilot told me something about the people who ran it. A test with nothing at stake returns what you walked in believing. You learn that people you hired can follow a coding manual, which you assumed, or you would not have sent the files.

Nothing learned.

What an offshore document review pilot actually grades

A review pilot grades three things. Documents per hour. Agreement with the second pass. Whether the deadline held. All three are real numbers. None of them is about judgment, because the coding manual already contains every decision that mattered. That is precisely what makes review delegable in the first place. The reviewer applies the rules. Somebody else wrote them, argued about them, and signed them off weeks earlier.

So the pilot measures the one part of the work that was fully specified before anybody offshore opened a file. The questions we actually have stay untested. What a person does with a document that fits no tag. Who they tell, how fast, and whether they stop or guess. Review is designed to eliminate exactly those moments. The pilot is scored on how few of them occurred. So the score improves as the interesting part of the job disappears, which is grading running backwards.

The pilot passes and the real question is still open

A passed review pilot answers one question: can this team apply a manual at volume. The decision sitting behind it is a different one entirely. Whether offshore staff can hold a seat with a decision in it. Intake, case management, drafting, client updates, calendar responsibility. None of that is graded on agreement with a second pass. Review results do not transfer to that decision, and they were never measuring the same thing. So the pilot passes and the hire nobody has made yet is still unmade. The batch cleared, which is production and not evidence.

Then the work vanishes. A matter closes and the review closes with it. No standard operating procedure survives it. No repository grows. Nobody offshore understands the firm better in month six than in month one, because nothing was written down that outlives the project. The next matter starts from zero, with the same vendor and the same manual. And a team with no next matter has nothing to stay for. The firm bought throughput on one matter and called it a staffing test. Months of production, and nothing on the bench a second matter could use.

A pile that moved is not a bench.

How much does offshore document review actually save?

First-pass coding gets cheaper offshore. The attorney hour sitting behind it does not move. Privilege calls, close questions and the final read stay with a licensed attorney, priced as they were before the vendor arrived. The ABA Model Rules set supervision obligations for non-lawyer assistants. Delegating the first pass does not lift them. Where the assistant sits changes nothing about who answers for the output. So the per-document quote is describing half the job.

Which is why the vendor's rate card is the wrong document to argue over. Outsourcing changes the cost of producing work. It does not change the cost of reviewing it. Review is the input most firms are already short of. The per-document rate is the only thing on the record, and it is not the number that decides. Count the weekly hours the named reviewer can give the matter first. Price the second pass, or the project has not been priced.

What to send offshore first instead of the review backlog

A better first job is one where being wrong is visible and recoverable, not one where being wrong is impossible. Three tests separate the two, and I would run them before anyone is interviewed.

  • Does the work still exist after this matter closes? If not, the pilot buys a result and no capability.
  • Is there a written standard for a correct output, or does it live in one partner's head? Criteria nobody wrote down cannot be handed to anybody.
  • Will the work generate escalations? A first job that produces no questions has tested nothing worth knowing.

Intake summaries, medical record chronologies, demand package assembly, calendar and deadline tracking. Each one recurs weekly. Each has a correct shape somebody can write down, and each produces a stream of judgment calls a supervisor can read. Run the trial against a matter the firm already closed, so it grades the provider instead of grading the firm's own uncertainty. Then read what comes back with the attention a filing gets. Review never gave anybody a reason to read it that closely.

People also ask about this

Is document review a bad first job to send offshore?
It is a poor first test rather than poor work. Review is graded on speed, volume and agreement with a second pass, so a team can pass it without ever showing how it handles a file that falls outside the coding manual.
How can a firm test whether offshore staff can handle judgment work?
Give them a small recurring task on a matter the firm has already closed, where the correct output is known in advance. Then grade the escalations and the questions, not only the finished product.
Does outsourcing document review reduce attorney hours?
It reduces first-pass production hours and leaves the attorney second pass where it was. Privilege calls and the final read stay with a licensed lawyer, so the review hour remains the ceiling on throughput.
What should a firm write down before any work moves offshore?
The criteria for a correct output and the point at which someone should stop and ask. Criteria held in one partner's head cannot be handed to anybody, offshore or otherwise.

Related Topics