All stories

Rolling out coding agents to an engineering team: a playbook

Buying licenses is procurement, not a rollout. The default way companies roll out AI coding tools to an engineering team (purchase seats, send the announcement, schedule a demo, hope) produces the same result everywhere: a usage dashboard that looks healthy, two developers who quietly transformed how they work, and ten who tried it twice and went back to their habits. Delivery metrics do not move, the renewal conversation gets awkward, and the skeptics feel vindicated.

The sequence that works is short to describe and takes discipline to run: measure a baseline, run a pilot squad on real backlog, measure the delta, then extend through champions. Eight weeks, roughly, for a mid-sized organization.

Why most AI coding tool rollouts stall

Because the hard part is not access, it is workflow. A coding agent is only as useful as the task definitions, context files and verification habits around it, and none of those come in the box. Left to individuals, that workflow knowledge accumulates in two or three heads and stays there, which is how the adoption gap happens: not a talent difference, an information-sharing failure.

The other reason is political. Without numbers, the rollout becomes a debate between enthusiasts with anecdotes and skeptics with different anecdotes, and skeptics argue better. Every step below exists to replace one of those anecdotes with a measurement.

Week one: baseline before anything changes

Before a single new seat is active, capture how the team delivers today: cycle time from first commit to merge, review turnaround, deployment frequency, defect and revert rates. All of it comes from tools you already run (git, CI, the issue tracker); a week is enough. We wrote up how we baseline and why skipping it poisons the whole program, but the short version is that without a before, there is no after, and the debate never ends.

Week one is also when security review happens: what data can reach which tool, retention terms, and the permission configuration agents will run under. Doing this now beats doing it as an incident response later.

Weeks two to four: one squad, real backlog

Pick one squad of five to eight, including at least one respected skeptic (their conversion is worth ten enthusiasts, and their objections improve the setup). Give them the real sprint backlog, not a sandbox project. Sandboxes prove nothing: the point is to hit the actual friction (the flaky test suite, the undocumented service, the ticket that was never really specified) because that friction is what the rollout has to fix.

During these weeks the squad builds the assets the rest of the organization will inherit: context files for their repos, the first shared skills for recurring tasks, task-framing conventions, and guardrails in CI sized for higher code volume. Expect the first week to be slower than normal. That is the learning curve being paid down in a contained place, and it is why the pilot is three weeks, not one.

Weeks four to eight: extend through champions, not memos

At the end of the pilot, compare against the baseline and be honest about the reading. Then extend squad by squad, each time seeded with a champion: someone from or trained by the pilot, embedded in the receiving team, with real time budgeted for the role. The champion model outperforms a central enablement team for one reason: proximity. Questions get answered in the moment, in context, by someone who knows both the tool and the codebase.

Champions also run the role-based workshops that replace the generic demo: backend, frontend, QA and data engineers hit different friction and need different patterns, on their own code. A one-hour generic training is how you get polite nodding and zero behavior change.

Keep score monthly

The rollout does not end, it becomes a routine: a monthly reading of the same metrics you baselined, plus the ones agents introduce (share of merged PRs that began as delegated tasks, token spend per squad). We covered which measurements hold up and which flatter separately. Two rules keep the program honest: publish the numbers whether they are good or not, and predefine what result would make you stop or change course. A rollout that cannot fail is a belief system, not an engineering program.

This is, step for step, the sequence we run inside client teams as part of our agentic engineering work: baseline week, pilot squad, measured rollout, monthly scorecard. None of it is clever. All of it is the difference between licenses and capability.