Assessment scoping / A practical first step

Start with work
that matters.

Bring one important repository, representative tasks and the decision you need to make. Agree scope before access, execution or spend.

Coding-agent performance assessment

Measure how a named agent configuration performs on your work. Identify codebase friction and improvements worth retesting. The readout leads with outcomes, human review and resource use, with static engineering evidence underneath.

Bring to the first conversation

Download the optional repository inventory template ↓

The template is a local JSON starting point, not a form submission. No repository paths or source are collected by this site.

A sequence with measurable checkpoints.

  1. Scope: agree representative tasks, success conditions, boundaries, owners and budgets.
  2. Inspect: scan context, documentation, planning artifacts, supported structure and engineering controls.
  3. Evaluate: run fresh repeated attempts; retain failures; review outcomes independently.
  4. Diagnose: connect observed failures to testable codebase or workflow hypotheses.
  5. Improve: change a targeted constraint and retest matched tasks plus held-out work.
  6. Decide: agree what can be delegated under human oversight, what needs work and what remains unproven.

Task count, duration, access and commercial terms are agreed during scoping. A six-week engagement is an option, not a promised result or fixed prerequisite. Start with a bounded pilot rather than requiring a whole-estate rollout.

What the first brief should answer.

The CLI's local runner is not a security sandbox or an independent grader. Protected evaluation, provider handling and human review must be agreed separately. Imported evidence is labeled reported; a static scan alone never claims task performance.

Repository Health Review

Available independently. Review reproducibility, verification, documentation and maintainability with engineers. Use the supported static checks and a scoped walkthrough to produce an evidence-backed improvement plan.

Change Safety Review

Available independently. Review verification, release controls, ownership and agreed operational evidence. Production and rollback conclusions depend on the evidence supplied, not on repository file presence.

Read the assessment method and limits →