ZOYA
← Back to ZOYA Solutions
Specimen deliverable

What the assessment actually produces.

Most advisories describe their deliverable. This is the deliverable — the executive summary page, the architecture debt map, the evidence and confidence record, the sensitivity band, the ranked portfolio and the 90-day sequence, at the depth a client receives them.

Constructed specimen Companion to the methodology brief No form gate
Read this first

This document is constructed. It is not a redacted client report, not an average of past engagements, and not a claim about what your program would show. It exists so you can judge the format and the rigor before commissioning anything. Every figure is illustrative and traces to the arithmetic published in the methodology brief, which uses the same specimen program.

00The specimen program

A mid-size control platform inside a larger system program. Deliberately unremarkable: no exotic technology, no crisis, no villain. The kind of program where every team reports green and integration keeps slipping anyway.

ReferenceSPECIMEN-01
Assessment scope18 modules · 240 documented interfaces
Trailing change effort (12 months)1,200 engineering days
Fully-loaded day rate (client-supplied)$650
Integration cycles per year4
Source accessRead-only, 11 of 18 modules
Elapsed3 weeks

Modules are identified by letter throughout, as they are in a real deliverable where names are client-confidential. Letters I and O are unused, to avoid confusion with digits.

01Executive summary

One page. It goes into a budget pack unedited, and it has to survive a finance director who did not attend any of the interviews.

SPECIMEN-01 · Architecture Debt & Cost AssessmentPage 1 of 24 · Executive summary
Annual exposure $323k Central estimate. Band $262k–$363k per year.
Integration schedule 5.5 wk Per year, absorbed by coupling rather than capability.
Recoverable $162k–$275k On 135 engineering days of remediation.

The finding

Coupling in this program is concentrated, not diffuse. Four of eighteen modules — 22% — carry 62% of cross-boundary interfaces and absorbed 71% of change effort in the trailing year. Three of those four sit on the integration critical path.

Normalizing for change size, work inside that cluster cost 2.4× the effort of comparable work in the program's low-coupling modules. The difference is not team capability — it is the same organization, the same process, the same domain. It is the cost of the partition.

What it costs

Change effort inside high-coupling cluster852 days
Same work at the program's own low-coupling baseline (852 ÷ 2.4)355 days
Excess attributable to coupling497 days / yr
At $650 fully loaded$323,000 / yr
Annual rework exposure — central estimate$323k

Because 68% of the excess sits on the integration critical path, roughly 338 of those days translate into schedule rather than cost alone — about 5.5 weeks of integration per year spent absorbing coupling.

The decision in front of you

Three remediation candidates address 78% of the excess for 135 engineering days and pay back inside eight months. A fourth candidate — the one engineers raise most often in interview — has a 2.8-year payback and should not be funded.

Confidence

The exposure band is $262k–$363k. Its width is driven almost entirely by one assumption — the coupling multiplier — because this program does not currently measure change effort per module. Narrowing that band is cheap: it requires attribution of effort at module granularity, which is a reporting change rather than an engineering one. The uncertainty is itself a finding.

Stated at readout

This assessment measures the architecture as documented and, where source access was granted, as implemented. It is not a certification artifact and does not substitute for a DER, auditor or safety assessor. It recommends work that ZOYA will not bid on.

02Architecture debt map

The technical page. It is what a chief architect argues with, and it is designed to be arguable — every edge traces to a documented interface or an observed change record.

SPECIMEN-01 · Architecture Debt & Cost AssessmentPage 2 of 24 · Coupling map
CLUSTER A · MODULES A–D · 62% OF CROSS-BOUNDARY INTERFACES A B C D E F G H J K L M N P Q R S T
Cluster-internal, high change traffic Link on the integration critical path Documented interface, low change traffic

Figure 1 — Coupling map, 18 modules. Node radius is proportional to trailing-year change effort. Cluster A contains modules A, B, C and D.

Effort concentration

Cluster A (4 modules)852 days
Remaining 14 modules348 days

Figure 2 — Change effort distribution, trailing 12 months. 22% of modules absorb 71% of effort.

Module register

ModuleCross-boundary interfacesChange effort (days)Critical path
A46268Yes
B41231Yes
C38205Yes
D24148No
E1346Yes
F1038No
G834No
H831No
J728No
K726No
L624No
M622No
N520No
P519No
Q518No
R416No
S414No
T312No
Total2401,200

Cluster A accounts for 149 of 240 interface endpoints (62%) and 852 of 1,200 change days (71%).

03Principal findings

Findings are written to be disagreed with. Each states the evidence it rests on, so a chief architect can attack the evidence rather than the conclusion.

A│B boundary carries shared mutable stateFund first

31 documented interfaces cross this single boundary — the densest pairing in the program — and 41% of the measured excess effort traces to changes that touched both sides within the same cycle. Evidence: interface control documents, 14 months of change records, confirmed against source in both modules.

Module C holds state owned by three teamsFund

Ownership is ambiguous in the documentation and contested in interview. Changes to C required cross-team coordination in 62% of cycles, against a program median of 11%. Evidence: change records, design review minutes, four interviews.

C│D interface contract is implicitFund if capacity

No versioned contract exists; compatibility is maintained by convention and enforced only at integration test. Accounts for 14% of excess and a disproportionate share of late-cycle defects. Evidence: test reports across four integration cycles.

Module F internals — do not fundAccept

Raised in three of six interviews as the program's worst code. It is. It is also changed twice a year, sits off the critical path, and accounts for 6% of excess against 55 days of remediation — a 2.8-year payback. Recommendation: accept and document the decision, with an owner and a review date.

Why the fourth finding matters most

A deliverable that only says "fund this" is a sales document. Module F is the control: it demonstrates that the ranking is driven by return rather than by engineering discomfort, and it is usually the finding that earns the rest of the report its credibility with finance.

04Evidence coverage and confidence

Every finding carries the evidence behind it and a confidence grade. Where coverage is thin, the deliverable says so rather than smoothing it over.

Evidence classCoverageConfidenceGap
Interface control documents240 / 24091%28 not at current revision
Change and defect history14 months86%Not attributed per module
Source verification11 / 18 modules64%7 modules documentation-only
Design review records4 cycles82%Cycle 2 minutes incomplete
Effort attributionProgram level48%Dominant source of band width
Practitioner interviews678%Supplier-side not represented
On the classification step

Document classification uses a method validated in doctoral research against a panel of 35 practicing engineers, reporting Cohen's kappa 0.84 — agreement between the classifier and expert human raters — and F1 0.82 detection accuracy. Those figures describe classification reproducibility only. They say nothing about the accuracy of the cost model, which rests on the assumptions tested in section 05 and is reported as a band for that reason. The validation population was drawn from complex engineering programs; the extent to which it generalizes beyond that population is an open question addressed in the methodology brief.

05Sensitivity

A single number implies a precision the method does not have. The deliverable always presents a band and names the assumption the answer is most sensitive to.

AssumptionRange testedExposureInfluence
Coupling multiplier1.9 – 2.9$262k – $363kDominant
Attributable share of effort64% – 76%$291k – $345kModerate
Fully-loaded day rate$580 – $720$288k – $358kLinear, low uncertainty
Attainable improvement50% – 85% of excess$162k – $275k recoverableDominant on the return side
How to read this

The conclusion — that the top three candidates are worth funding — holds across the full range of every assumption tested. What moves is the size of the prize, not the direction of the decision. That is the property that matters when the number is challenged in a budget review, and it is stated explicitly for exactly that reason.

06Ranked remediation portfolio

Ranked by return, not severity. "Do not fund" is a first-class result.

CandidateExcess addressedEst. effortPaybackCall
Re-partition A│B boundary41%60 d0.45 yrFund first
Extract shared state, module C23%45 d0.60 yrFund
Interface contract, C│D14%30 d0.66 yrFund if capacity
Consolidate module F internals6%55 d2.8 yrDo not fund

The top three address 78% of the excess for 135 engineering days, paying back inside eight months. The fourth is exactly the kind of work that gets funded on the basis of engineering discomfort and should not be.

0790-day sequence

The assessment ends with a sequence the program can execute itself. ZOYA does not deliver it, staff it, or bid on it.

  1. Weeks 1–2Attribute change effort at module granularityA reporting change, not an engineering one. It is the cheapest action available and it materially narrows the exposure band before any remediation is funded.
  2. Weeks 1–4Version the C│D interface contractLowest-effort candidate, and it stops the late-cycle defect pattern compounding while the larger work is scoped.
  3. Weeks 3–10Re-partition the A│B boundaryThe dominant candidate — 41% of excess for 60 days. Sequenced to complete before the next integration cycle so the effect is observable rather than inferred.
  4. Weeks 8–14Extract shared state from module COverlaps A│B deliberately: both touch the same teams, and running them consecutively wastes coordination cost already paid.
  5. Week 12Record the module F decisionAccept, with a named owner and a review date. An undocumented "we decided not to" becomes "nobody looked at it" within two staff changes.
  6. Week 14Re-measure against the baselineWith per-module attribution now in place, the second measurement is materially tighter than the first — and it is the point at which it becomes possible to tell whether the money worked.

08What this deliverable does not tell you

Stated at readout, in the report, in these words.

  • It is not a certification artifact. Where a program certifies to DO-178C, AS9100, MIL-STD-882, ISO 26262 or IEC 62304, the assessment scores against those obligations. It is not accredited by any of them and does not replace a DER, auditor or safety assessor.
  • It is a point-in-time measurement. Coupling accumulates continuously. A figure more than two or three integration cycles old should be treated as indicative.
  • Documentation fidelity bounds the result. Seven of eighteen modules here were assessed from documentation alone. Where documentation has drifted from implementation, the map reflects the documented architecture — and that risk is named in the report rather than discovered later.
  • It is a causal argument, not a controlled experiment. High-coupling modules cost more per unit of change. That coupling is the cause rather than a correlate of domain complexity, team experience or requirement volatility is argued from the in-organization counterfactual, not proven.
  • It does not predict your outcome. The recoverable range is an estimate of attainable improvement under stated assumptions, not a guarantee that the excess disappears.
Reminder

Everything above is a constructed specimen. No client engagement is described, and no figure on this page is a client result. The arithmetic is published in full in the methodology brief so that it can be checked rather than believed.

The firm measuring the debt is not selling you the rebuild.

If this is the depth you need for a budget case, a replan, or an inherited system you have just become responsible for, the assessment runs three weeks to a fixed scope. There is no implementation contract afterward, because ZOYA does not do implementation.

Start a scoping conversation