Define the Measurement Target and System Boundary

A generative system trustworthiness plan starts with a bounded claim about an operating version, not an impression of an isolated model. Identify model, instructions, index, tools, server, interface, users and allowed actions, then connect each claim to evidence and a predeclared decision. Keep answer correctness separate from action safety: an unauthorized record disclosure triggers containment even when average answer accuracy is high. Build a sampling frame that distinguishes routine use, exceptions and adversarial challenges. Preserve numerator, denominator and weight for every slice without presenting assumed use weights as observed production. Protect the holdout from leaked case families and obsolete documents. Write dated reference judgments and decisive conditions before seeing responses; record reviewer disagreement and adjudication. Report unjudgeable cases as a coverage limitation rather than silently removing them from the evidence.

Read the whole first subject without an account: its lessons, summary and review questions.