Empiricism: from a usage signal to an inspectable product decision
8 min read
Lesson objectives
Separate observation, assumption and decision in a complex product situation
Reading tools
Please sign in to use all the tools
Once you sign in, the reading tools are yours: larger or smaller text, typeface, line spacing, focus mode, highlighting and bold, and notes saved to your account and gathered in My study.
A Product Owner works where users' responses cannot be known in advance through a detailed plan alone. The Scrum Guide describes empiricism as making decisions based on what is observed and connects it with transparency, inspection and adaptation. Empiricism does not mean random experiments or the absence of a goal. State the result sought, produce a usable Increment that can be inspected, compare evidence with an explicit expectation, and adapt a decision when needed. For PSPO I reasoning, distinguish a rule of the Scrum framework from a complementary measurement technique chosen by an organization. Scrum defines accountabilities, events, artifacts and commitments; it does not prescribe one dashboard or one backlog ordering algorithm.
Begin with the decision question: what would change if the signal were reliable? A dashboard might show booking completion falling from 62% to 49% in a week. That is an observation under a particular measure, not proof that the latest feature caused the fall. Check the denominator, event instrumentation, sample size by segment, and changes to the channel, operating hours or screen design during the same period. Then write at least two testable explanations: perhaps the confirmation step became difficult, or new visitors arrived from a channel with a different baseline. If the cause remains unknown, building a complete new feature may consume capacity without removing the actual barrier.
Transparency comes before inspection. Show the measure's definition, interval, segment and limitations, and show an Increment that meets the Definition of Done rather than presentation slides that imply unfinished work is complete. Inspection is not a trial of individual team members; compare the state of the product and observed outcomes with what the team and stakeholders intended. Adaptation is a specific decision that changes Product Backlog ordering, a product hypothesis, or collaboration, with an owner, review point and signal for its effect. A Sprint Review does not require the Product Owner to accept every suggestion. It is an opportunity to inspect the Increment and progress toward the Product Goal and adapt future work with stakeholders.
Also distinguish decision rights. The Product Owner is accountable for maximizing product value and effective Product Backlog management. Some of that work may be delegated, while accountability remains. Developers are accountable for their day-to-day plan and for an Increment meeting the Definition of Done. The Scrum Master helps the team and organization understand Scrum and improve effectiveness. When a measure is unclear, the Product Owner can clarify the learning objective and work ordering while the Scrum Team collaborates on the best technical test. Turning the Product Owner into the assigner of individual tasks obscures self-management without improving empiricism.
Before trusting a satisfaction report, ask who could reach the question at all. A survey shown only after submission can describe people who passed the barrier while excluding those who abandoned earlier. This selection bias can remain even if every person who saw the survey answered it. Draw the route into measurement: open the page, start the request, complete it, and see the question. At each transition identify whose experience disappeared. Gather suitable evidence from people who left, respecting privacy, and compare their explanations with those of successful users. That gives a more useful improvement hypothesis than raising satisfaction among survivors alone.
Lesson summary
Separate observation from explanation, and inspect denominators and missing voices before attributing improvement to a product change.