Flow visibility and data quality · Lesson 3

Measure order service with valid denominators

5 min read

Lesson objectives

  • Define service denominators, calculate completeness, timeliness and joint success, and distinguish performance change from mix or inclusion-rule change.

A service metric answers a defined question; it is not a number whose meaning is obvious on a dashboard. If a team reports “95% of orders served,” ask whether the denominator is whole orders, order lines or individual units. Does success mean arrival on time, complete quantity or acceptable condition? SCOR performance models emphasize reliable customer order fulfillment, but a local operational measure still needs an explicit time window and inclusion rule. Choose a counting unit that matches the decision. Operations managers may need the number of affected orders, while planners need missing units. Switching denominators can create a fictitious improvement.

For this example, define complete-order rate as eligible orders delivered with all requested quantity divided by eligible orders in the period. Define on-time rate as eligible orders whose final part arrived no later than the date promised to the customer, divided by the same population. An immediate unit-fill measure would instead be units supplied without delay divided by units requested. Similar names do not make these measures equivalent. An order for 100 units and an order for one unit have equal weight in an order-based rate, but different weights in a unit-based rate. Put the definition in the table heading so someone else can reproduce it.

Before reporting a decline, examine the promised date used for each order. If a promise was revised after a delay and the report uses only the new date, the order may appear timely without an improved customer experience. Retain the original promise, any revision and reason, and actual arrival date. Use a stated measurement policy rather than rewriting history. Likewise, do not mix an order cancelled by the customer before allocation with an order the organization failed to serve. Either exclude cancellations under a published rule, adjusting the population consistently, or show them separately. Changing the inclusion rule between weeks prevents a direct comparison even when the arithmetic is sound.

A sound measure sheet records the status source, period, order closure point, on-time standard, treatment of split shipments, damage and returns, and handling of missing data. Make each order an auditable row: identifier, original and revised promise, actual delivery, ordered and delivered quantities, and condition. Recount at least one classified success and one failure manually. If one lacks a promised date, do not invent success or failure. Mark it unclassifiable pending a data-owner check. That may add work, but it is more honest than false certainty. The operational result is not only the rate; it is a list of exceptions someone can investigate and own.

Lesson summary

State the order population, inclusion rule and denominator before calculating a rate. Count the joint successes directly rather than multiplying separate rates.