Translate enterprise outcomes into data theses
11 min read
Lesson objectives
- Formulate a data thesis that links an enterprise outcome to a decision, measure and falsifiable hypothesis.
A data thesis is not a technology project list. It is a falsifiable claim explaining how specified data changes an enterprise decision to produce a defined outcome. Start with the recurring decision under uncertainty: who makes it, which realistic alternatives exist, and what information would reverse the choice? Only then identify data and capability. A strong thesis names outcome, denominator, period, assumption and falsifying fact, while separating an early signal from the later business result.
A data thesis is a testable explanation connecting an enterprise outcome, a recurring decision and a defined data capability. It is neither a project list nor a promise that more data improves performance. Its validity depends on three links: information reaches the decision owner in time, changes the choice or its speed, and explains part of the outcome while guardrails remain within bounds. Governance approves purpose and risk boundary; management designs and runs the trial.
Build the thesis on a seven-field sheet: intended outcome, current decision, decision owner, alternatives, required data, hypothesis and falsifying fact. Put denominator and period beside every measure. Then trace the chain from source event to the information seen by the decision owner and mark where causality may break. Reject “improve data” unless the changed behavior is explicit.
Compare repair at the decision point, a bounded capability trial and a broader platform. If an incident lead cannot see service dependencies, a two-service map tests the cause quickly. If dependencies are known but ignored, workflow and training are the intervention. A broader platform becomes justified only when the trial shows a recurring problem, a transferable pattern and scaling cost lower than expected impact.
Median recovery falls from 95 to 74 minutes, an improvement of 21 minutes or about 22.1%. Reopenings rise from 9% to 14%, breaching the 10% limit. Do not combine the measures into a score that hides harm. The speed link is supported; closure quality is not. Revise verification and rerun the trial. The thesis is not accepted until both conditions hold.
Track three separate signals: input quality, decision change and business result. In the maintenance trial, accurate cause code is an input signal, dispatching a second crew is a decision and reopening is the outcome. If the first improves without the second, workflow is blocking use; if the decision changes without outcome improvement, the causal hypothesis may be wrong. Never collapse these signals into one score.
When moving the trial to a third site, do not copy its threshold alone. Compare asset mix, supervisor skill and emergency-order share because lower reopening may reflect easier work. The thesis record retains denominator, measurement period and screen version, and scale pauses when the channel changes before a new baseline exists.
Build a data thesis for a service with recurring outages. The enterprise outcome is lower customer impact, not production of a dashboard. The decision to improve is the incident lead’s choice of which component to isolate or restore. Inputs are affected services, dependencies, the latest change and component state; the capability makes those relationships visible with known freshness. State a falsifiable hypothesis: if dependencies for critical services appear within two minutes of incident opening, median time to identify the causal component will fall by at least 25%, without pushing reopenings above 10%. Select incidents with comparable severity and disclose exclusions; a quiet week is not a valid baseline for a month containing a major release. In the trial, expose the map for two services and retain the former workflow. Before each incident, the lead records an initial hypothesis; afterward, the lead records whether the map changed the choice. Identification falls from 38 to 25 minutes and recovery from 95 to 74, yet reopenings rise to 14%. Review shows that relationship direction was unclear, so responders isolated a dependent component instead of the source. The decision is neither declare success nor abandon the thesis. Correct relationship direction, add verification before closure and continue for ten bounded cases. Extend to two more services only if recovery remains below 75 minutes and reopening returns to 10% or less. Data creates value here by changing an observable professional choice within a guardrail, a competing explanation and a rollback option.
Before approving the thesis, ask someone who did not write it to identify the decision, alternative and falsifying fact from the sheet alone. Then test an excluded case, such as a safety failure requiring immediate dispatch regardless of cause code. A clear boundary proves the thesis guides a specific choice rather than becoming a general slogan for funding data. Implementation review: retain an unchanged comparison channel and adjust for asset type and failure severity. Recalculate after excluding safety orders outside the trial decision. If the effect disappears, revise the claim instead of scaling. If it persists, move the trial to one new site before enterprise adoption. The record also preserves every exclusion reason for replay.
| Field | Decision or evidence |
|---|---|
| Title | Thesis worksheet |
| Outcome | reduce customer outage impact, measured by affected downtime minutes and customer count. |
| Decision | choose the component to isolate or restore; owner is the on-duty incident lead. |
| Inputs | affected service, dependency direction, latest change, component state and event time. |
| Capability | a dependency map with freshness and confidence; fields unused by the decision are excluded. |
| Baseline | twenty-four comparable incidents; median recovery 95 minutes and reopening 9%. |
| Hypothesis | relationships visible within two minutes reduce causal-component identification by 25% while reopening stays at or below 10%. |
| Trial | two services, two trained leads, ten eligible incidents and the former workflow retained for rollback. |
| Result | 74 minutes and 14% reopening; speed improves and the guardrail fails. |
| Competing explanation | a quieter period or different severity mix, checked through distribution and a comparable window. |
| Repair | show relationship direction and verify before closure. |
| Continuation | ten revised cases, then two more services only if both conditions hold. |
| Limit | this result does not prove every enterprise service needs the same platform. |
| Field | Decision or evidence |
|---|---|
| Title | Thesis decision lab |
| Situation | a maintenance company wants fewer repeat failures, while the sponsor proposes a unified warehouse before naming the decision that will change. |
| Outcome | reduce reopened work orders from 14% to 9% within ninety days without increasing first-closure time by more than 6%. |
| Decision | should the supervisor dispatch a second crew or close the order? That decision needs a reliable cause code, part history and use context, not every asset field. |
| Hypothesis | completing those elements before closure reduces wrong diagnosis; it is falsified if completeness rises while reopening does not fall. |
| Baseline | 1,200 orders, 168 reopened and 420 lacking a valid cause, with 73% of missing values produced by one mobile channel. |
| Alternatives | general training, blocking closure on missing data, or repairing the channel in a trial with an urgent exception route. Training is quick but leaves the screen constraint; a universal block can delay safety work. |
| Choice | trial the channel at two sites, block ordinary incomplete cases and allow signed exceptions for critical incidents. |
| Evidence | cause completeness, accuracy in a two-engineer sample, reopening by asset type and closure time. |
| Decision rights | maintenance owner accepts the outcome, data owner approves meaning and safety can stop the block if critical response is delayed. |
| Week-four gate | 90% coverage, 85% reviewer agreement and at least a two-point decline in reopening. |
| Guardrail | manual work rises no more than ten minutes per order and users do not substitute a misleading generic code. |
| Rollback | restore the prior screen after two consecutive days above the 6% delay boundary while retaining trial records. |
| Judgment | do not fund the warehouse yet; fund channel repair and hypothesis measurement, then scale only if effect survives site adjustment. |
| Field | Decision or evidence |
|---|---|
| Title | Post-trial review |
| 1 | Separate channel-repair effect from site difference using a comparable untreated site. Recalculate reopening by asset and severity, and inspect twenty orders whose code completed without decision improvement. If supervisor coaching caused the change, revise the thesis rather than scaling the warehouse. Verify that urgent exceptions did not become the normal route. The next decision is one-site scale, screen change or hypothesis stop, never automatic continuation. |
| 2 | The report also shows measurement confidence, sample size and site difference, because a lower average can hide more severe failures or move work to an unobserved channel. |
| 3 | Reviewer also records the nearest competing hypothesis and evidence for rejection. |
| Field | Decision or evidence |
|---|---|
| Title | Thesis verification |
| 1 | Recalculate once with emergency orders and once without them, then compare both sites with an unchanged site. Inspect ten cases where cause code completed but dispatch did not change. If effect exists under one supervisor only, record person dependency and do not attribute it to data capability. |
| Final boundary | do not generalize beyond maintenance channels represented in the measured sample, especially before a second operating cycle confirms persistence. Report asset mix, incident severity, emergency share, missing-value cause and supervisor coverage beside the result. Preserve the unchanged comparison site through the review window, and distinguish a durable workflow effect from a temporary response to observation or coaching before any enterprise funding decision. Record excluded orders and explain how their absence changes interpretation and confidence. |
Lesson summary
Formulate a data thesis that links an enterprise outcome to a decision, measure and falsifiable hypothesis.