When the Reported Number Disagrees With the Floor
Reported KPIs diverge from operational truth because the system of record captures whoever fills the cell, not the variable that governs throughput.
The 1% Downtime That Wasn't
A protein co-packer in the Midwest pulled their March production data for review. The MES reported 1% downtime across four packaging lines. By the standards of any operations executive, that is a clean month.
We had spent two days on those same lines the week before. The 1% number was not what we saw. Stops for upstream supply, micro-jams on the rolling block applicator, an operator waiting on a sanitation crew to finish the next cell, and at least one twenty-minute red-zone event that nobody on the floor wrote down. The reported number was not wrong because somebody was lying. It was wrong because the MES captured whatever the line lead chose to flag, and the line lead had been trained to flag mechanical failures, not throughput loss.
That is not an MES problem. That is a measurement protocol problem, and it is the same problem hiding inside half the operational data we touch.
Why the Reported Number Diverges from the Floor
Three forces pull reported KPIs away from operational truth.
The first is definition drift. The word downtime can mean different things to the planner who set the standard, the operator who fills the cell, and the executive reading the report. A line that runs at half speed because product upstream is short is recording uptime, even though the throughput loss is identical to a hard stop. Until the definition is written down and shared, every reporter is filling out a slightly different form.
The second is reporter incentive. Who fills the cell has a stake in what goes in it. Operators do not voluntarily write down downtime they expect to be questioned, and supervisors do not roll up numbers that will trigger a meeting they do not want. Optimism bias is not a sales-team disease. It is a property of any reporting system where the reporter pays a cost for the truth.
The third is the gap between the system of record and the system of reality. The MES is one log. The maintenance work order system is another. The camera footage in the red zone is a third. When those three sources do not reconcile against each other, the system of record is not the signal. It is one of three voices, and the noisiest one wins by default because it is on the dashboard.
This is an instance of a broader pattern. Organizations lose visibility into the things they do not have a structural reason to record. The variable on the report is not the variable that matters. It is the variable that was easiest to capture.
The Same Gap, Three Different Operations
Once you see this pattern, it surfaces everywhere we have worked recently.
A sales organization tightening their CRM rollout this month found their headline pipeline number moving on optimism alone. Reps were marking opportunities at high probability without coverage ratios attached. The sales operations lead is preparing to enforce weighted stages over a forty-five-day compliance ramp because raw pipeline was driving forecasts, and the forecasts were driving commitments. Without weighted math at the stage level, the planning decisions downstream were being made off a number that was not measuring what the executive team thought it was measuring.
A diligence team working a midmarket plastics acquisition pulled the target's procurement file last week. On paper the resin contracts looked solid. The work was to verify whether those contracts would actually hold under the volatility expected in the back half of the year. Some of the supplier commitments were handshake. Some were formal. The gap between we have an agreement and we have an enforceable agreement under allocation pressure is the entire question. The historical price was not the signal. The contract robustness was.
A finance review at an operating company surfaced the same pattern in their books. The consolidated P&L told one story. The subsidiary-level cash flow told a different one. Without time allocation by project, the firm could not produce a real margin number per engagement, which meant they could not tell which work was profitable. The reported margin existed. It was not the same as the actual margin.
In each case the failure mode is the same chain. Hidden loss leads to misattribution, which leads to the wrong intervention, which amplifies the loss. The protein plant with the 1% downtime number will not invest in the throughput problem they cannot see. They will invest in the demand problem they think they have. The sales organization with the inflated pipeline will hire to a forecast that does not land, and then cut the sales team when the issue was forecast quality. The acquirer who closes on a target with handshake contracts will discover the gap in the first volatile quarter, not the diligence room.
What to Do About It This Week
The work is not glamorous. Find your three most-cited operational KPIs. For each, answer four questions in writing.
Who fills the cell. What counts and what does not. What the source of truth is that the reported number reconciles against. What incentive the reporter has to under-report or over-report.
Pick the one with the largest gap between reporter incentive and decision weight. That is your first audit. Walk the floor for a shift. Pull the raw CSV for a day. Listen to two hours of call recordings. Compare what the dashboard says to what the source data shows. If they agree, move to the next KPI. If they do not, fix the definition before you fix the number.
This is what we told the protein co-packer this week. Before any analysis of their March production data, we are running an internal review meeting to walk through the raw CSV alongside the MES summary, with a request out to the plant for the red-zone observational data and the camera logs. The conversation with the operations lead is not your downtime is wrong. It is let us agree what downtime means before we count it. That alignment is the prerequisite to every improvement effort that follows.
The same is true at the film supplier where we are drafting a qualification protocol for the optimized spec rollout. The technical answer is not the bottleneck. The agreement on which benchmarks to capture, in what sequence, at what trial size, is the bottleneck. Stakeholders care more about the protocol than the answer, because the protocol is how they will judge the answer when it arrives.
The Number on the Dashboard Is Not the Operation
The dashboard is a story about the operation, told by whoever filled the cell. Until you verify the protocol behind the cell, every decision downstream is built on the storyteller, not the floor.