The Architecture of Measurement
Why standard culture tools miss systemic risk
The Behavioural Problem
Organisations are making serious decisions about risk, transformation, and governance based on data that captures 'Perception' rather than 'Architecture'. Tools like Culture Amp or Qualtrics are excellent for logistics, but often misleadingly similar across very different firms.
Systemic Diagnostic
Standard tools are calibrated for comparability. They prioritize universal constructs (engagement, alignment) over the specific regulatory and risk contexts of banking, healthcare, or public bodies. They measure how people feel, not how the system behaves under pressure.
Operational Impact
This leads to 'False Reassurance'. Boards receive heat-maps that look healthy, masking the shadow rules, incentives, and local workarounds that eventually crystallise into regulatory failure or safety incidents.
Over the last decade, a wave of culture and engagement tools has promised to make culture measurable, comparable, and easy to manage.
Platforms such as Culture Amp, Qualtrics, and others have made it simple to run surveys at scale and benchmark against peers, while more specialist instruments like the Organisational Culture Inventory (OCI), Denison, and OCAI offer branded models and diagnostics.
These tools provide useful data. The problem is that many organisations are making serious decisions about risk, transformation, and governance on the basis of information that is, at best, partial – and, at worst, misleadingly similar across very different firms.
1. What most mainstream tools do well
Across the major survey platforms and model-driven instruments, the strengths are clear and valuable for specific purposes:
- Logistical Scale: They make it incredibly easy to deploy surveys at high frequency and to slice results by team, location, or demographic.
- Established Constructs: They offer science‑backed item libraries. Tools like the OCI or Denison add explicit theoretical frameworks (e.g., Constructive vs. Defensive norms) that tie culture to general performance outcomes.
- Benchmarking: They are optimised for dashboards, heat‑maps, and comparative benchmarks. They allow a Board to see where they sit relative to "Industry Average."
For general engagement and sentiment tracking, these tools are the industry standard for a reason.
2. The Convergence: Sameness of Information
However, despite surface differences in branding or theoretical models, these approaches share several characteristics that limit their utility for deep governance and risk work:
They privilege perception over architecture
Most tools capture what people say they experience or believe is expected of them. This is valuable, but it reflects the collective perception of norms, not the underlying social architecture (incentives, decision rights, disciplinary processes) that generates those perceptions.
They are calibrated for comparability
Question banks and indices are designed so that organisations can be meaningfully compared to benchmarks. Over time, this encourages convergence on a narrow set of questions. The tool prioritises its own ability to benchmark over your ability to diagnose unique friction.
They underweight regulatory and risk context
Off‑the‑shelf tools are rarely designed with the specific risk environments of banking, legal, healthcare, or public bodies in mind. Their focus is usually on engagement or generic "culture types," rather than on how culture interacts with AML, patient safety, audit independence, or oversight obligations.
The net effect is that different tools frequently produce very similar artefacts: heat‑maps and quadrant plots that feel rigorous but rarely tell leadership which part of their architecture to change, in what order, and with what risk implications.
3. The Risks of Generic Data
For organisations facing serious risk and regulatory questions, this "sameness" matters.
- False Reassurance: Reasonable scores and favourable benchmarks can conceal deep misalignments between espoused values and actual behaviour. We frequently see "Green" engagement scores in units that are actively incubating "Red" conduct risks.
- Misallocated Attention: Leadership time is pulled towards what is easiest to visualise (engagement scores, word clouds) rather than what is hardest to see (shadow rules, decision pathways, local workarounds under pressure).
- Limited Predictive Power: Tools that treat culture as a set of attitudes have limited ability to predict where the system will fail under specific pressure. Knowing your "Engagement Index" does not tell you if your incentives are currently overriding your AML controls.
The data is real, but it is often not the data you need when the questions involve regulatory exposure, systemic risk, or deep transformation.
4. The Architectural Approach
At Neil Fogarty Research, our work starts from a different premise: that culture is best understood as the behaviour of a social architecture under pressure, not as a pattern of survey responses.
This shifts the analytical focus from perception alone to the interaction of:
- Architecture & Incentives: Roles, decision rights, reward mechanisms, and routines – what people are paid, explicitly and implicitly, to care about.
- Signals & Flows: How weak signals, concerns, and anomalies travel (or fail to travel) from the front line to the Board.
- Shadow Rules: The informal norms and deep‑rooted narratives that govern behaviour when formal rules collide with commercial reality.
We underpin this with longitudinal organisational behavioural economics. We integrate regulatory and sector context from the outset, using the Resonance Framework and the Resonant Shadow Ledger to map how architecture interacts with specific risk environments.
Surveys have a place as inputs to this diagnostic—snapshots of perception that help triangulate where the system is misaligned. The danger arises when the survey is treated as the diagnostic itself.
5. The Litmus Test
There are a few practical tests you can apply to your current culture tooling to determine if it is fit for governance purposes:
1. The Brand Test: If you removed the brand and colour scheme from the output, would an informed outsider be able to tell which tool produced it?
2. The Action Test: Can you draw a clear line from the results to specific architectural changes and risk decisions – or does every recommendation sound like "communicate more" and "develop leaders"?
3. The Risk Test: When your regulators or Board ask how culture relates to specific risks (e.g. AML, patient safety, audit independence), can your current tools help you answer that at the required depth?
If not, the issue may not be how often you measure, but what you measure.
If you are currently using one of the major platforms and want a view on what it can and cannot tell you – in the context of your sector, regulatory environment, and risk profile – we are happy to review it with you as part of an initial scoping conversation.
Core Concept
Measurement Resonance is the alignment of metric with intent.
From the Library
"When a system designed to provide justice operates mechanistically, it can deliver only process, and in doing so, risks losing its moral authority."
— The Philosophy of ResonanceBoardroom Synthesis
"If you removed the brand and colour scheme from your culture report, would an informed outsider be able to tell which tool produced it? If not, you are measuring the tool's model, not your organisation's reality."
