A 5-Metric Framework for Measuring Real Change Adoption
Introduction
A framework for measuring real change adoption while minimising the risks highlighted by Goodhart’s Law (metrics being gamed). The idea is to measure change from multiple angles, not just a single KPI.
1. Awareness Metrics
Measure whether people know about the change and understand why it is happening.
Typical indicators:
- % of staff who understand the change vision
- attendance at change briefings
- communication reach (town halls, intranet views)
Sample question:
“Do you understand why this change is necessary.”
Why it matters:
If people don’t understand the purpose, adoption rarely happens.
Limitation:
Awareness alone does not guarantee behaviour change.
2. Capability Metrics
Measure whether people can actually perform the new behaviours.
Typical indicators:
- training completion
- certification or competency assessments
- ability to demonstrate the new process
Better measurement approach:
Instead of measuring training attendance, measure competency demonstration.
Example:
- Employees complete a simulation or task using the new system.
Why it matters:
- Change fails when people are expected to use tools or processes that they do not yet understand.
3. Behavioural Adoption Metrics
Measure whether people are actually using the new way of working.
Typical indicators:
- % of work completed using new processes
- usage depth (not just logins)
- number of transactions in new system
Example:
Instead of measuring CRM logins, measure:
- % of customer interactions recorded in the CRM
Why it matters:
- This is where real change begins.
4. Performance Metrics
Measure whether the change is improving outcomes.
Examples:
- faster turnaround time
- reduced error rates
- improved productivity
- improved customer satisfaction
Example:
After implementing a new digital workflow:
- processing time drops from 4 days to 2 days.
Why it matters:
If performance does not improve, adoption may be superficial.
5. Cultural Reinforcement Metrics
Measure whether the new behaviours are becoming the norm.
Indicators:
- leaders modelling the new behaviours
- peer recognition of new practices
- employee attitudes toward the change
- new behaviours appearing in performance reviews
Sample question:
“Do you regard the new way of working is the normal way we operate.”
Why it matters:
This shows whether change has moved from project to culture.
The Framework Summary
| Metric Type | What It Measures | Key Question |
|---|---|---|
| 1. Awareness | Understanding | Do people know why change is happening? |
| 2. Capability | Skill | Can people perform the new behaviour? |
| 3. Behaviour | Adoption | Are people actually using the new approach? |
| 4. Performance | Results | Is the change improving outcomes? |
| 5. Culture | Sustainability | Has the change become the norm? |
If you measure only one thing (e.g., training completion), people can game the metric.
But when you measure five layers simultaneously, gaming becomes difficult because:
- activity metrics must align with behaviour
- behaviour must align with performance
- performance must align with culture
This creates a balanced view of change success.
An example: New Digital System Rollout
| Metric | Example |
|---|---|
| 1. Awareness | 85% of staff understand why the system is being introduced |
| 2. Capability | 90% pass competency assessment |
| 3. Behaviour | 70% of work processed through system |
| 4. Performance | processing time reduced by 30% |
| 5. Culture | teams say system is now “how we work” |
When all 5 improve, the change is real.
Key Insight
Effective change measurement should answer 3 questions:
Do people understand the change?
Can they do it?
Are they actually doing it and is it improving results?
If you only measure the first two, Goodhart’s Law will almost certainly appear.
(main sources: Charles Goodhart, 1975; Jerry Muller, 2018)