<span>Rethinking AI adoption: Measuring agility, not just skills</span>

Rethinking AI adoption: Measuring agility, not just skills

According to Mercer’s Global Talent Trends 2026 report, AI investment intent is at an all-time high. Sixty-three percent of C-suite leaders say redesigning work around AI and automation is the people initiative most likely to deliver the greatest return this year. Additionally, 98% of executives plan organizational design changes in the next two years. The research also finds that 65% of executives expect to redeploy or reskill between 11% and 30% of their workforce due to AI within that same period.

Yet, only about one-third of C-suite leaders believe their workforce is currently equipped to combine human and machine proficiency effectively.

The most common diagnosis is the most comfortable one: we have an AI skills gap. But what if the binding constraint is not ‘skills’ at all? What if the constraint is AI agility: the transferable human ability to adapt, judge, and redeploy work when AI changes the rules of the task?

That is the distinction at the core of Mercer’s AI Agility Framework: it separates what people know about AI tools from the deeper human attributes that determine whether AI adoption becomes business value.

Measuring what really drives AI performance

‘We have an AI skills gap’ has become one of the most common explanations offered for stalled AI returns. This framing is appealing because it’s simple: train people on the tools, maybe add some prompt-engineering specialists, and the problem is solved. It treats AI agility as a skill that can be trained quickly, like in an afternoon workshop.

Robert Solow, a Nobel Prize-winning economist and MIT professor whose research fundamentally shaped how we understand technology and economic growth, made a well-documented observation, now widely referenced as Solow’s paradox. It says that technology adoption does not automatically translate into productivity gains. This pattern has recurred across multiple waves of technological change, from enterprise computing to the internet, and current data suggests generative AI is following the same trajectory.

Through the lens of the AI Agility Framework, the ‘skills gap’ diagnosis is incomplete—and can misdirect investment. The real difference in outcomes often comes from who can handle disruption, reason through uncertainty, and exercise sound judgment with AI, especially under pressure.

In other words, adoption is about usage; agility is about the distribution of behavioral, cognitive, and technical strengths, and those strengths remain invisible unless they are measured.

Three dimensions of AI agility

Many organizations struggle with stalled AI returns because they treat ‘AI skills’ as a single category, solvable through training alone. In reality, ‘AI skill’ often combines several fundamentally different qualities.

Mercer’s AI Agility Framework separates AI agility into three distinct components, each with a different developmental profile and a different implication for talent strategy:

Behavioral predisposition

This examines whether an individual is genuinely open to having established workflows disrupted; whether they proactively seek new ways of working rather than waiting to be directed; and whether they remain resilient when early attempts with a new tool fail. These are tendency-based traits, not knowledge gaps, and they do not respond meaningfully to short-form training.

 

Cognitive ability

This involves an individual’s capacity to reason through ambiguity, identify patterns across disconnected information, and critically evaluate outputs that may be plausible in appearance but subtly incorrect. This is closer to underlying reasoning capacity than to domain-specific knowledge.

 

Tool-specific knowledge and skill

This is the ability to operate AI tools effectively: constructing useful prompts, setting constraints, evaluating outputs, and integrating results into the workflow. It is the dimension most L&D programs are built around, and it is also the most perishable. What counted as strong ‘prompt engineering’ in 2023 already looks dated next to today’s agentic and multimodal tools, and will likely be superseded again before most training cycles complete.

The strategic implication is straightforward: tool skill matters, but it is rarely the durable differentiator. A more sustainable advantage accrues to organizations that can identify and develop behavioral predisposition and cognitive ability across their workforce, because these attributes transfer across tools, models, and product cycles.

This is why the ‘skills gap’ narrative falls short. It collapses three distinct things into a single label, then attempts to solve all three with a single lever: training.

Implications for hiring, development, and workforce planning

For leaders responsible for talent acquisition, learning and development, or workforce planning, this reframing suggests several practical adjustments.

 

Tool familiarity should not be the main hiring filter. Experience with a specific AI product might show current proficiency, but its value as a predictor of long-term performance fades as tools evolve. For roles needing adaptability, organizations should emphasize how candidates handle change, reason through ambiguity, and navigate new challenges, alongside their experience with current AI tools.

 

Training investments should be split into two distinct categories. Tool-specific training should be low-cost and frequently updated, as its value depreciates quickly. In contrast, developing reasoning under ambiguity, resilience to change, and collaborative adoption of new working methods deserve sustained investment; these skills grow over time and don’t become obsolete with each new AI release.

 

Adoption metrics should be examined for confidence-related bias before they inform action. Where usage data reveals gaps across teams, demographic groups, or geographies, the appropriate first response is not necessarily a remedial training program. It is an honest assessment of who has had access to informal coaching, psychological safety to experiment, and visible permission to be unpolished with a new tool in front of colleagues and managers.

 

AI agility decisions should be held to the same evidentiary standard as other talent decisions. Workforce planning, hiring, and restructuring are not based on a single self-assessment, and AI agility should be treated no differently. Whatever assessment methodology is used, it should meet the standard expected of any defensible talent measure: validated constructs, demonstrated consistency across demographic groups, and an established link between the measure and actual outcomes.

Why agility becomes the differentiator

Organizations that gain a lasting advantage won’t be those with the most AI licenses. They will be the ones who correctly distinguish between:

  • Foundational human attributes (behavioral predisposition and cognitive ability), worth selecting and developing for.
  • Perishable tool skill, worth training broadly, cheaply, and repeatedly, but not mistaken for AI agility.

Rob Bailey
Written by Rob Bailey

Rob leads the Assessment Research Team, with a focus on: ensuring innovation and scientific rigour in Mettl’s assessments. He is a Chartered/Registered Occupational Psychologist with over 24 years of experience in psychometrics research and consultancy. He is a member of Mettl’s Executive Leadership Team.​

About This Topic
Learning agility is the ability and willingness to learn quickly and easily and incorporate new learnings in daily and first-time tasks. Learning agility is among the most wanted skills in employees in today’s fast-changing work environment.

Get awesome marketing content related to Hiring & L&D in your inbox each week

Stay up-to-date with the latest marketing, sales, and service tips and news

By using our offerings and services, you are agreeing to the Terms of Services and License Agreement and understand that your use and access will be subject to the terms and conditions and Privacy Notice