Every generation gets its own technology revolution. The internet changed how we access information. Cloud computing changed how businesses consume technology. Artificial intelligence is changing how work gets done. Most of the discussion has focused on productivity, automation, and efficiency. Those are all real benefits, but I believe the bigger change is happening somewhere else.
For decades, organizations had a relatively simple way to evaluate capability. People demonstrated it through their work. The quality of their analysis, the recommendations they made, the questions they asked, and the decisions they reached all revealed something about their experience and understanding. Expertise was never perfect, but over time it became fairly easy to distinguish someone who truly understood a subject from someone who did not.
That distinction is becoming less obvious. Today, someone with very little experience can generate a polished report, a detailed business case, or a sophisticated presentation in a matter of minutes. The output may be excellent. In many cases it may be better than what an experienced professional would have produced on their own. The challenge is that the quality of the output no longer tells us much about the capability of the person behind it.
Looking Smart Versus Being Smart
Knowledge has never been the same thing as understanding. Having access to information is not the same as knowing what to do with it. Producing an answer is not the same as exercising judgment. Most leaders have worked with people who could speak intelligently about a topic but struggled when it came time to make decisions. They have also worked with people who were not particularly impressive in meetings but consistently delivered results when conditions became difficult.
The difference is usually judgment. Judgment comes from experience. It comes from making decisions, living with the consequences, learning from mistakes, and understanding context. It develops over time through exposure to situations where there is no obvious answer and no perfect outcome.
AI can accelerate access to information. It can summarize research, draft recommendations, and organize ideas. What it cannot do is compress years of experience into a prompt. It cannot create judgment. It cannot create accountability. It cannot create the understanding that develops when someone has personally navigated uncertainty and accepted responsibility for the outcome.
Competence becomes visible when things stop working.
The Real Test of Competence
When systems fail, customers become frustrated, revenue is disrupted, or a major incident occurs, organizations quickly discover whether they possess genuine capability or simply impressive outputs. The report that looked brilliant last month becomes irrelevant if nobody knows how to respond when circumstances change. The strategy that sounded convincing in the boardroom loses value if the team cannot adapt when reality diverges from the plan.
This is why experience still matters. When disruption occurs, there is rarely a playbook that perfectly fits the situation. Leaders must make decisions with incomplete information. Teams must solve problems they have never encountered before. Tradeoffs must be made quickly. The ability to navigate those moments comes from understanding the business, not from generating content about the business.
The person who understands the underlying problem can adapt. The person who only understands the output often cannot.
A New Leadership Challenge
This creates a challenge that many organizations are only beginning to recognize. Historically, managers evaluated capability by reviewing work products. Reports, presentations, proposals, and analyses provided evidence of expertise. Those artifacts helped leaders identify high performers and future leaders. Increasingly, they may reveal more about an individual's ability to use AI than their ability to think critically.
That does not mean the work is bad. In fact, the work may be exceptional. The problem is that traditional signals are becoming less reliable. Leaders can no longer assume that polished output reflects deep understanding. They must look beyond the final product and evaluate how people arrive at their conclusions.
The questions become different. Can someone explain why a recommendation was made? Can they defend it when challenged? Can they identify the assumptions behind it? Can they recognize when it is wrong? Can they adapt when the situation changes?
Output alone often does not reveal competence.
Trust in the Age of AI
The irony is that AI is frequently positioned as a tool that improves decision-making. In many cases it absolutely will. Organizations that use it effectively will move faster, process information more efficiently, and eliminate work that adds little value.
At the same time, AI introduces a new trust challenge. As organizations rely more heavily on automated recommendations and generated outputs, leaders may find themselves placing greater confidence in results while having less visibility into the capability of the people overseeing them. The risk is not that AI produces bad answers. The risk is that organizations lose the ability to distinguish between genuine expertise and the appearance of expertise.
That distinction matters because businesses do not succeed based on information alone. They succeed based on decisions. Those decisions still require judgment, accountability, context, and experience. They still require people who understand why something works, not just what the answer happens to be.
Therefore, in my opinion, AI does not make people smarter, but it does make competence harder to see.