By Seth Earley, Founder & CEO, Earley Information Science
────────────────────────────────────
Published: June 13, 2025
Last Updated: October 7, 2026 | Version 1.0
────────────────────────────────────
Who This Is For: C-suite executives, VP/Directors of Digital Transformation, and AI/ML leaders navigating the transition from LLM-based tools to agentic AI systems. Also valuable for technology strategists and enterprise architects evaluating agentic deployment.
Prerequisites: Basic familiarity with large language models and enterprise AI initiatives.
────────────────────────────────────
This article draws on a roundtable discussion with AI and search practitioners Jeff Evernham of Chapsvision, Olivier Têtu of Coveo, Patrick Hoeffel of Perficient, and Phillip Ryan of GlassLeopard Technologies, who participated in the Earley Information Science seven-part series on Search and AI.
────────────────────────────────────
Something significant is happening beneath the surface of the AI conversation, and it is not the headline capabilities that tend to dominate coverage. The more consequential shift is architectural: enterprises are moving from large language models as standalone tools toward agentic systems that orchestrate tasks, coordinate across multiple systems, and act with a degree of autonomy that earlier AI implementations did not possess.
For most organizations, this transition is arriving faster than their strategic planning anticipated. Understanding what it means in practical terms — what agentic systems can do, where they fall short, and what organizational conditions determine whether they succeed — is now a prerequisite for executive decision-making, not a topic that can be safely delegated to technology teams.
Traditional large language models respond to prompts. They generate text, summarize documents, draft communications, and answer questions. The interaction is fundamentally reactive: a human initiates, the model responds, the exchange ends. This is genuinely useful, but it is also inherently limited. The model does not initiate, does not remember across sessions by default, and does not act on systems beyond producing text.
Agentic systems operate differently. They are designed to pursue goals across multiple steps, coordinating between data sources, APIs, software systems, and in some configurations, other agents. Jeff Evernham of Chapsvision observed in our discussion that AI is becoming less something people consciously go to and more the invisible infrastructure woven through everything an organization does. That shift in how AI is experienced — from tool to infrastructure — is what agentic architecture enables.
Patrick Hoeffel of Perficient offered a useful analogy: agentic AI is to traditional LLMs what microservices were to monolithic applications. Just as software architects decomposed large applications into smaller, independently deployable services, agentic AI decomposes complex tasks into specialized agents that can be composed and orchestrated as the work requires. The interface is natural language; the underlying architecture is modular and dynamic.
The business implications are substantial. Agentic AI creates the possibility of automating not just discrete tasks but connected workflows — sequences of decisions and actions that previously required human coordination at each handoff. Customer support interactions that route, escalate, and resolve across multiple systems. Software development workflows where agents suggest, test, and refine code in parallel. Knowledge management processes where agents curate, validate, and surface information without manual intervention at each step.
Phillip Ryan of GlassLeopard Technologies described how agentic tools have transformed development workflows in practice, with multiple agents collaborating in real time to accelerate work that previously required sequential human effort. The productivity gains in bounded, well-defined domains are real.
But the transition introduces complexity that organizations need to plan for honestly. Agentic systems that operate autonomously across multiple steps and systems also fail in more consequential ways than systems that merely respond to prompts. The scope of potential error is broader, the traceability of that error is harder, and the governance required to manage it is more demanding.
Data quality determines everything. This is not a new insight, but agentic AI makes it more consequential than ever. Phillip Ryan put it directly: search and retrieval are not query-time problems, they are data management problems. Agentic systems can orchestrate across datasets, but they cannot compensate for the quality of the data they draw on. Every failure mode in earlier AI implementations that traced back to poor information architecture, inconsistent taxonomy, or ungoverned metadata will resurface in agentic deployments — at greater speed and scale. Organizations that have deferred foundational data work will find it impossible to avoid any longer.
Pattern matching is not reasoning. Olivier Têtu of Coveo raised a concern that practitioners encounter consistently: users develop an inflated sense of AI capability based on fluent, confident outputs. Current models, including those powering agentic systems, are fundamentally pattern-matchers. They produce plausible continuations of language based on statistical relationships in training data. When operating in well-structured domains with high-quality inputs, this produces impressive results. When operating outside those conditions, it produces hallucinations — outputs that are fluent and confident but factually incorrect. Agentic systems inherit this limitation and must be carefully scoped, grounded in authoritative knowledge sources, and monitored to prevent unintended consequences from propagating across automated workflows.
Generic solutions will not create competitive advantage. Têtu also observed that differentiation in agentic AI will not come from access to foundation models, which are broadly available, but from how organizations configure, customize, and integrate those models against their specific operational realities. Every enterprise will need agentic configurations tailored to their data, their workflows, and their customer expectations. The organizations that build that customization capability — developing the orchestration layers, the domain-specific training, and the integration architecture that reflects how their business actually works — will pull ahead of those that rely on off-the-shelf implementations.
ROI must be defined before deployment, not after. Ryan identified a pressure point that many technology leaders will recognize: the imperative to deploy AI is sometimes stronger than the imperative to derive value from it. This is a significant risk at the organizational level. Agentic systems that are deployed without clear success criteria — specific, measurable outcomes tied to defined business processes — are expensive and hard to evaluate. Traditional KPIs may not capture the performance of multi-step, probabilistic workflows. Organizations need measurement frameworks designed for agentic systems before those systems go into production, not improvised afterward when stakeholders are already questioning the investment.
One risk that received significant attention in our discussion deserves direct mention for C-suite leaders. As agentic capabilities become more accessible, organizations will accumulate specialized agents rapidly — for specific functions, specific data domains, specific customer workflows. Some organizations are already managing thousands of custom GPTs and specialized configurations.
Without intentional organizational frameworks for cataloging, governing, and retiring agents, this proliferation creates a new version of a familiar problem: the data sprawl of earlier enterprise technology cycles, now replicated at the level of AI agents. Discovering which agent is authoritative for a given task, ensuring agents are not operating with conflicting assumptions about the same business concepts, and maintaining consistency across an expanding agentic ecosystem are governance challenges that need to be addressed before the ecosystem grows large enough to make them intractable.
The organizations positioned to benefit from agentic AI share a set of characteristics that have nothing to do with which models or platforms they have selected. They have invested in information architecture as foundational infrastructure rather than a supporting concern. They define business outcomes before deploying technology and build measurement frameworks that reflect how agentic systems actually operate. They approach customization as a strategic capability rather than an implementation detail. And they treat governance as an enabler of scale rather than an obstacle to speed.
Agentic AI is becoming the interface layer between human intent and machine execution. For enterprises that build the right foundations, the potential is substantial. For those that do not, the complexity will compound faster than the value.
This article was originally published on CustomerThink.