All Posts

Four Critical Elements of Metrics-Driven Information Governance

The importance of information governance is recognized by most organizations, both for its operational value and its role in supporting such functions as compliance and risk management. Success depends on having programs in place for assessing the effectiveness of their governance programs in achieving their strategic goals. Here are four critical steps of a metrics-driven information governance program:

  1. Picking the right metrics
  2. Mining user behavior through search analytics
  3. Integrating data sources
  4. Promoting culture change


New call-to-action

Picking the Right Metrics

The best way to decide which metrics matter is to define what success would look like. This varies depending on the organization’s mission. Success might be:

  • for a customer to buy a product, or reach a certain dollar value of purchases;
  • a point along the way, like asking for more information or signing up for a rewards card;
  • or, customers’ interactions with web content, the catalog, and the product pages, if the goal is to drive new leads.

The goal will determine the performance metrics and guide the selection of analytics.

Once success is defined, the next step is to look at the digital traces. There are events that can be measured and tracked within the organization’s information systems. The beauty of digital content that it is possible to watch much of the customer’s journey through an application or a website, from search to purchase to how often the customer calls for help. Does the “electronic body language” of the customer indicate that they wanted to buy a particular product? Are people drilling down and getting more information and generating indicators of intent to purchase? Quality metrics are the key to implementing metric-driven data governance.

[Webinar] How to Instrument KPIs Throughout the Customer Journey

Mining User Behavior through Search Analytics

One typical source of metrics are searches conducted by users on a company’s website. These are a prolific source of data that can be used to provide input to how data should be structured and organized to maximize its value to customers. Examples of search metrics include:

  • number of results for particular queries,
  • number of queries that are producing no results,
  • results where users do not click on anything but instead execute another query,
  • coverage of search terms within a taxonomy, and
  • various types of relevancy metrics.

Judicious use of analytics technology can provide significant insights and a quick return on investment.

Since relevancy is in the eye of the beholder, these tests should be run on search results with specific users and use cases in mind. Search metrics provide additional data points for governance teams when reviewing the performance of web content and architectural constructs. 

Data helps settle disagreements about how to govern information, overriding opinions that turn out not to be justified.

Integrating Data Sources

Metrics-driven governance programs become the point of information integration across numerous systems.  Average order size is harvested from transaction systems, but to correlate average order size with customer segment requires data from CRM and customer master files.  Being able to correlate average order size with customer segment for a particular campaign and web site offer requires integration across marketing management systems and web analytics in addition to CRM, transaction, and customer master data. IT policies and procedures for integration should align with data governance programs.

Increasingly the customer’s success depends not only on content, but also on data from various back end systems as well as interaction with the customer service organization.  The customer may need to access account history, submit trouble tickets, pay bills online, look for maintenance information, connect with other users, voice frustrations or positive experiences, research multiple options, and complete a transaction using multiple devices.

IT, marketing, line of business, analytics, social media, information architecture, and user experience teams are increasingly being organized under a digital experience department or function.  Metrics-driven governance processes are driving working agendas through dashboards that integrate multiple data and analytics sources and various levels of granularity for different audiences and purposes. Implementing the right technology to support these initiatives is essential. 

Promoting Culture Change

One of the biggest challenges with any enterprise innovation is culture change, and doing so for a data-driven information governance program is no exception. Each participant needs to understand how the governance process is relevant to their job and the organization’s objectives. Employees who do not see governance as being part of their job, and focus solely on their primary roles such as sales or customer relationships, will not be motivated to take an active role in completing tasks such as filling in data about a product.

The need for change management should be anticipated and included as part of the emerging data governance framework.

Many different types of actions are required to maintain a metrics-driven governance system. Although much of the data needed for assessments is collected automatically by enterprise systems, some of the data that is required in order to obtain metrics must be entered by employees. The best strategy is to engage the stakeholders early in the process so they are on board with all the behavioral changes that will be required. However, if people have not bought into the process, then a change management project might be required to develop appropriate training, socialization and communications programs.

An organization establishing or evolving governance should evaluate various governance models to determine what will work best for their culture and processes. A democratic model gives everyone a vote but making decisions can be difficult. Multi-domain models with an enterprise-wide steering committee help drive strategy but can be stifling. A gatekeeper model uses a single decision-making body that is responsible for all decisions and offers consistency, but can produce bottlenecks. Whatever model is used should provide accountability and transparency so that key stakeholders understand the standards, purpose, and policies of the new initiative.

These and other models each offer their own advantages and drawbacks; sometimes hybrid models that use components of each are the best for a particular organization.  There are multiple roles and stakeholder types in each of these models.  Some people are involved producing metrics, and others are consumers of the reports. Each organization needs to structure its governance in a way that allows for the flow of metrics to the correct level of decision maker in order to catalyze action and achieve the desired business results.

The philosophy of metrics-driven governance can be applied to any part of the business where value is generated by facilitating a cross-functional collaboration focused on specific, measurable outcomes. In each part of the business, however, people need to understand the value of governance and the processes required to make it work.

Ready to Talk?

Seth Earley
Seth Earley
Seth Earley is the Founder & CEO of Earley Information Science and the author of the award winning book The AI-Powered Enterprise: Harness the Power of Ontologies to Make Your Business Smarter, Faster, and More Profitable. An expert with 20+ years experience in Knowledge Strategy, Data and Information Architecture, Search-based Applications and Information Findability solutions. He has worked with a diverse roster of Fortune 1000 companies helping them to achieve higher levels of operating performance.

Recent Posts

The Future of Bots and Digital Transformation – Is ChatGPT a Game Changer?

Digital assistants are taking a larger role in digital transformations. They can improve customer service, providing more convenient and efficient ways for customers to interact with the organization. They can also free up human customer service agents by providing quick and accurate responses to customer inquiries and automating routine tasks, which reduces call center volume. They are available 24/7 and can personalize recommendations and content by taking into consideration role, preferences, interests and behaviors. All of these contribute to improved productivity and efficiency. Right now, bots are only valuable in very narrow use cases and are unable to handle complex tasks. However, the field is rapidly changing and advances in algorithms are having a very significant impact.

[February 15] Demystifying Knowledge Graphs – Applications in Discovery, Compliance and Governance

A knowledge graph is a type of data representation that utilizes a network of interconnected nodes to represent real-world entities and the relationships between them. This makes it an ideal tool for data discovery, compliance, and governance tasks, as it allows users to easily navigate and understand complex data sets. In this webinar, we will demystify knowledge graphs and explore their various applications in data discovery, compliance, and governance. We will begin by discussing the basics of knowledge graphs and how they differ from other data representation methods. Next, we will delve into specific use cases for knowledge graphs in data discovery, such as for exploring and understanding large and complex datasets or for identifying hidden patterns and relationships in data. We will also discuss how knowledge graphs can be used in compliance and governance tasks, such as for tracking changes to data over time or for auditing data to ensure compliance with regulations. Throughout the webinar, we will provide practical examples and case studies to illustrate the benefits of using knowledge graphs in these contexts. Finally, we will cover best practices for implementing and maintaining a knowledge graph, including tips for choosing the right technology and data sources, and strategies for ensuring the accuracy and reliability of the data within the graph. Overall, this webinar will provide an executive level overview of knowledge graphs and their applications in data discovery, compliance, and governance, and will equip attendees with the tools and knowledge they need to successfully implement and utilize knowledge graphs in their own organizations. *Thanks to ChatGPT for help writing this abstract.

Innovation with Utility in Mind - What’s Ahead for 2023

It has been a year of advances in AI with new tools that create art, write essays, and have conversations that are often (but not always) startlingly eloquent.  It is that space of "not always" that keeps these tools from working out of the box to solve actual business problems without human intervention.