All Posts

Heuristics and Empirics, Natural Frenemies

A simple question -- How do you know when you’re right? – led me down a long and treacherous path of self-discovery. The truth is that it is very easy to think that content models are correct, vocabularies complete, and process flows comprehensive and strategically appropriate, but very hard to actually know. (And frankly, this is not good for business!)

I began exploring the patterns of both development and validation – how models are created and then tested – and found a deceptively simple duality: heuristics vs. empirics. Heuristics can be thought of as the mental or creative model, based on what feels like gut instinct but is actually the wealth of tacit knowledge accumulated over time. Heuristic thinking is disguised as “genius” and “intuition,” but it’s also the only way to predict and define a future state that doesn’t yet exist outside the imagination. Empirics, in contrast, are all about the current reality, the often complicated truth. Empiricists are natural guides through the intricacies of hard data, analytically synthesizing the details and behavior of actual data and actual content consumers (users). Wherever the heuristic strategist dreams of an elegant solution, the empirical realist smashes it with measurable fact.

And so heuristic and empirics are both natural partners and natural enemies. You might even say frenemies. And their stadium is one of current state. Heuristic approaches are about advancing current state to something faster, more elegant and more efficient, whereas empirical approaches are about better understanding the current state, discovering patterns of strength and weakness not through brainstorming but simple observation.

Let’s take the example of a controlled vocabulary, such as a list of product categories. If a florist wanted to build a list of words that broadly describe collections of product types, it could approach the problem both heuristically and empirically. Heuristically, a few experienced people can gather in a room and collaborate on how they think about florists products. There are things that grow, like seeds and plants, and things that don’t, like soil and fertilizer and tools. Plants themselves can then be divided into types of plants, such as flowering and nonflowering, edible and inedible, aromatic and nonaromatic, native and nonnative. This top-down brainstorming is indicative of heuristic work.

Alternatively (or simultaneously), a hands-on inspection of all of the florist’s current products, as well as any products they expect to sell in the near future and those sold by competitors, can uncover some interesting perspectives. There are products bought by amateurs or professionals, in bulk or in individual units, during the summer months or all year round, from brand-name vendors or with indifference to source, paired with other products or in isolation. The key to this bottom-up approach is access to data: catalogs (which may already have structure that’s helpful or misleading), purchase records, seasonal data, search queries, behavioral observations. Rarely are empirical data “pretty,” but a smart visualization can bring this knowledge quickly to the light.

Of course, all of this doesn’t yet answer the original question, How do you know when you’re right? For this answer, you’re going to have to wait for my next post. In the meantime, recognize that this question must be answered with a question: Do you mean heuristically or empirically? Because clearly the answer is something like “a little bit of both.”

For more on this topic see, Using CRANIUM for Empirical Testing.

Recent Posts

Use Customer and Behavior Data To Create Personalized Experiences

The more quickly customers can find the product they are seeking, the more likely they are to complete a transaction and to return to the site in the future. Personalizing offers and making well- targeted recommendations can bring customers and products together faster, and are effective ways to engage customers by creating a more positive customer experience. In order to do this, companies need to capture and use as much relevant information as possible. The more that is known about the customer, the more effectively the recommendation system works. Customers generate many signals through their online behavior, and those signals can also be used to understand their interests, purchasing patterns, and needs. Reading their digital body language accurately and creating a valid customer model is essential to anticipating and fulfilling those needs.

How to Instrument KPIs Throughout the Customer Journey

You're probably using metrics to determine if your marketing programs are effective. But, have you selected the right metric at each stage of the customer journey?  Which ones connect to your strategic goals? In this session Seth Earley and Allison Brown talk about how each stage of the journey can be instrumented to use feedback from course corrections to further improve the process. You'll learn: Types of operational and user experience metrics and KPI’s How to select and collect the right metric for each stage of the customer journey How KPIs can be used for data-driven decisions How to manage conflicting goals and metrics

First Party Data - Managing and Monetizing the "Data Exhaust" From Your MarTech Stack

Understanding, anticipating and responding to the wants, needs and behaviors of your customer is the competitive battlefield of 2022. However, with new limitations and regulations regarding second and third-party data and tracking cookies, marketers, digital leaders and ecommerce executives have to consider their own methods of collecting and acting upon the data they gather about customers. In this webinar Seth Earley will talk with industry experts about how you need to model, collect, normalize, organize, manage, analyze, and act on customer information. The time to do so is now and we’ll discuss practical ways to move the needle on customer data, customer analytics and orchestration of the customer experience.