All Posts

What is Semantic Search?

Semantics is the study of meaning. So a semantic search is one which “seeks to improve search accuracy by understanding searcher intent and the contextual meaning of terms … to generate more relevant results.”  Human knowledge and the language that humans use to communicate that knowledge are ambiguous and messy. 

A semantic search is one which “seeks to improve search accuracy by understanding searcher intent and the contextual meaning of terms … to generate more relevant results.

Take the term” diamond,” for example. It could refer to jewelry or sports. If I am searching for “mercury,” is that the planet, the element, or the car? We see the problem in business every day. People use the same term to describe different things, and they also use different terms to describe the same thing. They use vague terms such as “searching for a solution” or “looking for an agreement.” 

The source of search problems - not the technology

Most organizations have problems with search not because the search engine is inherently flawed. Keyword search engines do what they are told: they look for word occurrences. Humans and human language is the bigger problem. For those organizations mature and disciplined enough to utilize the tools and technologies currently available (such as metadata management in SharePoint) it is possible to create very effective search experiences.

However, most organizations do not have their acts together when it comes to enterprise taxonomy and information architecture, which are the core foundation for these processes. In fact, a recent survey of practitioners and executives from industry (283 responses from enterprises of various sizes) found that over two thirds of respondents (68%) rated their organizations as unmanaged or limited in terms of their maturity in enterprise taxonomy. (The choices were “Unmanaged,” “Limited,” “Pervasive,” “Proactive/Optimized,” and “Strategic Business Asset.”)

Without the core of intelligent classification, it is not possible to be successful in content organization, and therefore search will not be as effective as it might otherwise be. However, the new “semantic technologies” can go a long way toward compensating for these structural deficiencies.

Where technology can help

Semantic technologies can interpret the aspects of search  that humans are good at and computers are usually bad at: meaning, nuance, and context. Computers are good at working with long lists of information, large numbers, and calculations -- things that can be dealt with through pure logic. Computers have traditionally had a very difficult time with language and interpretation that relies on subtle differences in context or usage. But, the times they are a changin’.

If metadata is lacking because a coherent taxonomy has never been developed, pre-processing the data can help achieve clarity. For example, if a user is looking for content that pertains to the “Acme” company’s “Deluxe Widget.” Many documents contain “deluxe” and many that contain “widget,” and even more that contain “Acme.” But if the three terms are together, then you can be assured that this is the right product information. 

Semantic technologies have the ability to subject the queries to all sorts of pre-processing manipulations which can effectively identify the user, understand the term, interpret that term based on a use case, and associate terms that are automatically discovered.  We can use query rules to change the nature of a term to align more closely with what the user is asking for. This effectively means that the search engine can recognize the problem that the user is trying to solve and can present results that depend on the identity of the user and the nature of the tasks. 

Semantic search-based applications represent the next stage of search, tuning the results to specific end users and getting people the information they need in the context of the goals they are trying to achieve. 

Learn the crucial roles that taxonomy and metadata play effective enterprise content and knowledge management systems in Searching for Gold: Harnessing the Power of Taxonomy and Metadata to Improve Search.

Seth Earley
Seth Earley
Seth Earley is the Founder & CEO of Earley Information Science and the author of the award winning book The AI-Powered Enterprise: Harness the Power of Ontologies to Make Your Business Smarter, Faster, and More Profitable. An expert with 20+ years experience in Knowledge Strategy, Data and Information Architecture, Search-based Applications and Information Findability solutions. He has worked with a diverse roster of Fortune 1000 companies helping them to achieve higher levels of operating performance.

Recent Posts

Use Customer and Behavior Data To Create Personalized Experiences

The more quickly customers can find the product they are seeking, the more likely they are to complete a transaction and to return to the site in the future. Personalizing offers and making well- targeted recommendations can bring customers and products together faster, and are effective ways to engage customers by creating a more positive customer experience. In order to do this, companies need to capture and use as much relevant information as possible. The more that is known about the customer, the more effectively the recommendation system works. Customers generate many signals through their online behavior, and those signals can also be used to understand their interests, purchasing patterns, and needs. Reading their digital body language accurately and creating a valid customer model is essential to anticipating and fulfilling those needs.

How to Instrument KPIs Throughout the Customer Journey

You're probably using metrics to determine if your marketing programs are effective. But, have you selected the right metric at each stage of the customer journey?  Which ones connect to your strategic goals? In this session Seth Earley and Allison Brown talk about how each stage of the journey can be instrumented to use feedback from course corrections to further improve the process. You'll learn: Types of operational and user experience metrics and KPI’s How to select and collect the right metric for each stage of the customer journey How KPIs can be used for data-driven decisions How to manage conflicting goals and metrics

First Party Data - Managing and Monetizing the "Data Exhaust" From Your MarTech Stack

Understanding, anticipating and responding to the wants, needs and behaviors of your customer is the competitive battlefield of 2022. However, with new limitations and regulations regarding second and third-party data and tracking cookies, marketers, digital leaders and ecommerce executives have to consider their own methods of collecting and acting upon the data they gather about customers. In this webinar Seth Earley will talk with industry experts about how you need to model, collect, normalize, organize, manage, analyze, and act on customer information. The time to do so is now and we’ll discuss practical ways to move the needle on customer data, customer analytics and orchestration of the customer experience.