How to professionally manage search
To manage search on your website, don’t manage the technology or the content. Manage the task. Success is about finding, not searching.
The following are the steps involved in professionally managing search:
- Identify the top 200-400 search terms on your website. These top 200-400 terms will usually represent a very significant percentage of search volume.
- Identify the correct search result for each of these search terms.
- Test each of these top search terms in your search engine.
- Measure how often the correct result appears in the first three results. (Research shows that 60 percent of people will click on one of the first three results.)
- Compile a success rate. You will then be able to say something like: Our search has a 45 percent success rate. Then you can plan for how you will increase that success rate.
This is just the first stage in professionally managing search. The next is to identify the search component in key organization tasks and to show how improved search improves task completion.
I once asked a senior manager in an insurance company why management in his organization didn’t care about search. Their search was pretty awful but there were no plans to do anything about it.
His reply was that search was this vague thing that nobody was really responsible for. In his opinion, until improvement in search was directly linked to improvements within the key functions of the business, it would continue to be ignored.
He gave an example. He said an important business metric was the annual cost of managing existing customers. If improved search could be directly linked with reducing this cost, then that would surely get attention.
For certain organizations it may even be the case that search does not add enough value. There are many websites where navigation is much more important than search. For example, Gap.com doesn’t have a search engine.
What is certainly true is that you don’t need a poorly performing search engine. If you can’t allocate the resources to manage search professionally, then it is a much better management decision to get rid of your search engine.
You may also find that as you improve the quality of task completion on your website, your search activity will decline. We once worked with an intranet where it was very difficult to find correct office and building location information.
Nobody really owned location information and, as a result, a huge variety of maps and directional information had been created over the years. Much of this information was out-of-date and/or poorly designed and confusing.
This location information was cleaned up. A new office locator was launched, which was much more accurate and easier to use. What was interesting to note was that as the office locator became more popular, the number of location-type searches in the general search engine showed a significant decline.
We are only at the beginning of the information revolution. Search, by definition, is a frustrating and unproductive activity. As we design better websites, and as people become more familiar with the Web, search activity will decline.
Search in itself is never the objective. You search for McDonald’s not to find McDonald’s, but because you’re hungry and you want to eat a Big Mac and fries.

Alan says:
Added on May 14th, 2007 at 11:43 amThough I think I understand why you said “Search, by definition, is a frustrating and unproductive activity. As we design better websites, and as people become more familiar with the Web, search activity will decline…Search in itself is never the objective.†I disagree for two reasons.
First, search has been and forever will be an important component of our habits. Whether it was stopping by the hardware store seventy years ago to see what was new to stopping in the bookstore today to see what books and magazines are available, searching, looking, wondering what we will find is a natural part of our makeup. So I would disagree that search is by definition a frustrating and unproductive activity nor do I think it will decline.
Second, I think the assumption you make about the design of better Web sites and more familiarity with the Web leading to less searching is also wrong. The amount of information available has for the most part always outpaced the ability to manage that information, leading to the development of new ways to manage and present the information. If this is true, then the growth of the Web will always be in front of the design of Web sites and the ability of information architects to present that information in a useful and efficient way. Unless the is a decline in the propagation of information, I don’t foresee Web site design catching up for quite a while.â€
Cheers,
Alan
Peter Cullen says:
Added on May 14th, 2007 at 1:26 pm’search was this vague thing that nobody was really responsible for’ Interesting sentence this.
Who actually owns ‘Search’ in large companies?
Is it the IT function, Communications, Marketing? Sales?
If companies don’t see ‘Search’ as strategic, which it surely must be in today’s world, how can they plan to exploit its benefits?
This approach is typical of companies getting wrapped up in ‘its all about us’ mentality and having a blind side when it comes to company information and how it can be exploited for profit.
Rolf Molich says:
Added on May 14th, 2007 at 7:48 pmGreat points. I have used this method myself for a client, a midsize Danish town (Kolding), and it was a tremendous success.
Four of the keywords on the top-10 search terms were completely unexpected to the web team. These words were: hotel, shopping mall, library, cinema. In all cases, the web team’s immediate response was: “It’s not our job to handle queries like that properly.”
Fortunately, the web team quickly realized that it was their job to handle frequent requests from their citizens’ properly, regardless of their personal opinion of the appropriateness of the request. They solved the problem very nicely by tuning the search engine for the top-200 search terms so in case the proper search result did not appear by itself, they simply inserted a message like: “You searched for “hotel”. May we suggest the Kolding tourist office website http://www.visitkolding.dk“. A constructive, precise and inoffensive message. Great!
The study was done in 2003. The web team now regularly checks its top-200 search terms and tweaks the search results. After the initial effort it’s not much work.
Gerry McGovern (blog author) says:
Added on May 14th, 2007 at 10:15 pmAlan, I think you’re right. Information is growing faster than our ability to develop habits, so we will probably be searching for many years to come.
I was thinking of a pattern where you started with search, you found something good, then you came back to the same place. But it’s a big–and getting bigger world–out there.
I think Peter nails something when he asks: who is responsible for search? It’s such an important activity today. Who should manage it, I wonder? Who has the best skills?
And Rolf gives a simple, practical and hugely powerful example of just what best practice in search management means on a day-to-day basis.